-- Logs begin at Mon 2022-09-05 16:20:26 UTC, end at Mon 2022-09-05 17:53:01 UTC. -- Sep 05 16:53:02.972961 dv-cinder-855964-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 05 16:53:02.981417 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 05 16:53:02.984046 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 5 16:53:02 2022] *** Sep 05 16:53:02.984046 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 05 16:53:02.984046 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 05 16:53:02.984046 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: nodename: dv-cinder-855964-1-iscsi Sep 05 16:53:02.984046 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: machine: x86_64 Sep 05 16:53:02.984046 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: clock source: unix Sep 05 16:53:02.984046 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: pcre jit disabled Sep 05 16:53:02.984046 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: detected number of CPU cores: 4 Sep 05 16:53:02.984046 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: current working directory: / Sep 05 16:53:02.984046 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: detected binary path: /usr/bin/uwsgi-core Sep 05 16:53:02.984046 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: your processes number limit is 47680 Sep 05 16:53:02.984046 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: your memory page size is 4096 bytes Sep 05 16:53:02.984046 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: detected max file descriptor number: 2048 Sep 05 16:53:02.984046 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: lock engine: pthread robust mutexes Sep 05 16:53:02.984990 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: thunder lock: enabled Sep 05 16:53:02.984990 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 05 16:53:02.984990 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 05 16:53:03.022583 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: Python main interpreter initialized at 0x560f01c9d9c0 Sep 05 16:53:03.022583 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: python threads support enabled Sep 05 16:53:03.022583 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: your server socket listen backlog is limited to 100 connections Sep 05 16:53:03.022583 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: your mercy for graceful operations on workers is 90 seconds Sep 05 16:53:03.022932 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: mapped 403077 bytes (393 KB) for 2 cores Sep 05 16:53:03.023010 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: *** Operational MODE: preforking *** Sep 05 16:53:03.023247 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: *** uWSGI is running in multiple interpreter mode *** Sep 05 16:53:03.023247 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: spawned uWSGI master process (pid: 105528) Sep 05 16:53:03.025684 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: spawned uWSGI worker 1 (pid: 105529, cores: 1) Sep 05 16:53:03.025684 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: spawned uWSGI worker 2 (pid: 105530, cores: 1) Sep 05 16:53:03.025684 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 05 16:53:03.023443 dv-cinder-855964-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 05 16:53:03.676060 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 05 16:53:03.676938 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 05 16:53:04.746269 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 16:53:04.746269 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: from cryptography.utils import int_from_bytes Sep 05 16:53:04.746862 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 16:53:04.746862 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: from cryptography.utils import int_from_bytes Sep 05 16:53:04.746862 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 16:53:04.746862 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: from cryptography.utils import int_from_bytes Sep 05 16:53:04.747627 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 16:53:04.747627 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: from cryptography.utils import int_from_bytes Sep 05 16:53:07.184435 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 16:53:07.185147 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 16:53:07.185511 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 16:53:07.185609 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 16:53:07.185698 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 16:53:07.185778 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 16:53:07.185861 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 16:53:07.185941 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 16:53:07.186020 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 16:53:07.186116 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 16:53:07.186203 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.186288 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.186501 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.186593 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.186754 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.186919 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.187019 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.187205 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.187338 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.187564 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.187697 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.187833 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.187923 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.188181 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.188316 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.188505 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.188601 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.188820 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.188931 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.189072 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.189169 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.189388 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.189486 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855964-1-iscsi {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.189709 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855964-1-iscsi {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.189801 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.190001 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.190121 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.190293 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.190444 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.190594 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.190683 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.190890 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.190987 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.191190 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.191278 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.191487 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.191570 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.191794 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.191975 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.192318 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.192458 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.192633 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.192751 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.192934 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.193050 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.193260 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.193383 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.193562 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.193676 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.193865 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.193973 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.194188 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.194328 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.194486 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.194605 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.194788 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.194899 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.195103 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.195198 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.195405 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.195494 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855964-1-iscsi {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.195794 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855964-1-iscsi {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.195890 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.196096 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.196228 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.196445 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.196538 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.196742 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.196847 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.197119 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.197218 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.197419 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.197517 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.197728 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.197813 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.198039 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.198123 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.198339 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.198434 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.198645 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.198732 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.198958 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.199056 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.199267 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.199356 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.199576 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.199696 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.199869 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.199963 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.200237 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.200358 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.200564 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.200714 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.200872 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.201026 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.201202 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.201344 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.201441 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.201650 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.201753 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.201951 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.202063 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.202194 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.202280 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.202495 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.202583 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.202820 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.202907 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.203090 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.203183 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.203334 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.203441 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.203642 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.203730 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.203920 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.204006 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.204260 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.204442 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.204584 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.204731 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.204873 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.205008 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.205154 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.205288 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.205422 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.205555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.205698 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.205832 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.205981 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.206115 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.206260 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.206402 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.206554 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.206726 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.206870 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.207020 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.207159 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.207299 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.207440 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.207575 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.207718 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.207858 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.208049 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.208229 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.208362 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.208496 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.208642 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.208776 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.208970 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.209115 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.209283 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.209396 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.209586 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.209686 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.209897 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.209988 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.210201 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.210301 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.210497 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.210602 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.210797 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.210896 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.211093 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.211196 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.211395 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.211486 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.211730 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.211864 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.212005 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.212115 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.212287 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.212382 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.212545 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.212643 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.212861 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.213006 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.213168 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.213303 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.213468 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.213603 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.213732 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.213840 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.214058 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.214193 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.214322 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.214469 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.214645 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.214790 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.214888 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.214970 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.215222 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.215361 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.215490 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.215586 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.215826 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.215934 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.216176 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.216472 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.216915 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.217059 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.217226 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.217374 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.217489 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.217597 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.217823 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.217955 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.218105 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.218198 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.218417 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.218528 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.218724 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.218824 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.219022 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.219126 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.219319 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.219422 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.219613 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.219713 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.219908 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.219998 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.220241 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.220354 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.220540 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.220641 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.220892 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.220999 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.221146 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.221247 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.221439 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.221531 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.221735 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.221834 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.222027 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.222162 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.222327 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.222445 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.222623 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.222719 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.222933 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.223038 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.223226 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.223319 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.223520 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.223613 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.223826 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.223927 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.224121 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.224229 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.224444 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.224585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.224740 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.224829 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.225034 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.225123 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.225331 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.225417 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.225629 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.225723 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.225926 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.226023 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.226219 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.226323 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.226511 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.226610 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.226821 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.226945 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.227131 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.227297 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.227434 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.227520 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.227730 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.227825 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.228028 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.228127 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.228364 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.228454 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 16:53:07.228690 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.228776 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.229012 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.229108 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.229347 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.229434 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.229966 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.230065 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.230293 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.230391 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.230618 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.230704 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.230944 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.231081 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.231264 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.231500 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.231629 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.231718 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.231986 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.232132 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.232288 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.232389 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.232603 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.232690 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.232909 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.232994 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.233224 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.233333 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.233538 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.233625 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.233863 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.233956 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.234177 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.234274 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.234487 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.234581 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.234799 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.234886 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.235107 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.235195 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.235417 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.235503 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.235740 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.235833 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.236054 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.236140 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.236386 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.236488 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.236720 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.236815 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.237060 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.237146 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.237367 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.237452 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.237685 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.237780 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.238000 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.238124 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.238308 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.238396 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.238616 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.238721 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.238921 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.239007 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.239260 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.239352 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.239566 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.239664 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.239874 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.239960 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.240208 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.240300 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.240517 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.240606 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.240835 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.240920 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.241140 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.241225 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.241447 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.241535 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.241751 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.241837 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.242053 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.242147 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.242359 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.242445 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.242692 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.242786 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.243002 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.243089 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.243319 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.243405 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.243625 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.243711 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.243934 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.244019 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.244268 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.244358 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.244578 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.244664 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.244885 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.244987 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.245192 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.245279 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.245490 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.245582 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.245789 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.245884 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.246086 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.246183 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.246389 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.246498 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.246693 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.246789 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.247076 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.247217 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.247366 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.247619 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.247715 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.247929 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.248017 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.248286 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.248390 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.248590 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.248687 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.248895 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.248990 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.249200 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.249286 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.249502 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.249596 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.249800 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.249886 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.250106 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.250199 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.250409 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.250574 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.250711 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.250799 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.251020 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.251114 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.251323 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.251430 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.251618 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.251705 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.251930 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.252017 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.252251 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.252341 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.252559 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.252656 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.252867 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.252953 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.253173 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.253269 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.253480 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.253568 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.253783 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.253877 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.254088 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.254188 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.254392 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.254479 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.254695 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.254795 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.254998 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.255094 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.255321 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.255409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.255624 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.255723 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.255929 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.256015 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.256275 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.256366 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.256589 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.256689 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.256891 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.256978 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.257184 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.257270 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.257486 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.257587 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.257783 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.257869 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.258080 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.258166 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.258375 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.258471 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.258671 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.258758 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.258961 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.259047 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.259256 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.259344 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.259549 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.259685 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.259845 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.259941 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.260139 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.260290 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.260471 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.260576 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.260772 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.260858 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.261065 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.261152 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.261361 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.261447 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.261654 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.261740 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.261980 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.262067 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.262276 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.262370 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.262703 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.262835 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.263029 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.263155 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.263343 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.263476 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.263659 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.263789 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.263964 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.264103 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.264300 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.264435 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.264604 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.264745 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.264908 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.265051 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.265212 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.265357 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.265514 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.265674 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.265824 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.265980 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.266125 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.266295 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.266436 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.266601 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.266739 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.266920 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.267056 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.267224 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.267367 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.267540 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.267656 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.267839 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.267957 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.268187 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.268292 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.268506 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.268603 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.268833 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.268928 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.269145 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.269245 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.269461 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.269548 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.269772 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.269867 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.270083 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.270181 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.270388 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.270481 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.270691 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.270784 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.270991 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.271077 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.271291 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.271377 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.271601 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.271695 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.271900 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.271987 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.272231 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.272322 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.272536 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.272623 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.272850 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.272938 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.273146 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.273232 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.273457 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.273542 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.273751 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.273837 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.274055 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.274142 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.274374 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.274471 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.274701 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.274787 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.275007 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.275101 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.275314 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.275408 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.275623 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.275710 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.275927 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.276011 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.276250 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.276352 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.276558 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.276644 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.276856 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.276945 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.277152 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.277247 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.277451 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.277537 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.277757 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.277844 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.278059 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.278162 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.278390 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.278477 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.278697 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.278823 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.278988 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.279071 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.279286 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.279375 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.279582 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.279669 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.279879 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.279977 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.280202 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.280294 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.280518 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.280617 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.280824 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.280911 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.281135 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.281220 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.281449 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.281578 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.281746 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.281836 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.282043 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.282131 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.282357 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.282454 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.282665 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.282755 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.282962 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.283049 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.283257 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.283353 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.283553 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.283650 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.283885 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.283974 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.284210 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.284319 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.284508 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.284597 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.284815 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.284902 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.285127 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.285267 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.285430 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.285516 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.285732 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.285825 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.286034 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.286123 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.286376 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.286628 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.286714 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.286956 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.287062 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.287268 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.287354 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.287566 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.287659 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.287868 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.287969 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.288185 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.288276 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.288488 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.288586 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.288792 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.288904 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.289091 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.289177 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.289391 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.289480 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.289693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.289782 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.289990 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.290093 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.290286 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.290373 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.290591 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.290678 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.290905 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.291154 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.291469 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.291557 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.291776 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.291872 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.292086 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.292232 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.292432 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.292519 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.292749 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.292848 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.293069 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.293176 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.293388 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.293488 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.293691 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.293865 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.294056 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.294159 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.294363 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.294545 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.294668 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.294755 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.294964 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.295051 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.295264 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.295349 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.295558 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.295643 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.295856 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.295945 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.296170 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.296262 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.296474 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.296577 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.296769 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.296863 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.297066 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.297154 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.297363 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.297457 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.297656 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.297752 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.297955 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.298041 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.298250 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.298348 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.298553 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.298642 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.298849 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.298939 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.299147 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.299242 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.299447 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.299542 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.299746 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.299842 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.300045 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.300132 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.300447 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.300550 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.300784 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.300872 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.301082 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.301170 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.301411 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.301507 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.301733 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.301820 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.302062 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.302148 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.302362 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.302481 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.302660 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.302834 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.302979 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.303067 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.303277 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.303365 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.303573 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.303670 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.303868 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.303955 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.304192 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.304296 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.304487 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.304594 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.304781 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.304869 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.305082 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.305167 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.305379 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.305475 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.305680 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.305775 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.305979 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.306066 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.306273 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.306361 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.306572 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.306679 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.306864 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.306969 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.307168 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.307271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.307464 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.307560 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.307758 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.307854 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.308052 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.308162 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.308377 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.308488 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.308675 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.308787 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.308969 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.309065 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.309267 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.309361 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.309601 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.309755 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.310026 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.310272 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.310364 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.310641 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.310749 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.310943 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.311101 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.311244 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.311406 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.311548 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.311716 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.311849 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.312022 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.312181 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.312349 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.312490 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.312672 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.312802 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.312981 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.313106 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.313282 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.313410 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.313580 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.313717 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.313883 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.314020 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.314181 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.314318 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.314475 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.314623 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.314778 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.314940 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.315091 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.315253 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.315402 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.315556 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.315700 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.315863 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.316001 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.316186 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.316341 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.316489 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.316647 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.316790 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.316936 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.317098 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.317240 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.317396 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.317537 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.317695 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.317832 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.317994 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.318127 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.318299 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.318424 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.318596 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.318719 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.318921 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.319035 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.319228 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.319324 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.319529 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.319624 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.319830 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.319930 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.320130 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.320251 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.320486 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.320595 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.320787 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.320875 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.321134 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.321219 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.321432 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.321525 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.321742 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.321847 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.322055 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.322158 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.322357 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.322453 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.322665 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.322749 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.322968 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.323054 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.323267 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.323362 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.323575 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.323660 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.323879 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.323964 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.324206 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.324311 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.324507 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.324592 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.324803 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.324890 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.325168 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.325253 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.325485 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.325642 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.325826 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.325922 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.326087 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.326176 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.326404 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.326499 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.326722 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.326807 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.327019 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.327105 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.327320 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.327407 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.327623 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.327708 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.327926 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.328021 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.328254 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.328342 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.328562 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.328665 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.328868 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.328953 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.329174 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.329268 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.329479 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.329575 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.329784 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.329877 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.330087 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.330181 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.330386 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.330484 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.330697 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.330783 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.331004 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.331089 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.331308 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.331476 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.331649 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.331761 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.331928 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.332022 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.332251 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.332347 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.332558 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.332642 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.332857 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.332972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.333163 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.333250 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.333461 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.333555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.333882 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.333967 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.334185 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.334270 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.334488 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.334573 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.334786 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.334872 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.335091 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.335177 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.335395 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.335478 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.335703 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.335801 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.336010 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.336097 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.336335 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.336421 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.336743 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.336839 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.337046 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.337138 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.337351 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.337435 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.337653 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.337747 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.337952 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.338037 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.338245 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.338329 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.338547 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.338642 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.338864 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.338955 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.339159 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.339243 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.339456 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.339543 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.339750 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.339835 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.340065 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.340178 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.340387 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.340470 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.340726 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.340909 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.341136 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.341445 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.341544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.341748 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.341841 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.342087 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.342176 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.342450 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.342553 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.342761 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.342847 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.343081 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.343178 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.343396 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.343481 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.343711 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.343805 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.344014 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.344101 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.344340 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.344441 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.344652 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.344740 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.344960 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.345046 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.345277 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.345374 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.345586 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.345681 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.345890 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.345977 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.346192 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.346291 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.346490 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.346583 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.346806 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.346902 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.347113 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.347205 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.347431 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.347526 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.347819 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.347905 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.348163 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.348263 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.348475 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.348562 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.348792 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.348878 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.349114 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.349215 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.349418 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.349513 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.349718 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.349804 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.350025 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.350121 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.350327 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.350413 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.350625 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.350709 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.350924 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.351020 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.351225 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.351310 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.351525 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.351617 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.351828 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.351914 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.352132 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.352257 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.352460 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.352558 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.352766 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.352865 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.353065 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.353150 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.353371 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.353455 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.353668 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.353770 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.353983 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.354068 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.354289 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.354374 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.354922 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.355015 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.355224 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.355310 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.355522 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.355616 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.355839 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.355931 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.356142 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.356350 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.356582 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.356679 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.356954 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.357039 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.357265 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.357349 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.357583 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.357678 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.357895 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.357982 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.358215 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.358301 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.358536 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.358634 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.358843 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.358938 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.359148 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.359233 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.359475 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.359578 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.359793 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.359878 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.360104 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.360210 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.360436 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.360532 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.360749 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.360837 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.361048 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.361133 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.361353 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.361447 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.361652 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.361745 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.361951 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.362035 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.362249 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.362343 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.362547 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.362651 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.362850 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.362947 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.363151 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.363236 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.363447 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.363539 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.363745 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.363840 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.364045 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.364132 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.364378 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.364465 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.364676 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.364770 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.364991 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.365077 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.365292 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.365377 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.365591 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.365684 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.365888 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.365975 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.366184 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.366275 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.366510 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.366596 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.366807 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.366891 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.367130 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.367215 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.367434 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.367528 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.367748 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.367841 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.368059 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.368205 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.368395 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.368507 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.368705 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.368817 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.369015 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.369128 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.369322 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.369442 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.369630 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.369749 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.369938 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.370062 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.370242 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.370355 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.370550 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.370660 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.370857 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.371014 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.371170 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.373318 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.374033 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.374152 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.374152 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.374367 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.374483 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.374590 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.374705 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.374810 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.374924 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.375028 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.375132 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.375235 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.375345 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.375459 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.375563 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.375666 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.375771 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.375874 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.375977 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.376090 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.376215 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.376324 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.376413 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.376493 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.376572 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.376665 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.376749 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.376836 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.376924 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.377010 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.377098 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.377186 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.377272 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.377359 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.377448 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.377528 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.377616 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.377700 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.377791 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.377872 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.377952 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.378112 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.378203 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.378322 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.378416 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.378633 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.378729 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.378973 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.379108 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.379285 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.379419 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.379589 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.379725 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.379901 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.380049 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.380209 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.380316 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.380526 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.380671 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.380834 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.380987 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.381116 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.381214 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.381447 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.381595 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.381734 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.381834 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.382073 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.382221 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.382353 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.382449 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.382703 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.382837 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.383009 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.383153 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.383292 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.383520 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.383702 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.383829 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.384113 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.384224 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.384447 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.384540 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.384772 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.384863 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.385088 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.385188 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.385406 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.385498 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.385711 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.385800 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.386014 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.386116 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.386314 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.386405 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.386612 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.386701 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.386898 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.387033 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.387199 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.387308 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.387544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.387648 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.387848 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.387956 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.388166 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.388269 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.388491 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.388676 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.388801 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.388977 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.389291 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.389395 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.389598 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.389686 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.389981 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.390123 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.390307 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.390482 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.390633 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.390791 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.390955 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.391107 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.391260 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.391425 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.391583 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.391737 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.391888 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.392043 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.392221 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.392384 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.392542 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.392685 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.392856 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.393002 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.393163 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.393296 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.393462 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.393626 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.393779 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.393906 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.394089 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.394235 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.394372 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.394516 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.394671 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.394803 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.394973 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.395108 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.395300 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.395442 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.395590 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.395718 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.395893 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.396028 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.396213 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.396356 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.396514 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.396656 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.396819 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.396955 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.397121 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.397257 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.397417 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.397575 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.397707 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.397837 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.398001 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.398143 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.398298 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.398432 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.398605 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.398737 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.398903 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.399033 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.399188 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.399321 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.399487 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.399629 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.399792 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.399934 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.400112 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.400241 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.400453 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.400553 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.400751 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.400838 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.401049 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.401134 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.401352 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.401452 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.401650 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.401736 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.401958 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.402046 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.402263 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.402363 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.402578 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.402665 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.402884 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.402970 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.403275 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.403388 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.403607 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.403800 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.403965 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.404135 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.404464 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.404554 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.404792 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.404877 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.405108 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.405194 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.405411 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.405497 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.405713 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.405798 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.406013 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.406099 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.406325 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.406412 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.406628 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.406715 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.406935 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.407031 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.407240 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.407326 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.407545 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.407637 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.407848 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.407942 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.408185 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.408276 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.408480 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.408576 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.408784 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.408885 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.409090 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.409184 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.409394 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.409480 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.409696 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.409790 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.410001 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.410086 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.410303 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.410388 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.410607 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.410702 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.410912 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.411006 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.411216 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.411303 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.411528 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.411625 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.411852 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.411937 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.412177 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.412264 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.412492 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.412588 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.412798 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.412892 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.413107 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.413201 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.413412 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.413500 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.413716 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.413800 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.414020 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.414194 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.414321 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.414408 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.414628 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.414716 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.414930 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.415029 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.415246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.415545 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.415636 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.415921 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.416254 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.416345 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.416567 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.416654 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.416879 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.416964 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.417198 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.417324 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.417507 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.417600 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.417818 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.417905 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.418133 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.418222 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.418441 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.418538 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.418816 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.418930 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.419122 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.419211 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.419445 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.419639 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.419777 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.419968 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.420100 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.420299 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.420445 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.420608 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.420747 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.420918 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.421047 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.421229 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.421347 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.421549 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.421637 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.421859 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.421949 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.422165 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.422253 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.422475 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.422573 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.422784 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.422871 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.423086 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.423173 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.423388 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.423485 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.423683 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.423770 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.423980 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.424084 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.424327 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.424449 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.424603 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.424699 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.424897 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.424985 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.425193 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.425291 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.425490 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.425578 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.425786 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.425882 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.426082 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.426172 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.426379 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.426467 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.426679 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.426765 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.426973 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.427061 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.427272 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.427361 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.427569 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.427664 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.427863 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.427952 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.428177 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.428270 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.428509 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.428610 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.428831 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.428918 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.429138 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.429225 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.429450 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.429546 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.429753 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.429840 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.430067 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.430157 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.430373 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.430470 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.430688 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.430791 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.431001 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.431096 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.431311 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.431408 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.431626 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.431727 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.431933 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.432033 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.432257 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.432350 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.432565 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.432653 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.432876 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.432963 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.433179 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.433267 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.433483 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.433572 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.433787 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.433874 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.434105 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.434199 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.434510 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.434690 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.434864 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.435022 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.435148 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.435233 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.435446 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.435546 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.435760 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.435866 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.436071 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.436240 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.436423 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.436510 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.436734 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.436834 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.437044 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.437130 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.437353 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.437438 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.437660 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.437755 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.437964 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.438056 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.438268 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.438354 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.438573 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.438660 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.438874 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.438959 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.439180 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.439267 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.439489 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.439585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.439798 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.439885 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.440121 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.440229 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.440463 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.440551 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.440768 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.440854 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.441090 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.441185 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.441409 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.441504 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.441749 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.441836 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.442057 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.442152 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.442398 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.442485 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.442708 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.442792 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.443017 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.443183 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.443320 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.443417 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.443561 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 16:53:07.443649 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 16:53:07.443844 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 16:53:07.597591 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO dbcounter [None req-381435ba-272d-497b-b271-89af5f5e816e None None] Registered counter for database nova_api Sep 05 16:53:07.597817 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO dbcounter [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] Registered counter for database nova_api Sep 05 16:53:07.618187 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_db.sqlalchemy.engines [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 16:53:07.620356 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG oslo_db.sqlalchemy.engines [None req-381435ba-272d-497b-b271-89af5f5e816e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105529) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 16:53:07.625638 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writer thread running {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 16:53:07.627576 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG dbcounter [-] [105529] Writer thread running {{(pid=105529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 16:53:07.682527 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.context [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),58a28fd3-8685-4f6c-b4e5-aee03c36263b(cell1) {{(pid=105530) load_cells /opt/stack/nova/nova/context.py:464}} Sep 05 16:53:07.686625 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 16:53:07.687031 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 16:53:07.688644 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 16:53:07.689370 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 16:53:07.689815 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 16:53:07.691812 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 16:53:07.693856 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO dbcounter [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] Registered counter for database nova_cell0 Sep 05 16:53:07.696112 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.context [None req-381435ba-272d-497b-b271-89af5f5e816e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),58a28fd3-8685-4f6c-b4e5-aee03c36263b(cell1) {{(pid=105529) load_cells /opt/stack/nova/nova/context.py:464}} Sep 05 16:53:07.697890 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO dbcounter [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] Registered counter for database nova_cell1 Sep 05 16:53:07.700267 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG oslo_concurrency.lockutils [None req-381435ba-272d-497b-b271-89af5f5e816e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105529) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 16:53:07.700933 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG oslo_concurrency.lockutils [None req-381435ba-272d-497b-b271-89af5f5e816e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105529) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 16:53:07.702605 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG oslo_concurrency.lockutils [None req-381435ba-272d-497b-b271-89af5f5e816e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105529) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 16:53:07.703755 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG oslo_concurrency.lockutils [None req-381435ba-272d-497b-b271-89af5f5e816e None None] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105529) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 16:53:07.704469 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG oslo_concurrency.lockutils [None req-381435ba-272d-497b-b271-89af5f5e816e None None] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105529) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 16:53:07.707668 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_db.sqlalchemy.engines [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 16:53:07.707820 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG oslo_concurrency.lockutils [None req-381435ba-272d-497b-b271-89af5f5e816e None None] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105529) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 16:53:07.708579 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_db.sqlalchemy.engines [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 16:53:07.709007 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO dbcounter [None req-381435ba-272d-497b-b271-89af5f5e816e None None] Registered counter for database nova_cell0 Sep 05 16:53:07.713168 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO dbcounter [None req-381435ba-272d-497b-b271-89af5f5e816e None None] Registered counter for database nova_cell1 Sep 05 16:53:07.714108 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writer thread running {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 16:53:07.719641 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writer thread running {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 16:53:07.720982 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG oslo_db.sqlalchemy.engines [None req-381435ba-272d-497b-b271-89af5f5e816e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105529) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 16:53:07.723171 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG oslo_db.sqlalchemy.engines [None req-381435ba-272d-497b-b271-89af5f5e816e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105529) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 16:53:07.728323 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG dbcounter [-] [105529] Writer thread running {{(pid=105529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 16:53:07.734168 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG dbcounter [-] [105529] Writer thread running {{(pid=105529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 16:53:07.860607 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO dbcounter [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] Registered counter for database nova_cell0 Sep 05 16:53:07.869816 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_db.sqlalchemy.engines [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 16:53:07.874003 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO dbcounter [None req-381435ba-272d-497b-b271-89af5f5e816e None None] Registered counter for database nova_cell0 Sep 05 16:53:07.875864 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writer thread running {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 16:53:07.883124 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG oslo_db.sqlalchemy.engines [None req-381435ba-272d-497b-b271-89af5f5e816e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105529) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 16:53:07.889302 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG dbcounter [-] [105529] Writer thread running {{(pid=105529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 16:53:08.213515 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: WARNING keystonemiddleware.auth_token [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 16:53:08.220035 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: WARNING keystonemiddleware.auth_token [None req-381435ba-272d-497b-b271-89af5f5e816e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 16:53:08.221023 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: WARNING keystonemiddleware.auth_token [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 16:53:08.227298 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: WARNING keystonemiddleware.auth_token [None req-381435ba-272d-497b-b271-89af5f5e816e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 16:53:08.561136 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: WARNING keystonemiddleware.auth_token [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 16:53:08.565346 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: WARNING keystonemiddleware.auth_token [None req-381435ba-272d-497b-b271-89af5f5e816e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 16:53:08.567183 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: WARNING keystonemiddleware.auth_token [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 16:53:08.571262 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: WARNING keystonemiddleware.auth_token [None req-381435ba-272d-497b-b271-89af5f5e816e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 16:53:08.572866 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560f01c9d9c0 pid: 105530 (default app) Sep 05 16:53:08.574946 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:53:08.576194 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001788 Sep 05 16:53:08.576585 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Mon Sep 5 16:53:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:53:08.576735 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560f01c9d9c0 pid: 105529 (default app) Sep 05 16:54:27.170875 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:54:27.172661 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002200 Sep 05 16:54:27.173276 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 931 bytes} [Mon Sep 5 16:54:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 16:54:27.185429 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG dbcounter [-] [105529] Writing DB stats nova_api:SELECT=3 {{(pid=105529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:54:27.186560 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG dbcounter [-] [105529] Writing DB stats nova_cell0:SELECT=3 {{(pid=105529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:54:27.187367 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG dbcounter [-] [105529] Writing DB stats nova_cell1:SELECT=3 {{(pid=105529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:54:27.188201 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG dbcounter [-] [105529] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:54:28.079885 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-70601ba9-ca43-48c3-bae8-9e46df5b2204 admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:54:28.112580 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-70601ba9-ca43-48c3-bae8-9e46df5b2204 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.932254 Sep 05 16:54:28.113374 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1292 bytes} [Mon Sep 5 16:54:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 16:54:30.440413 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:54:30.441397 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-6d148612-44c8-4179-a89f-f429dd26c246 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 05 16:54:30.446799 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 931 bytes} [Mon Sep 5 16:54:30 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:54:30.866653 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-c522c23f-b69b-4172-a491-cd6671f7fcce admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:30.913461 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-c522c23f-b69b-4172-a491-cd6671f7fcce admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.465472 Sep 05 16:54:30.914185 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Sep 5 16:54:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 16:54:31.139562 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-36af56fa-2f5c-4b0c-908b-c671523c9441 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:31.146003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_api:SELECT=3 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:54:31.146808 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_cell0:SELECT=3 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:54:31.147681 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_cell1:SELECT=3 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:54:31.148404 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:54:31.209447 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-36af56fa-2f5c-4b0c-908b-c671523c9441 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286808 Sep 05 16:54:31.210072 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1336 bytes} [Mon Sep 5 16:54:30 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 16:54:33.560472 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-c522c23f-b69b-4172-a491-cd6671f7fcce admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:54:33.561537 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-c522c23f-b69b-4172-a491-cd6671f7fcce admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Sep 05 16:54:33.562222 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 931 bytes} [Mon Sep 5 16:54:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:54:34.334033 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-84942e3a-c71b-4675-91ac-e66171aaabda admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M"}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:34.381573 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-84942e3a-c71b-4675-91ac-e66171aaabda admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.812614 Sep 05 16:54:34.386963 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Sep 5 16:54:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 16:54:34.394948 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-5ffdf0e3-35d7-4aaf-8f8e-fdf77b23da8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:34.432800 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-5ffdf0e3-35d7-4aaf-8f8e-fdf77b23da8a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041336 Sep 05 16:54:34.433381 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1336 bytes} [Mon Sep 5 16:54:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 16:54:36.767349 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-84942e3a-c71b-4675-91ac-e66171aaabda admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:54:36.768320 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-84942e3a-c71b-4675-91ac-e66171aaabda admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Sep 05 16:54:36.768757 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 931 bytes} [Mon Sep 5 16:54:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:54:37.190679 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-5ac79e59-a686-493e-96b1-0c420baf5724 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2"}} {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:37.211234 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-5ac79e59-a686-493e-96b1-0c420baf5724 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436452 Sep 05 16:54:37.212128 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Sep 5 16:54:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 16:54:37.224405 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-f0d051ae-bc91-48ea-ad8d-91a05630501c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:37.250353 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-f0d051ae-bc91-48ea-ad8d-91a05630501c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029758 Sep 05 16:54:37.251013 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1336 bytes} [Mon Sep 5 16:54:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 16:54:39.602076 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-5ac79e59-a686-493e-96b1-0c420baf5724 admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:54:39.603772 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-5ac79e59-a686-493e-96b1-0c420baf5724 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002151 Sep 05 16:54:39.604762 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 931 bytes} [Mon Sep 5 16:54:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:54:40.097967 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-e50edc7c-3199-4c2e-8757-5764556a83f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "vcpus": 2, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:40.121256 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-e50edc7c-3199-4c2e-8757-5764556a83f2 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.509915 Sep 05 16:54:40.122794 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Sep 5 16:54:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 16:54:40.134500 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-1aeee8d8-f363-477f-9085-cf670dc63f8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:40.161066 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-1aeee8d8-f363-477f-9085-cf670dc63f8e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030172 Sep 05 16:54:40.161651 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1336 bytes} [Mon Sep 5 16:54:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 16:54:42.585012 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-e50edc7c-3199-4c2e-8757-5764556a83f2 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:54:42.586026 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-e50edc7c-3199-4c2e-8757-5764556a83f2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Sep 05 16:54:42.586403 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 931 bytes} [Mon Sep 5 16:54:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:54:43.035201 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-0a4236db-86ab-4af6-94bc-a94580591401 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:43.054755 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-0a4236db-86ab-4af6-94bc-a94580591401 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.461337 Sep 05 16:54:43.055304 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Sep 5 16:54:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 16:54:43.067568 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-60f01f42-00f3-40d4-9f9a-027248c7bb44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:43.093995 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-60f01f42-00f3-40d4-9f9a-027248c7bb44 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029935 Sep 05 16:54:43.102999 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1336 bytes} [Mon Sep 5 16:54:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 16:54:45.528921 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-0a4236db-86ab-4af6-94bc-a94580591401 admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:54:45.530141 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-0a4236db-86ab-4af6-94bc-a94580591401 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001807 Sep 05 16:54:45.530546 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 931 bytes} [Mon Sep 5 16:54:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:54:45.956029 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-be3e9f39-0f47-475c-a2d4-6bd975c346a3 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:54:45.980940 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-be3e9f39-0f47-475c-a2d4-6bd975c346a3 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.443657 Sep 05 16:54:45.981507 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1292 bytes} [Mon Sep 5 16:54:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 16:54:48.726958 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-0a4236db-86ab-4af6-94bc-a94580591401 admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:54:48.727922 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-0a4236db-86ab-4af6-94bc-a94580591401 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Sep 05 16:54:48.728586 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 931 bytes} [Mon Sep 5 16:54:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:54:49.299102 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-b6f1381b-75ce-4cd2-ba39-74586eec741d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny"}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:49.321071 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-b6f1381b-75ce-4cd2-ba39-74586eec741d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.585168 Sep 05 16:54:49.321717 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Sep 5 16:54:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 16:54:49.335474 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-3c7dfdbc-1787-41f4-95e0-cb0e3c4bc202 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:49.362090 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-3c7dfdbc-1787-41f4-95e0-cb0e3c4bc202 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030339 Sep 05 16:54:49.362622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1333 bytes} [Mon Sep 5 16:54:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 16:54:51.688199 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-b6f1381b-75ce-4cd2-ba39-74586eec741d admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:54:51.689278 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-b6f1381b-75ce-4cd2-ba39-74586eec741d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Sep 05 16:54:51.689655 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 931 bytes} [Mon Sep 5 16:54:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:54:52.099114 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-9340738b-1887-4f07-a21b-ca6c4c6f9dd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048}} {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:52.120411 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-9340738b-1887-4f07-a21b-ca6c4c6f9dd2 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.424656 Sep 05 16:54:52.120968 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Sep 5 16:54:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 16:54:52.133161 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-2ddbe252-1cbc-44fe-b0ba-7debbc4edfe6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:52.156197 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-2ddbe252-1cbc-44fe-b0ba-7debbc4edfe6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026830 Sep 05 16:54:52.156954 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1333 bytes} [Mon Sep 5 16:54:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 16:54:54.503561 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-9340738b-1887-4f07-a21b-ca6c4c6f9dd2 admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:54:54.506409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-9340738b-1887-4f07-a21b-ca6c4c6f9dd2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003235 Sep 05 16:54:54.507000 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 931 bytes} [Mon Sep 5 16:54:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:54:54.872972 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-3802a45e-ad90-4649-b152-ccab728cb43c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:54.893329 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-3802a45e-ad90-4649-b152-ccab728cb43c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.379614 Sep 05 16:54:54.893882 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Sep 5 16:54:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 16:54:54.906425 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-bdfb1bb5-9e0b-4dee-936d-73d2ab53f7ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:54.936857 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-bdfb1bb5-9e0b-4dee-936d-73d2ab53f7ee admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033475 Sep 05 16:54:54.937917 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1333 bytes} [Mon Sep 5 16:54:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 16:54:57.318265 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-3802a45e-ad90-4649-b152-ccab728cb43c admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:54:57.319349 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-3802a45e-ad90-4649-b152-ccab728cb43c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 05 16:54:57.319753 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 931 bytes} [Mon Sep 5 16:54:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:54:57.795367 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-e97ca135-2b92-44cc-9ffa-96b7477a8952 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "ram": 8192, "swap": 0, "disk": 80, "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:57.804695 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG dbcounter [-] [105529] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:54:57.821235 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-e97ca135-2b92-44cc-9ffa-96b7477a8952 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.481118 Sep 05 16:54:57.828006 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Sep 5 16:54:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 16:54:57.840010 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-df32caa5-6a34-451c-9070-b8d463ed26bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:54:57.878103 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-df32caa5-6a34-451c-9070-b8d463ed26bf admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042099 Sep 05 16:54:57.879009 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1333 bytes} [Mon Sep 5 16:54:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 16:55:00.239917 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-e97ca135-2b92-44cc-9ffa-96b7477a8952 admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:00.241059 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-e97ca135-2b92-44cc-9ffa-96b7477a8952 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Sep 05 16:55:00.245402 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 931 bytes} [Mon Sep 5 16:55:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:55:00.673563 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-6d1afa16-0cf9-4fb8-889d-a7892aa23a7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "swap": 0, "id": "5", "vcpus": 8, "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:55:00.694349 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-6d1afa16-0cf9-4fb8-889d-a7892aa23a7a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.446531 Sep 05 16:55:00.695173 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Sep 5 16:55:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 16:55:00.707734 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-0f8a6fa3-6872-46e2-b4a0-f669befd5adf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:55:00.738687 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-0f8a6fa3-6872-46e2-b4a0-f669befd5adf admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035104 Sep 05 16:55:00.739572 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1333 bytes} [Mon Sep 5 16:55:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 16:55:19.702690 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-6d1afa16-0cf9-4fb8-889d-a7892aa23a7a admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:19.703961 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-6d1afa16-0cf9-4fb8-889d-a7892aa23a7a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001764 Sep 05 16:55:19.704553 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 931 bytes} [Mon Sep 5 16:55:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:55:19.715531 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG dbcounter [-] [105529] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:55:20.150452 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-9ae53c22-ed14-4b29-ab9b-79d92457dddf admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:20.168661 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-9ae53c22-ed14-4b29-ab9b-79d92457dddf admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.457948 Sep 05 16:55:20.169200 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1292 bytes} [Mon Sep 5 16:55:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 16:55:21.291955 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-6d1afa16-0cf9-4fb8-889d-a7892aa23a7a admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:21.293222 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-6d1afa16-0cf9-4fb8-889d-a7892aa23a7a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Sep 05 16:55:21.293767 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Sep 5 16:55:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:55:21.838390 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-7a2315ec-601c-4002-aa1b-acfddde0c2de admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:21.844775 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.wsgi [None req-7a2315ec-601c-4002-aa1b-acfddde0c2de admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-7a2315ec-601c-4002-aa1b-acfddde0c2de admin admin] Request method failure captured: Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Accept: application/json Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Accept-Encoding: gzip, deflate Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Connection: keep-alive Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Content-Length: 0 Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Host: 10.222.0.23 Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Openstack-Api-Version: compute 2.92 Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Openstack-System-Scope: None Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: User-Agent: python-novaclient Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Auth-Token: gAAAAABjFin59pa_Wvk40whTcsz02CS_gRrLAb-oDpcSrFrH7jRstzPeC6gvLSc27tlPxSS1fDHE0jSAzLnXKrGiJnMbVD42mQQOJK6XeBaSjofSsrbJP11YVlhPbknyLhk1V12pO31bvFHyoMeCyaJ7HNi6c8ovWBwnJKNTfYLB5pc0uCkc_mo Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Domain-Id: None Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Domain-Name: None Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Identity-Status: Confirmed Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Is-Admin-Project: True Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Project-Domain-Id: default Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Project-Domain-Name: Default Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Project-Id: 831cdea88c914362aff075e5d457eeb4 Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Project-Name: admin Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Role: member,reader,admin Sep 05 16:55:21.848043 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Roles: member,reader,admin Sep 05 16:55:21.849821 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_831cdea88c914362aff075e5d457eeb4"}]}] Sep 05 16:55:21.849821 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Tenant: admin Sep 05 16:55:21.849821 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Tenant-Id: 831cdea88c914362aff075e5d457eeb4 Sep 05 16:55:21.849821 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Tenant-Name: admin Sep 05 16:55:21.849821 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-User: admin Sep 05 16:55:21.849821 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-User-Domain-Id: default Sep 05 16:55:21.849821 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-User-Domain-Name: Default Sep 05 16:55:21.849821 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-User-Id: fce1040c54ac43928ab07aa4e6b6d613 Sep 05 16:55:21.849821 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-User-Name: admin Sep 05 16:55:21.849821 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: method: > Sep 05 16:55:21.849821 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: exception: Flavor 42 could not be found. Sep 05 16:55:21.849821 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: action_args: {'id': '42'} Sep 05 16:55:21.849821 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 16:55:21.849821 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 16:55:21.850966 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Sep 05 16:55:21.852555 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-7a2315ec-601c-4002-aa1b-acfddde0c2de admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105529) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 16:55:21.854308 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-7a2315ec-601c-4002-aa1b-acfddde0c2de admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.416412 Sep 05 16:55:21.854308 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Sep 5 16:55:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 16:55:21.860791 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-01a9ef47-cd89-4c66-a02e-56167d395e9b admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:21.864916 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:55:21.885261 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-01a9ef47-cd89-4c66-a02e-56167d395e9b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028083 Sep 05 16:55:21.885787 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Sep 5 16:55:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 16:55:21.896055 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-ce23b972-1a7c-4afb-a8a8-eee0e9452763 admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:21.919813 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-ce23b972-1a7c-4afb-a8a8-eee0e9452763 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027509 Sep 05 16:55:21.920388 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Sep 5 16:55:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 16:55:21.933141 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-0cdc0051-d9e4-4210-9abf-e62cdfbd9044 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:21.942900 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.wsgi [None req-0cdc0051-d9e4-4210-9abf-e62cdfbd9044 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-0cdc0051-d9e4-4210-9abf-e62cdfbd9044 admin admin] Request method failure captured: Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Accept: application/json Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Accept-Encoding: gzip, deflate Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Connection: keep-alive Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Content-Length: 0 Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Host: 10.222.0.23 Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Openstack-Api-Version: compute 2.92 Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Openstack-System-Scope: None Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: User-Agent: python-novaclient Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Auth-Token: gAAAAABjFin59pa_Wvk40whTcsz02CS_gRrLAb-oDpcSrFrH7jRstzPeC6gvLSc27tlPxSS1fDHE0jSAzLnXKrGiJnMbVD42mQQOJK6XeBaSjofSsrbJP11YVlhPbknyLhk1V12pO31bvFHyoMeCyaJ7HNi6c8ovWBwnJKNTfYLB5pc0uCkc_mo Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Domain-Id: None Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Domain-Name: None Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Identity-Status: Confirmed Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Is-Admin-Project: True Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Project-Domain-Id: default Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Project-Domain-Name: Default Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Project-Id: 831cdea88c914362aff075e5d457eeb4 Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Project-Name: admin Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Role: member,reader,admin Sep 05 16:55:21.947693 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Roles: member,reader,admin Sep 05 16:55:21.949180 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_831cdea88c914362aff075e5d457eeb4"}]}] Sep 05 16:55:21.949180 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Tenant: admin Sep 05 16:55:21.949180 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Tenant-Id: 831cdea88c914362aff075e5d457eeb4 Sep 05 16:55:21.949180 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Tenant-Name: admin Sep 05 16:55:21.949180 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-User: admin Sep 05 16:55:21.949180 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-User-Domain-Id: default Sep 05 16:55:21.949180 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-User-Domain-Name: Default Sep 05 16:55:21.949180 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-User-Id: fce1040c54ac43928ab07aa4e6b6d613 Sep 05 16:55:21.949180 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-User-Name: admin Sep 05 16:55:21.949180 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: method: > Sep 05 16:55:21.949180 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: exception: Flavor 42 could not be found. Sep 05 16:55:21.949180 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: action_args: {'id': '42'} Sep 05 16:55:21.949180 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 16:55:21.949180 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 16:55:21.950064 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Sep 05 16:55:21.951271 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-0cdc0051-d9e4-4210-9abf-e62cdfbd9044 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 16:55:21.952459 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-0cdc0051-d9e4-4210-9abf-e62cdfbd9044 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.022434 Sep 05 16:55:21.952459 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Sep 5 16:55:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 16:55:22.923045 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-ce23b972-1a7c-4afb-a8a8-eee0e9452763 admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:22.924083 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-ce23b972-1a7c-4afb-a8a8-eee0e9452763 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 05 16:55:22.924509 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Sep 5 16:55:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:55:23.505559 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-0198cd96-7565-4205-9af2-c80cea970310 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:23.511996 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.wsgi [None req-0198cd96-7565-4205-9af2-c80cea970310 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-0198cd96-7565-4205-9af2-c80cea970310 admin admin] Request method failure captured: Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Accept: application/json Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Accept-Encoding: gzip, deflate Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Connection: keep-alive Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Content-Length: 0 Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Host: 10.222.0.23 Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Openstack-Api-Version: compute 2.92 Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Openstack-System-Scope: None Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: User-Agent: python-novaclient Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Auth-Token: gAAAAABjFin6zbhMhiedsxxjEAO9qKt7Wes0NHjspjKr0F4383j2ZvawHyoQhvLnoLV-90JNZlgG68Iqt9M7pV2FKMmuWZBLmcvGdwfwHlFgg7K_h382OcTA80uKGQ1Ac_tkNr3ftvjZd7AE7SQupzNqJRxmkBu7C3DvZ_SN2BWtEBHCGYTc7js Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Domain-Id: None Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Domain-Name: None Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Identity-Status: Confirmed Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Is-Admin-Project: True Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Project-Domain-Id: default Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Project-Domain-Name: Default Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Project-Id: 831cdea88c914362aff075e5d457eeb4 Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Project-Name: admin Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Role: member,reader,admin Sep 05 16:55:23.514003 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Roles: member,reader,admin Sep 05 16:55:23.515504 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_831cdea88c914362aff075e5d457eeb4"}]}] Sep 05 16:55:23.515504 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Tenant: admin Sep 05 16:55:23.515504 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Tenant-Id: 831cdea88c914362aff075e5d457eeb4 Sep 05 16:55:23.515504 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Tenant-Name: admin Sep 05 16:55:23.515504 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-User: admin Sep 05 16:55:23.515504 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-User-Domain-Id: default Sep 05 16:55:23.515504 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-User-Domain-Name: Default Sep 05 16:55:23.515504 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-User-Id: fce1040c54ac43928ab07aa4e6b6d613 Sep 05 16:55:23.515504 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-User-Name: admin Sep 05 16:55:23.515504 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: method: > Sep 05 16:55:23.515504 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: exception: Flavor 84 could not be found. Sep 05 16:55:23.515504 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: action_args: {'id': '84'} Sep 05 16:55:23.515504 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 16:55:23.515504 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 16:55:23.516431 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Sep 05 16:55:23.517544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-0198cd96-7565-4205-9af2-c80cea970310 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 16:55:23.518954 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-0198cd96-7565-4205-9af2-c80cea970310 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.454315 Sep 05 16:55:23.518954 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Sep 5 16:55:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 455 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 16:55:23.525518 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-14fd7043-2ba0-4d9f-b10d-976bdd9766a0 admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:23.541288 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-14fd7043-2ba0-4d9f-b10d-976bdd9766a0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019373 Sep 05 16:55:23.541847 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Sep 5 16:55:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 16:55:23.553915 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-231aaef3-a0e9-4c52-b044-10c5ffab5683 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:23.570075 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-231aaef3-a0e9-4c52-b044-10c5ffab5683 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021787 Sep 05 16:55:23.570591 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Sep 5 16:55:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 16:55:23.580119 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-09ed60e7-a067-4529-888a-596cc876a64a admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:23.585582 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.wsgi [None req-09ed60e7-a067-4529-888a-596cc876a64a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-09ed60e7-a067-4529-888a-596cc876a64a admin admin] Request method failure captured: Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Accept: application/json Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Accept-Encoding: gzip, deflate Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Connection: keep-alive Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Content-Length: 0 Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Host: 10.222.0.23 Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Openstack-Api-Version: compute 2.92 Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Openstack-System-Scope: None Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: User-Agent: python-novaclient Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Auth-Token: gAAAAABjFin6zbhMhiedsxxjEAO9qKt7Wes0NHjspjKr0F4383j2ZvawHyoQhvLnoLV-90JNZlgG68Iqt9M7pV2FKMmuWZBLmcvGdwfwHlFgg7K_h382OcTA80uKGQ1Ac_tkNr3ftvjZd7AE7SQupzNqJRxmkBu7C3DvZ_SN2BWtEBHCGYTc7js Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Domain-Id: None Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Domain-Name: None Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Identity-Status: Confirmed Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Is-Admin-Project: True Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Project-Domain-Id: default Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Project-Domain-Name: Default Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Project-Id: 831cdea88c914362aff075e5d457eeb4 Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Project-Name: admin Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Role: member,reader,admin Sep 05 16:55:23.587078 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Roles: member,reader,admin Sep 05 16:55:23.588657 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_831cdea88c914362aff075e5d457eeb4"}]}] Sep 05 16:55:23.588657 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Tenant: admin Sep 05 16:55:23.588657 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Tenant-Id: 831cdea88c914362aff075e5d457eeb4 Sep 05 16:55:23.588657 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Tenant-Name: admin Sep 05 16:55:23.588657 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-User: admin Sep 05 16:55:23.588657 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-User-Domain-Id: default Sep 05 16:55:23.588657 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-User-Domain-Name: Default Sep 05 16:55:23.588657 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-User-Id: fce1040c54ac43928ab07aa4e6b6d613 Sep 05 16:55:23.588657 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-User-Name: admin Sep 05 16:55:23.588657 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: method: > Sep 05 16:55:23.588657 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: exception: Flavor 84 could not be found. Sep 05 16:55:23.588657 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: action_args: {'id': '84'} Sep 05 16:55:23.588657 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 16:55:23.588657 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 16:55:23.589622 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Sep 05 16:55:23.590972 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-09ed60e7-a067-4529-888a-596cc876a64a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105529) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 16:55:23.592263 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-09ed60e7-a067-4529-888a-596cc876a64a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012023 Sep 05 16:55:23.592263 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Sep 5 16:55:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 16:55:24.566969 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-231aaef3-a0e9-4c52-b044-10c5ffab5683 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:24.568230 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-231aaef3-a0e9-4c52-b044-10c5ffab5683 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001880 Sep 05 16:55:24.568743 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Sep 5 16:55:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:55:25.147762 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-dbb47900-933e-4e43-bc3e-f04eb0b18e77 admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:25.153880 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.wsgi [None req-dbb47900-933e-4e43-bc3e-f04eb0b18e77 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-dbb47900-933e-4e43-bc3e-f04eb0b18e77 admin admin] Request method failure captured: Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Accept: application/json Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Accept-Encoding: gzip, deflate Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Connection: keep-alive Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Content-Length: 0 Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Host: 10.222.0.23 Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Openstack-Api-Version: compute 2.92 Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Openstack-System-Scope: None Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: User-Agent: python-novaclient Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Auth-Token: gAAAAABjFin8QiF_4UsUthpt1b22fPGmiv1M93F2XeixQZz_VpH8bJtBECjVnb-ZE6hfN1qX5pxweOF7wctrE2SbY5BLQyOv-CyQlw2j2tC2svogex5jLe6oujXX5S8QqOfr-aHsUfwLriK7v5WRzPP6xZBlvvnJDT9mieXld-ePUGmCMlROAQw Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Domain-Id: None Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Domain-Name: None Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Identity-Status: Confirmed Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Is-Admin-Project: True Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Project-Domain-Id: default Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Project-Domain-Name: Default Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Project-Id: 831cdea88c914362aff075e5d457eeb4 Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Project-Name: admin Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Role: member,reader,admin Sep 05 16:55:25.155409 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Roles: member,reader,admin Sep 05 16:55:25.156752 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_831cdea88c914362aff075e5d457eeb4"}]}] Sep 05 16:55:25.156752 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Tenant: admin Sep 05 16:55:25.156752 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Tenant-Id: 831cdea88c914362aff075e5d457eeb4 Sep 05 16:55:25.156752 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-Tenant-Name: admin Sep 05 16:55:25.156752 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-User: admin Sep 05 16:55:25.156752 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-User-Domain-Id: default Sep 05 16:55:25.156752 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-User-Domain-Name: Default Sep 05 16:55:25.156752 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-User-Id: fce1040c54ac43928ab07aa4e6b6d613 Sep 05 16:55:25.156752 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: X-User-Name: admin Sep 05 16:55:25.156752 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: method: > Sep 05 16:55:25.156752 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: exception: Flavor 451 could not be found. Sep 05 16:55:25.156752 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: action_args: {'id': '451'} Sep 05 16:55:25.156752 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 16:55:25.156752 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 16:55:25.157585 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: ERROR nova.api.openstack.wsgi Sep 05 16:55:25.158619 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-dbb47900-933e-4e43-bc3e-f04eb0b18e77 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105529) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 16:55:25.159889 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-dbb47900-933e-4e43-bc3e-f04eb0b18e77 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.451833 Sep 05 16:55:25.159889 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Sep 5 16:55:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 453 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 16:55:25.167363 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-ed9cd593-7a88-489c-bf87-91a19adc1be2 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:25.183724 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-ed9cd593-7a88-489c-bf87-91a19adc1be2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020326 Sep 05 16:55:25.184306 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Sep 5 16:55:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 16:55:25.194163 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-e4018802-383b-4405-96b5-1f527641df4d admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:25.209425 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-e4018802-383b-4405-96b5-1f527641df4d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018817 Sep 05 16:55:25.209959 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Sep 5 16:55:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 16:55:25.220101 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-9e8d93ed-09c7-4f5c-b9c8-bf00ae302ef4 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:25.225855 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.wsgi [None req-9e8d93ed-09c7-4f5c-b9c8-bf00ae302ef4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-9e8d93ed-09c7-4f5c-b9c8-bf00ae302ef4 admin admin] Request method failure captured: Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Accept: application/json Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Accept-Encoding: gzip, deflate Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Connection: keep-alive Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Content-Length: 0 Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Host: 10.222.0.23 Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Openstack-Api-Version: compute 2.92 Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Openstack-System-Scope: None Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: User-Agent: python-novaclient Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Auth-Token: gAAAAABjFin8QiF_4UsUthpt1b22fPGmiv1M93F2XeixQZz_VpH8bJtBECjVnb-ZE6hfN1qX5pxweOF7wctrE2SbY5BLQyOv-CyQlw2j2tC2svogex5jLe6oujXX5S8QqOfr-aHsUfwLriK7v5WRzPP6xZBlvvnJDT9mieXld-ePUGmCMlROAQw Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Domain-Id: None Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Domain-Name: None Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Identity-Status: Confirmed Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Is-Admin-Project: True Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Project-Domain-Id: default Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Project-Domain-Name: Default Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Project-Id: 831cdea88c914362aff075e5d457eeb4 Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Project-Name: admin Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Role: member,reader,admin Sep 05 16:55:25.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Roles: member,reader,admin Sep 05 16:55:25.229255 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/831cdea88c914362aff075e5d457eeb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_831cdea88c914362aff075e5d457eeb4"}]}] Sep 05 16:55:25.229255 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Tenant: admin Sep 05 16:55:25.229255 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Tenant-Id: 831cdea88c914362aff075e5d457eeb4 Sep 05 16:55:25.229255 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-Tenant-Name: admin Sep 05 16:55:25.229255 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-User: admin Sep 05 16:55:25.229255 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-User-Domain-Id: default Sep 05 16:55:25.229255 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-User-Domain-Name: Default Sep 05 16:55:25.229255 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-User-Id: fce1040c54ac43928ab07aa4e6b6d613 Sep 05 16:55:25.229255 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: X-User-Name: admin Sep 05 16:55:25.229255 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: method: > Sep 05 16:55:25.229255 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: exception: Flavor 451 could not be found. Sep 05 16:55:25.229255 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: action_args: {'id': '451'} Sep 05 16:55:25.229255 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 16:55:25.229255 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 16:55:25.230196 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Sep 05 16:55:25.231246 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-9e8d93ed-09c7-4f5c-b9c8-bf00ae302ef4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 16:55:25.232309 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-9e8d93ed-09c7-4f5c-b9c8-bf00ae302ef4 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012848 Sep 05 16:55:25.232309 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Sep 5 16:55:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 16:55:26.232699 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-e4018802-383b-4405-96b5-1f527641df4d admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:26.233709 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-e4018802-383b-4405-96b5-1f527641df4d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 05 16:55:26.234115 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Sep 5 16:55:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:55:26.804761 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-61271e74-6655-4184-a3ed-3ab5e3a1ad04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:55:26.827983 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-61271e74-6655-4184-a3ed-3ab5e3a1ad04 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.459083 Sep 05 16:55:26.828679 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Mon Sep 5 16:55:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 16:55:27.814082 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-e4018802-383b-4405-96b5-1f527641df4d admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:27.815082 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-e4018802-383b-4405-96b5-1f527641df4d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 05 16:55:27.815468 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Sep 5 16:55:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:55:28.393801 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-42fafb4d-ac14-4158-b5a9-d7a43f93b4fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:55:28.414492 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-42fafb4d-ac14-4158-b5a9-d7a43f93b4fc admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.462355 Sep 05 16:55:28.415006 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Mon Sep 5 16:55:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 16:55:29.382079 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-e4018802-383b-4405-96b5-1f527641df4d admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:29.383215 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-e4018802-383b-4405-96b5-1f527641df4d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Sep 05 16:55:29.383575 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Sep 5 16:55:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:55:29.955143 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-b1c153ba-2079-4916-9df6-55558dcd3157 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:55:29.977391 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-b1c153ba-2079-4916-9df6-55558dcd3157 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.457076 Sep 05 16:55:29.977979 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Mon Sep 5 16:55:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 16:55:30.968928 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-e4018802-383b-4405-96b5-1f527641df4d admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:30.969933 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-e4018802-383b-4405-96b5-1f527641df4d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 05 16:55:30.970348 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Sep 5 16:55:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:55:31.523106 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-59e2439c-5afe-4d5b-b50f-1e24a0065fda admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 16:55:31.547811 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-59e2439c-5afe-4d5b-b50f-1e24a0065fda admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.436548 Sep 05 16:55:31.548386 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Mon Sep 5 16:55:31 2022] POST /compute/v2.1/flavors => generated 409 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 16:55:32.524618 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-e4018802-383b-4405-96b5-1f527641df4d admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:32.525685 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-e4018802-383b-4405-96b5-1f527641df4d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Sep 05 16:55:32.528818 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Sep 5 16:55:32 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:55:33.112950 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-9a5a3a2b-d76b-4a23-9387-6d94af4679b1 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:55:33.134122 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-9a5a3a2b-d76b-4a23-9387-6d94af4679b1 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.459061 Sep 05 16:55:33.134871 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Mon Sep 5 16:55:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 16:56:26.969863 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-e4018802-383b-4405-96b5-1f527641df4d admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:56:26.971491 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-e4018802-383b-4405-96b5-1f527641df4d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002230 Sep 05 16:56:26.972188 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 931 bytes} [Mon Sep 5 16:56:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:56:26.986386 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:56:27.440301 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-4c08f65a-bb5f-451f-8eed-39a5e65881fa admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:56:27.460477 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-4c08f65a-bb5f-451f-8eed-39a5e65881fa admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.481900 Sep 05 16:56:27.461056 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1292 bytes} [Mon Sep 5 16:56:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 16:56:27.482607 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG dbcounter [-] [105529] Writing DB stats nova_api:SELECT=14 {{(pid=105529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:56:27.486623 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-4a6c9b25-18fc-4207-ab05-38c9741690fa admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:56:27.496127 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-4a6c9b25-18fc-4207-ab05-38c9741690fa admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015046 Sep 05 16:56:27.496735 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1283 bytes} [Mon Sep 5 16:56:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 16:56:27.511258 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-6a4cf3ff-42c8-4e70-9e9f-de6e6e662ddc admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:56:27.519483 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-6a4cf3ff-42c8-4e70-9e9f-de6e6e662ddc admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014315 Sep 05 16:56:27.519996 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1286 bytes} [Mon Sep 5 16:56:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 16:56:27.534281 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-9252d208-46ea-4ace-a45f-aa6d060a9582 admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:56:27.545694 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-9252d208-46ea-4ace-a45f-aa6d060a9582 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017059 Sep 05 16:56:27.546353 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1286 bytes} [Mon Sep 5 16:56:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 16:56:27.563874 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-297d5766-70fa-4fba-a837-6b5ded846bf7 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:56:27.576311 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-297d5766-70fa-4fba-a837-6b5ded846bf7 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018181 Sep 05 16:56:27.577031 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1283 bytes} [Mon Sep 5 16:56:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 16:59:28.814726 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-9252d208-46ea-4ace-a45f-aa6d060a9582 admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:59:28.815741 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-9252d208-46ea-4ace-a45f-aa6d060a9582 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 05 16:59:28.816140 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Sep 5 16:59:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:59:28.968950 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_api:SELECT=6 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:59:29.146049 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-563027e7-0635-4809-9102-08e7705b64e3 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:59:29.149506 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-563027e7-0635-4809-9102-08e7705b64e3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 16:59:29.149977 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-563027e7-0635-4809-9102-08e7705b64e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 16:59:29.150400 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-563027e7-0635-4809-9102-08e7705b64e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 16:59:29.151113 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-563027e7-0635-4809-9102-08e7705b64e3 admin admin] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 16:59:29.151555 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-563027e7-0635-4809-9102-08e7705b64e3 admin admin] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 16:59:29.151968 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-563027e7-0635-4809-9102-08e7705b64e3 admin admin] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 16:59:29.185886 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-563027e7-0635-4809-9102-08e7705b64e3 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.218543 Sep 05 16:59:29.186474 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Sep 5 16:59:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 16:59:30.006684 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-9252d208-46ea-4ace-a45f-aa6d060a9582 admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:59:30.008390 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-9252d208-46ea-4ace-a45f-aa6d060a9582 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Sep 05 16:59:30.008791 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Sep 5 16:59:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:59:30.216974 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-33e9ab50-bc5a-480a-bfd9-f233e311f39a admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:59:30.220414 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-33e9ab50-bc5a-480a-bfd9-f233e311f39a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 16:59:30.220885 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-33e9ab50-bc5a-480a-bfd9-f233e311f39a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 16:59:30.221310 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-33e9ab50-bc5a-480a-bfd9-f233e311f39a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 16:59:30.222017 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-33e9ab50-bc5a-480a-bfd9-f233e311f39a admin admin] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 16:59:30.222472 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-33e9ab50-bc5a-480a-bfd9-f233e311f39a admin admin] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 16:59:30.222880 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-33e9ab50-bc5a-480a-bfd9-f233e311f39a admin admin] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 16:59:30.242637 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-33e9ab50-bc5a-480a-bfd9-f233e311f39a admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.090787 Sep 05 16:59:30.243188 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Sep 5 16:59:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 16:59:41.480064 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-9252d208-46ea-4ace-a45f-aa6d060a9582 admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:59:41.481122 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-9252d208-46ea-4ace-a45f-aa6d060a9582 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 05 16:59:41.481540 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Sep 5 16:59:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:59:41.623886 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_cell0:SELECT=4 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:59:41.624677 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_cell1:SELECT=4 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:59:41.625449 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_api:SELECT=8 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 16:59:41.687483 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-a417a774-42f0-4936-b58e-5708be944aa5 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:59:41.692975 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-a417a774-42f0-4936-b58e-5708be944aa5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 16:59:41.693620 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-a417a774-42f0-4936-b58e-5708be944aa5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 16:59:41.694235 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-a417a774-42f0-4936-b58e-5708be944aa5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 16:59:41.695291 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-a417a774-42f0-4936-b58e-5708be944aa5 admin admin] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 16:59:41.695907 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-a417a774-42f0-4936-b58e-5708be944aa5 admin admin] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 16:59:41.696544 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-a417a774-42f0-4936-b58e-5708be944aa5 admin admin] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 16:59:41.724827 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-a417a774-42f0-4936-b58e-5708be944aa5 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.105317 Sep 05 16:59:41.725374 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 38/74] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Sep 5 16:59:41 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 16:59:42.561487 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: DEBUG nova.api.openstack.wsgi [None req-9252d208-46ea-4ace-a45f-aa6d060a9582 admin admin] Calling method '>' {{(pid=105529) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:59:42.562499 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: INFO nova.api.openstack.requestlog [None req-9252d208-46ea-4ace-a45f-aa6d060a9582 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 05 16:59:42.562906 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: [pid: 105529|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Sep 5 16:59:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 16:59:42.782949 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-82858d9f-6a06-4b51-9dc5-2be8b6310047 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 16:59:42.787022 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-82858d9f-6a06-4b51-9dc5-2be8b6310047 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 16:59:42.787605 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-82858d9f-6a06-4b51-9dc5-2be8b6310047 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 16:59:42.788035 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-82858d9f-6a06-4b51-9dc5-2be8b6310047 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 16:59:42.788782 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-82858d9f-6a06-4b51-9dc5-2be8b6310047 admin admin] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 16:59:42.789222 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-82858d9f-6a06-4b51-9dc5-2be8b6310047 admin admin] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 16:59:42.789628 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-82858d9f-6a06-4b51-9dc5-2be8b6310047 admin admin] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 16:59:42.814834 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-82858d9f-6a06-4b51-9dc5-2be8b6310047 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.103009 Sep 05 16:59:42.815634 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 39/76] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Sep 5 16:59:42 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:00:42.724974 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: Mon Sep 5 17:00:42 2022 - graceful shutdown triggered... Sep 05 17:00:42.725113 dv-cinder-855964-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 05 17:00:42.725915 dv-cinder-855964-1-iscsi devstack@n-api.service[105529]: Gracefully killing worker 1 (pid: 105529)... Sep 05 17:00:42.726291 dv-cinder-855964-1-iscsi devstack@n-api.service[105530]: Gracefully killing worker 2 (pid: 105530)... Sep 05 17:00:43.727094 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: worker 1 buried after 1 seconds Sep 05 17:00:43.727094 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: worker 2 buried after 1 seconds Sep 05 17:00:43.727094 dv-cinder-855964-1-iscsi devstack@n-api.service[105528]: goodbye to uWSGI. Sep 05 17:00:43.729095 dv-cinder-855964-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 05 17:00:43.730261 dv-cinder-855964-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 05 17:00:43.733819 dv-cinder-855964-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 05 17:00:43.744592 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 05 17:00:43.747393 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 5 17:00:43 2022] *** Sep 05 17:00:43.747571 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 05 17:00:43.747571 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 05 17:00:43.747571 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: nodename: dv-cinder-855964-1-iscsi Sep 05 17:00:43.747571 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: machine: x86_64 Sep 05 17:00:43.747571 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: clock source: unix Sep 05 17:00:43.747571 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: pcre jit disabled Sep 05 17:00:43.747571 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: detected number of CPU cores: 4 Sep 05 17:00:43.747571 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: current working directory: / Sep 05 17:00:43.747571 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: detected binary path: /usr/bin/uwsgi-core Sep 05 17:00:43.747571 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: your processes number limit is 47680 Sep 05 17:00:43.747571 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: your memory page size is 4096 bytes Sep 05 17:00:43.747571 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: detected max file descriptor number: 2048 Sep 05 17:00:43.747571 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: lock engine: pthread robust mutexes Sep 05 17:00:43.748477 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: thunder lock: enabled Sep 05 17:00:43.748477 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 05 17:00:43.748477 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 05 17:00:43.791794 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: Python main interpreter initialized at 0x5614d8fe69c0 Sep 05 17:00:43.791794 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: python threads support enabled Sep 05 17:00:43.791794 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: your server socket listen backlog is limited to 100 connections Sep 05 17:00:43.791794 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: your mercy for graceful operations on workers is 90 seconds Sep 05 17:00:43.792478 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: mapped 403077 bytes (393 KB) for 2 cores Sep 05 17:00:43.792478 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: *** Operational MODE: preforking *** Sep 05 17:00:43.792707 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: *** uWSGI is running in multiple interpreter mode *** Sep 05 17:00:43.792707 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: spawned uWSGI master process (pid: 120708) Sep 05 17:00:43.792943 dv-cinder-855964-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 05 17:00:43.794146 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: spawned uWSGI worker 1 (pid: 120731, cores: 1) Sep 05 17:00:43.795338 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: spawned uWSGI worker 2 (pid: 120733, cores: 1) Sep 05 17:00:43.795725 dv-cinder-855964-1-iscsi devstack@n-api.service[120708]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 05 17:00:44.474785 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 05 17:00:44.513887 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 05 17:00:45.646738 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 17:00:45.646738 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: from cryptography.utils import int_from_bytes Sep 05 17:00:45.647370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 17:00:45.647370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: from cryptography.utils import int_from_bytes Sep 05 17:00:45.661910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 17:00:45.661910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: from cryptography.utils import int_from_bytes Sep 05 17:00:45.662560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 17:00:45.662560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: from cryptography.utils import int_from_bytes Sep 05 17:00:48.070793 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 17:00:48.071485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 17:00:48.071607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 17:00:48.072092 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 17:00:48.072308 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 17:00:48.072545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.073081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.073738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.073738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.073909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.074173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.074492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.074808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.075142 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.075323 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 17:00:48.075699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.075786 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 17:00:48.075871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.076056 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 17:00:48.076187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855964-1-iscsi {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.076452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 17:00:48.076566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.076720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 17:00:48.076813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.077094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.077202 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.077443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.077575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.077745 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.077955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.078141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.078228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.078310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.078397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.078679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.078919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.079131 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.079589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.080026 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.080296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.080472 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.080663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.080944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.081123 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.081298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.081450 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.081608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.081858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.082022 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.082167 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.082478 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.082738 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855964-1-iscsi {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.082914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855964-1-iscsi {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.083189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.083357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.083508 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.083803 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.083975 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.084243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.084414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.084559 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.084852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.085015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.085226 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.085377 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.085528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.085686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.085836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.085995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.086157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.086884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.087073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.087265 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.087475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.087716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.087874 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.088018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.088187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.088405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.088810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.089382 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.089569 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.089732 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.089884 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.090034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.090190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.090339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.090488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.090638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.090789 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.090932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.091084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.091227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.091392 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855964-1-iscsi {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.091545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.091545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.091833 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.091983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.092136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.093506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.093671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.093873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.094035 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.094241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.094422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.094582 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.094735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.094894 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.095053 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.095204 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.095354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.095497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.095639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.095790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.095790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.096404 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.096561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.096712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.096865 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.097407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.097571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.097725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.097882 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.098034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.098187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.098338 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.098487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.098637 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.098779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.098947 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.098947 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.099237 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.099237 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.099519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.099519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.099805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.099958 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.100110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.100329 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.100475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.100625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.100777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.100941 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.101087 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.101238 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.101390 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.101541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.101698 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.101847 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.101997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.102147 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.102299 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.102454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.102961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.103746 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.103917 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.104069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.104814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.104978 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.105130 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.105285 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.105430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.105574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.105716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.105914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.106064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.106218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.106361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.106511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.106654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.106805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.106960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.107110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.107253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.107402 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.107557 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.107926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.108085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.108085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.108547 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.108692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.108852 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.109003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.109145 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.109293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.109436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.109581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.109757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.110046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.110202 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.110362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.110505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.110675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.110834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.110983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.111134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.111284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.111435 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.111585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.111741 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.111884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.112032 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.112235 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.112391 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.112555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.112705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.112847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.112995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.112995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.114067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.114241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.114385 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.114528 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.114679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.114883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.115033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.115033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.115675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.115675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.115967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.116111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.116303 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.116485 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.116630 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.116772 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.116924 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.117079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.117223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.117364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.117512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.117672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.117829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.117981 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.118135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.118277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.118425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.118583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.118726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.118869 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.119011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.119011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.119294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.119483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.119681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.119836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.120465 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.120752 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.121019 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.121263 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.121420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.121571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.121729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.121881 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.122029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.122182 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.122322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.122481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.122636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.122778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.122923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.123063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.123204 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.123344 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.124333 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.124499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.124650 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.124792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.124977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.125143 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.125295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.125295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.125581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.125730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.125870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.126025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.126173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.126315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.126461 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.126618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.126758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.126912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.127065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.127206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.127347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.127496 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.127645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.127784 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.127929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.128080 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.128258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.128408 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.128559 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.128707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.128846 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.129007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.129147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.129292 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.129446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.129596 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.129743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.129890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.130041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.130189 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.130337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.130495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.130646 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.130797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.130945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.131098 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 17:00:48.131246 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.131443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.131588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.131728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.131881 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.132035 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.132501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.132661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.132811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.132951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.133109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.133258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.133414 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.133555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.134216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.134532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.134691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.134842 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.135038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.135216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.135413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.135657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.135910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.136074 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.136251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.136395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.136535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.136674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.136815 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.136965 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.137111 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.137252 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.137401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.137547 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.137696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.137696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.137989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.138130 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.138277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.138277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.138551 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.138551 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.138834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.138982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.139134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.139281 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.139421 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.139574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.139727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.139875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.140023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.140181 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.140345 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.140503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.140644 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.140790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.140930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.141070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.141218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.141359 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.141507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.141665 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.141812 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.141960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.142110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.142250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.142390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.142528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.142668 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.142808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.142956 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.143107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.143254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.143395 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.143552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.143692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.144407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.144761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.144909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.145097 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.145246 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.145396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.145536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.145683 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.145830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.145980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.146138 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.146289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.146438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.146578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.146724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.146865 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.147012 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.147162 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.149753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.149932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.150100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.150307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.150471 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.150639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.150919 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.151077 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.151228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.151379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.151617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.151770 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.151920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.152068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.152230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.152394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.152547 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.152687 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.152839 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.152986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.153127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.153307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.153461 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.153604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.153743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.153890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.154560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.154912 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.155079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.155273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.155419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.155579 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.155729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.155889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.156029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.156186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.156333 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.156473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.156612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.156771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.156912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.157058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.157199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.157364 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.157512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.157669 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.157822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.157822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.158097 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.158245 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.158384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.158533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.158674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.158815 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.158962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.159110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.159275 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.159275 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.159550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.159699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.159846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.159988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.160136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.160335 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.160476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.160624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.160773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.160931 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.161621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.161786 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.161930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.162079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.162220 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.162360 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.162514 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.162656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.162806 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.162806 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.163082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.163233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.163373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.163373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.163658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.163807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.163955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.164128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.164742 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.164898 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.165136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.165136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.165476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.165643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.165873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.166018 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.166171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.166312 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.166488 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.166641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.166781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.166922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.167018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.167105 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.167178 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.167271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.167361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.167452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.167542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.167626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.167721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.167815 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.167908 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.167992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.167992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.168170 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.168283 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.168377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.168471 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.168563 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.168654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.168738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.168828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.168920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.168920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.169072 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.169154 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.169237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.169332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.169422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.169512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.169595 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.169677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.169772 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.169856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.169938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.170020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.170102 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.170194 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.170285 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.170369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.170459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.170543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.170625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.170716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.170808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.170898 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.170988 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.171071 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.171153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.171235 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.171330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.171421 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.171505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.171586 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.171721 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.171816 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.171908 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.171997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.172080 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.172239 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.172330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.172426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.172518 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.172609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.172693 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.172782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.172873 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.172970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.173061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.173144 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.173227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.173317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.173408 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.173500 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.173583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.173668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.173765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.173856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.173956 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.174040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.174124 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.174213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.174311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.174873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.174975 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.175060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.175164 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.175249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.175454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.175558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.175654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.175740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.175740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.175905 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.175905 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.175905 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.175905 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.175905 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.175905 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.176439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.176523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.176523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.176523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.176523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.176523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.176919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.177001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.177001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.177001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.177001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.177001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.177001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.177426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.177516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.177516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.177516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.177516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.177516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.177901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.177999 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.177999 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.177999 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.178231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.178320 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.178320 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.178491 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.178575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.178575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.178575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.178575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.178878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.178963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.178963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.178963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.178963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.178963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.178963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.179549 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.179646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.179646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.179646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.179646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.179646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.180053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.180229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.180229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.180375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.180641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.180797 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.180939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.181275 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.181413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.181590 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.181904 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.182144 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.182256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.182598 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.182828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.182980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.183211 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.183435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.183574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.183841 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.184024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.184202 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.184912 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.185052 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.185158 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.185255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.185341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.185582 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.185697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.186016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.186166 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.186314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.186666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.186805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.186994 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.187228 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.187340 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.187583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.187808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.187911 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.188228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.188425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.188539 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.188822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.189014 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.189109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.189424 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.189641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.189757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.190026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.190119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.190331 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.190635 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.190736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.190946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.191216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.191312 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.191552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.191804 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.191910 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.192165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.192402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.192497 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.192804 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.193018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.193139 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.193407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.193634 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.193729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.193989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.194331 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.194561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.195067 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.195067 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.195257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.195350 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.195610 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.195729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.195920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.196248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.196416 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.196577 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.196886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.197041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.197194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.197501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.197721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.197938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.198255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.198554 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.198654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.198912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.199192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.199293 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.199604 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.199803 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.199915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.200238 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.200367 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.200552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.200863 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.200962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.201186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.201436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.201528 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.201791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.202002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.202101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.202396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.202588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.202706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.203010 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.203157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.203322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.203626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.203730 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.203944 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.204234 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.204340 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.204567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.204853 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.205291 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.205291 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.205471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.205605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.205753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.206032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.206139 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.206374 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.206474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.206679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.206957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.207057 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.207276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.207549 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.207646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.207870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.208115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.208368 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.208512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.208720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.208819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.209121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.209285 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.209432 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.209736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.209934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.210037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.210334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.210435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.210642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.210930 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.211030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.211239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.211498 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.211598 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.211833 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.212064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.212188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.212470 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.212705 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.212811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.213076 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.213543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.213710 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.213710 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.214026 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.214141 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.214409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.214499 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.214710 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.214999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.215455 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.215455 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.215628 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.215766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.215924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.216222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.216341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.216563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.216739 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.216872 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.217190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.217279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.217980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.218081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.218180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.218180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.218362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.218462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.218694 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.218936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.219041 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.219445 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.219587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.219673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.219943 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.220189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.220299 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.220584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.220775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.220901 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.221214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.221348 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.221525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.221841 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.221938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.222154 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.222422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.222521 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.222770 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.222984 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.223074 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.223385 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.223545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.223700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.224011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.224109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.224349 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.224617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.224709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.224946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.225549 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.225657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.225789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.225891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.225891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.226159 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.226249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.226467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.226757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.226857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.227066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.227331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.227512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.228205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.228300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.228510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.228762 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.228887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.229200 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.229406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.229539 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.229825 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.230055 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.230159 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.230427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.230640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.230863 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.231132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.231308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.231622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.231728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.231933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.232589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.232699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.232800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.232887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.232887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.233189 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.233391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.233518 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.233788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.233902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.234095 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.234354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.234458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.234720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.234813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.235044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.235246 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.235469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.235674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.235780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.236077 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.236203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.236527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.236635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.236845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.237034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.237162 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.237481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.237583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.237804 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.237982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.238134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.238411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.238512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.238749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.238899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.239062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.239330 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.239423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.239703 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.239793 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.240020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.240243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.240365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.240675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.240776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.241009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.241152 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.241338 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.241581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.241682 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.241968 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.242059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.242386 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.242486 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.242712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.242889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.243025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.243332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.243436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.243670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.243813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.243977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.244270 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.244379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.244651 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.244853 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.244946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.245256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.245357 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.245584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.245792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.245893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.246190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.246281 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.246503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.246742 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.246838 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.247105 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.247222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.247412 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.247663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.247764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.248033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.248177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.248383 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.248592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.248684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.249000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.249101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.249318 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.249498 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.249626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.249926 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.250033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.250246 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.250414 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.250554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.250850 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.250957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.251157 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.251342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.251502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.251772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.251864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.252118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.252266 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.252475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.252702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.252799 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.253106 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.253267 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.253441 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.253609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.253772 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.254052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.254157 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.254395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.254547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.254715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.254994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.255097 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.255334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.255467 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.255643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.255898 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.255991 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.256277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.256405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.256588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.256903 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.257046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.257216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.257522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.257622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.257826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.258011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.258142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.258442 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.258536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.258758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.258898 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.259083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.259313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.259418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.259687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.259786 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.259994 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.260233 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.260415 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.260648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.260766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.261076 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.261167 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.262557 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.262686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.262779 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.262881 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.262979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.263066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.263160 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.263260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.263348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.263433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.263525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.263525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.263688 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.263785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.263879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.264137 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.265087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.265210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.265298 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.265400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.265488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.265488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.265644 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.265739 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.266110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.266214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.266406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.266591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.266724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.267020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.267127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.267338 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.267504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.267655 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.267944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.268037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.268292 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.268458 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.268608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.268896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.268989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.269219 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.269380 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.269551 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.269877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.269968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.270205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.270399 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.270546 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.270833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.270925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.271185 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.271322 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.271505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.271750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.271843 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.272193 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.272324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.272513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.272691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.272823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.273133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.273227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.273449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.273615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.273765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.274040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.274140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.274381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.274516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.274699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.274964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.275056 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.275312 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.275435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.275627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.275917 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.276038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.276357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.276538 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.276734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.276977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.277072 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.277387 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.277480 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.277704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.277988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.278090 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.278329 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.278476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.278852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.278943 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.279171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.279358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.279510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.279805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.279906 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.280172 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.280325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.280499 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.280759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.280852 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.281148 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.281247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.281461 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.281656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.281771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.282085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.282184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.282401 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.282558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.282710 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.282993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.283091 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.283335 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.283483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.283643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.283913 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.284006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.284294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.284429 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.284819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.284913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.285172 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.285302 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.285490 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.285751 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.285857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.286131 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.286337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.286451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.286761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.286853 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.287087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.287255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.287399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.287699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.287802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.288013 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.288223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.288355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.288650 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.288750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.288957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.289135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.289271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.289582 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.289688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.289887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.290060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.290200 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.290486 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.290587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.290825 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.290964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.291134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.291463 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.291559 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.291899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.292030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.292265 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.292401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.292580 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.292831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.292928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.293184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.293285 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.293493 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.293718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.293809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.294100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.294198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.294511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.294614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.294821 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.295053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.295154 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.295483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.295583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.295793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.295978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.296103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.296458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.296563 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.296771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.296932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.297082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.297376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.297469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.297706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.297860 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.298031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.298289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.298385 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.298648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.298765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.298998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.299194 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.299319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.299659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.299854 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.300090 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.300213 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.300524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.300616 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.300866 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.301041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.301201 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.301494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.301589 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.301807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.301982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.302113 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.302435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.302529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.302744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.302941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.303059 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.303373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.303473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.303687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.303861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.303998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.304326 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.304434 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.304639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.304827 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.304952 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.305251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.305343 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.305567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.305727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.305878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.306157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.306258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.306489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.306623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.306800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.307091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.307222 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.307473 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.307575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.307794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.307989 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.308112 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.308468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.308561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.308791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.308996 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.309098 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.309405 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.309499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.309719 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.309904 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.310032 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.310331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.310431 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.310675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.310832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.310990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.311265 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.311358 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.311690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.311791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.312005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.312709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.312803 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.312890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.312976 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.313070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.313165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.313259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.313486 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.313588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.313876 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.314045 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.314200 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.314419 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.314511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.314831 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.314931 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.315175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.315347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.315504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.315833 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.315939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.316141 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.316349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.316472 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.316774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.316979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.317069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.317323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.317428 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.317708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.317869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.317969 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.318270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.318362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.318584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.318780 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.318885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.319186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.319277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.319495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.319692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.319797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.320098 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.320214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.320430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.320743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.320949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.321051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.321342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.321475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.321650 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.321922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.322015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.322251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.322411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.322556 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.322916 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.323012 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.323352 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.323454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.323664 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.323844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.323972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.324302 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.324419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.324655 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.324791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.324974 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.325226 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.325326 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.325603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.325702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.325928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.326148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.326241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.326551 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.326651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.326875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.327081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.327194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.327507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.327613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.327842 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.328031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.328167 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.328491 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.328583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.328805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.328991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.329119 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.329425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.329527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.329737 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.329958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.330053 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.330382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.330481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.330699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.330872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.331027 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.331312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.331415 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.331658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.331801 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.331975 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.332261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.332356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.332641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.332742 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.332954 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.333177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.333277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.333564 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.333655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.333878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.334086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.334179 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.334497 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.334589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.334810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.334992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.335123 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.335429 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.335522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.335743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.335925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.336071 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.336390 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.336486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.336797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.336888 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.337128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.337330 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.337458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.337763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.337856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.338107 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.338290 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.338632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.338727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.338973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.339295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.339410 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.339614 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.339848 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.339957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.340169 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 17:00:48.340376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.340768 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.341157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.341541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.341922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.342313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.342687 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.343056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.343430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.343805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.344247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.344581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.345121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.345316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.345700 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.346075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.346671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.347084 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.347464 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.347852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.348264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.348649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.349020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.349409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.349782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.350152 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.350531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.350911 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.351282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.351651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.352025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.352421 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.353134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.353443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.353747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.354153 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.354569 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.354884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.355191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.355501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.355805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.356108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.356436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.356740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.357051 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.357353 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.357754 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.358059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.358372 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.358720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.359031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.359335 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.359657 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.359964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.360297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.360617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.360936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.361258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.361569 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.361880 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.362222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.362539 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.363069 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.363400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.363718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.364047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.364399 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.364706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.365009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.365310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.365632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.365939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.366248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.366557 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.366864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.367170 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.367479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.367787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.368557 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.368557 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.368761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.369068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.369376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.369866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.370183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.370498 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.370844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.371160 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.371475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.371790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.372105 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.372441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.372750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.373057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.373363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.373893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.374223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.374536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.374843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.375268 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.377585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.377585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.377585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.377585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.377585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.377585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.377585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.378749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.378749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.378749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.378749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.379082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.379281 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.379584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.379887 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.380212 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.380522 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.380846 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.381156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.381460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.381763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.382071 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.382376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.382679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.382980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.383281 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.383585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.383883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.384201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.384502 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.384800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.385143 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.385441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.385746 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.386140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.386446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.386747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.387046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.387345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.387671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.388000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.388335 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.388654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.388962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.389280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.389586 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.389903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.390219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.390534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.390844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.391172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.391479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.391786 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.392097 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.392427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.392732 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.393052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.393362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.393684 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.393989 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.394311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.394624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.394942 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.395253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.395559 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.395883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.396237 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.396546 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.396851 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.397158 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.397464 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.397774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.398079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.398384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.398693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.399002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.399323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.399642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.399948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.400294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.400621 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.401004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.401318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.401648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.401970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.402162 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO dbcounter [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] Registered counter for database nova_api Sep 05 17:00:48.402281 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.402589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.402890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 17:00:48.403130 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 17:00:48.422817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_db.sqlalchemy.engines [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120733) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 17:00:48.429384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writer thread running {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 17:00:48.464757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO dbcounter [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] Registered counter for database nova_api Sep 05 17:00:48.485589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_db.sqlalchemy.engines [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 17:00:48.486230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.context [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),58a28fd3-8685-4f6c-b4e5-aee03c36263b(cell1) {{(pid=120733) load_cells /opt/stack/nova/nova/context.py:464}} Sep 05 17:00:48.490321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:00:48.490808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:00:48.492391 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:00:48.492842 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writer thread running {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 17:00:48.493125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:00:48.493573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:00:48.495634 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:00:48.497697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO dbcounter [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] Registered counter for database nova_cell0 Sep 05 17:00:48.501825 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO dbcounter [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] Registered counter for database nova_cell1 Sep 05 17:00:48.509071 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_db.sqlalchemy.engines [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120733) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 17:00:48.511754 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_db.sqlalchemy.engines [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120733) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 17:00:48.518915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writer thread running {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 17:00:48.521238 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writer thread running {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 17:00:48.550355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.context [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),58a28fd3-8685-4f6c-b4e5-aee03c36263b(cell1) {{(pid=120731) load_cells /opt/stack/nova/nova/context.py:464}} Sep 05 17:00:48.554418 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:00:48.554893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:00:48.556452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:00:48.557207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:00:48.557677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:00:48.559672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:00:48.561695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO dbcounter [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] Registered counter for database nova_cell0 Sep 05 17:00:48.565663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO dbcounter [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] Registered counter for database nova_cell1 Sep 05 17:00:48.572969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_db.sqlalchemy.engines [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 17:00:48.575323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_db.sqlalchemy.engines [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 17:00:48.579835 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writer thread running {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 17:00:48.667664 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO dbcounter [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] Registered counter for database nova_cell0 Sep 05 17:00:48.674844 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_db.sqlalchemy.engines [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120733) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 17:00:48.679585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writer thread running {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 17:00:48.722081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writer thread running {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 17:00:48.732978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO dbcounter [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] Registered counter for database nova_cell0 Sep 05 17:00:48.740195 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_db.sqlalchemy.engines [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 17:00:48.746609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writer thread running {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 17:00:48.997820 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: WARNING keystonemiddleware.auth_token [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 17:00:49.005381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: WARNING keystonemiddleware.auth_token [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 17:00:49.061214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: WARNING keystonemiddleware.auth_token [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 17:00:49.068515 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: WARNING keystonemiddleware.auth_token [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 17:00:49.352983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: WARNING keystonemiddleware.auth_token [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 17:00:49.359101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: WARNING keystonemiddleware.auth_token [None req-cecdb599-381e-4818-9a50-a6a13af25471 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 17:00:49.364563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5614d8fe69c0 pid: 120733 (default app) Sep 05 17:00:49.414706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: WARNING keystonemiddleware.auth_token [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 17:00:49.420858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: WARNING keystonemiddleware.auth_token [None req-330bf5fe-6b15-4d82-b899-f52d0f6dbe59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 17:00:49.426176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5614d8fe69c0 pid: 120731 (default app) Sep 05 17:01:25.361403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=3 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:01:25.363017 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=3 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:01:25.363748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=3 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:01:25.364904 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=3 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:01:26.806762 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-87a02262-e8bd-4b48-b7c2-596456b385e1 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Action: 'create', calling method: .version_select at 0x7f1d3baed280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2041597689"}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:01:28.415079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-87a02262-e8bd-4b48-b7c2-596456b385e1 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.070789 Sep 05 17:01:28.415736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1155 bytes} [Mon Sep 5 17:01:25 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3074 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 05 17:01:28.435163 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-38002e48-7d25-4025-92b3-9389ff010859 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b9ce160>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:28.602747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-38002e48-7d25-4025-92b3-9389ff010859 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af" status: 200 len: 345 microversion: 2.1 time: 0.172555 Sep 05 17:01:28.609652 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 2/2] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Sep 5 17:01:28 2022] GET /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af => generated 345 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:01:28.683783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-26686989-42c6-4992-ac9d-d465ef7119b2 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] Calling method '.version_select at 0x7f1d3bb973a0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:28.715437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:01:28.716734 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:01:28.717980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:01:28.718954 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:01:29.331693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-26686989-42c6-4992-ac9d-d465ef7119b2 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/78c6b29c-f016-42ce-9640-3450b97ab185" status: 200 len: 350 microversion: 2.1 time: 1.016507 Sep 05 17:01:29.333680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1/3] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Sep 5 17:01:28 2022] GET /compute/v2.1/os-volumes/78c6b29c-f016-42ce-9640-3450b97ab185 => generated 350 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:29.619531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-73bf00f5-2b47-4945-b03a-4927da2a8e77 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b9ce820>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:30.566043 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-73bf00f5-2b47-4945-b03a-4927da2a8e77 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af" status: 200 len: 346 microversion: 2.1 time: 0.952251 Sep 05 17:01:30.566616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 3/4] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Sep 5 17:01:29 2022] GET /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af => generated 346 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:30.585229 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f9ed3a88-7a91-4f89-8886-3fb86b5c0455 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Action: 'create', calling method: .version_select at 0x7f1d3b9b00d0>, body: {"snapshot": {"volume_id": "374efd2c-df28-45cf-9f07-2fda708ac8af", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1157214201"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:01:31.663439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f9ed3a88-7a91-4f89-8886-3fb86b5c0455 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.082562 Sep 05 17:01:31.664339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 2/5] 10.222.0.23 () {60 vars in 1162 bytes} [Mon Sep 5 17:01:30 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:31.681060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f25695dd-c435-478d-b3fb-771aee90c105 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b9ceee0>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:31.927604 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f25695dd-c435-478d-b3fb-771aee90c105 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 287 microversion: 2.1 time: 0.255496 Sep 05 17:01:31.928780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 4/6] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:31 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 287 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:31.942050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b3f29534-53f9-445e-a4c2-30354e983b4f tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b9b0160>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:32.043328 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b3f29534-53f9-445e-a4c2-30354e983b4f tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.105078 Sep 05 17:01:32.045184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 3/7] 10.222.0.23 () {58 vars in 1140 bytes} [Mon Sep 5 17:01:31 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:32.059206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e05de537-2ca1-4d56-b174-e5bebef708bb tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b9ceaf0>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:32.112238 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e05de537-2ca1-4d56-b174-e5bebef708bb tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 287 microversion: 2.1 time: 0.058240 Sep 05 17:01:32.113088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 5/8] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:32 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:33.126815 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2ddc991c-c7c9-46f0-856b-9c3fb0e18987 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b9ce430>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:33.128087 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-05b85d97-e5dd-4954-98a5-a9ffe92789a7 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] Calling method '.version_select at 0x7f1d3b9c99d0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:33.348882 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2ddc991c-c7c9-46f0-856b-9c3fb0e18987 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 287 microversion: 2.1 time: 0.227039 Sep 05 17:01:33.355060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 6/9] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:33 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 287 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:01:33.471973 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-05b85d97-e5dd-4954-98a5-a9ffe92789a7 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/63f7b7bb-13dc-4ceb-ba49-8b922681eb90" status: 200 len: 350 microversion: 2.1 time: 0.355659 Sep 05 17:01:33.481629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 4/10] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Sep 5 17:01:33 2022] GET /compute/v2.1/os-volumes/63f7b7bb-13dc-4ceb-ba49-8b922681eb90 => generated 350 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:34.362396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-964cf907-8e7b-4229-9656-cb65fa6f21e7 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b958040>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:34.428940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-964cf907-8e7b-4229-9656-cb65fa6f21e7 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 287 microversion: 2.1 time: 0.069670 Sep 05 17:01:34.435792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 7/11] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:34 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:35.443429 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-33c87657-eb53-4e2a-a8b5-5a542d72cd0e tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b9c9040>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:35.500665 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-33c87657-eb53-4e2a-a8b5-5a542d72cd0e tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 287 microversion: 2.1 time: 0.061321 Sep 05 17:01:35.501243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 5/12] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:35 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:36.454745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1492257317", "imageRef": "c1a4f3d3-4d68-489a-a57b-bae7854beb29", "flavorRef": "452", "networks": [{"uuid": "60f46f15-440e-47c2-9483-f0ca9b1d65c5"}]}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:01:36.533973 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d6f3ae19-7a13-4531-8c85-456506a1b361 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3c31d280>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:36.579410 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d6f3ae19-7a13-4531-8c85-456506a1b361 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 287 microversion: 2.1 time: 0.050313 Sep 05 17:01:36.585065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 6/13] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:36 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:36.616922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.network.neutron [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] validate_networks() for [('60f46f15-440e-47c2-9483-f0ca9b1d65c5', None, None, None, None, None)] {{(pid=120733) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:01:37.308812 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-da0db358-2281-4374-803d-30f734798c4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Action: 'create', calling method: .version_select at 0x7f1d3b9b0f70>, body: {"keypair": {"name": "tempest-keypair-428398837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfbwTOD3Ge8yg1eC3FFZh6biVUgYv0ASH6P4575EBLXwcTfNGsH+vUzbYnujxHshspYTbAps0qqywiI6z8PiL2x8W5+UqR/fkkAXhukqbVjiOAvNVkPMmJYOWp70S1yeQ=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:01:37.374482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-da0db358-2281-4374-803d-30f734798c4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Getting quotas for project e933bc308b31482a9db533a7e89aeb4b. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:01:37.388831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-da0db358-2281-4374-803d-30f734798c4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Getting quotas for user c53ac49fbc054c01a5a1ef41e04bf253 and project e933bc308b31482a9db533a7e89aeb4b. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:01:37.514956 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-da0db358-2281-4374-803d-30f734798c4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.372417 Sep 05 17:01:37.515566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 7/14] 10.222.0.23 () {62 vars in 1200 bytes} [Mon Sep 5 17:01:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 374 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 05 17:01:37.599856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6f6a78b6-7238-43b6-bf92-bf04d7257ef5 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b930160>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:37.674383 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6f6a78b6-7238-43b6-bf92-bf04d7257ef5 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 287 microversion: 2.1 time: 0.084681 Sep 05 17:01:37.675357 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 8/15] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:37 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:01:37.941650 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Flavor limits 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:01:37.943037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Image limits 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:01:37.943880 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Flavor pref 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:01:37.944552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Image pref 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:01:37.945157 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:01:37.987852 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:37.996741 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:37.998677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:38.001292 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:38.001776 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:38.002197 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:38.070708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Getting quotas for project 3fba05bd3cd4401597809b1fd0cdb439. Resources: {'ram', 'cores', 'instances'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:01:38.079377 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Getting quotas for user 117a819351b742deb901c081d0a4347b and project 3fba05bd3cd4401597809b1fd0cdb439. Resources: {'ram', 'cores', 'instances'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:01:38.094245 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Going to run 1 instances... {{(pid=120733) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:01:38.100073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a4f3d3-4d68-489a-a57b-bae7854beb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120733) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:01:38.255019 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-befcf183-4003-4d5d-a992-558b501c2cca tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.892261 Sep 05 17:01:38.263190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 8/16] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:01:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 17:01:38.287367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e49fc0dd-8286-4364-a106-2c0d545165f2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:38.288101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e49fc0dd-8286-4364-a106-2c0d545165f2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:38.316118 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-397191594", "imageRef": "c1a4f3d3-4d68-489a-a57b-bae7854beb29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:01:38.470701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e49fc0dd-8286-4364-a106-2c0d545165f2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:38.492968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] validate_networks() for [('c7cd5467-6640-4175-bb4b-ee1f5e095448', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:01:38.522981 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e49fc0dd-8286-4364-a106-2c0d545165f2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1215 microversion: 2.1 time: 0.245554 Sep 05 17:01:38.526374 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 9/17] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:38 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1215 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:38.687940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6b2cbb86-002a-45b4-aa67-0a175e9ebc7c tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b06e1f0>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:38.728923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6b2cbb86-002a-45b4-aa67-0a175e9ebc7c tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 287 microversion: 2.1 time: 0.044798 Sep 05 17:01:38.730100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 10/18] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:38 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:01:39.222952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:01:39.223671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:01:39.224680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:01:39.225100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:01:39.226455 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:01:39.242134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:39.242752 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:39.244615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:39.245588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:39.246166 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:39.246686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:39.277855 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Getting quotas for project cdbd9f06f3484da6a6fd14977b82f384. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:01:39.282751 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Getting quotas for user 06e60909a8b04008af659620527e3236 and project cdbd9f06f3484da6a6fd14977b82f384. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:01:39.301392 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:01:39.304862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a4f3d3-4d68-489a-a57b-bae7854beb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:01:39.415477 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bc333eca-600e-41a9-a913-8a248fb8c9d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.247131 Sep 05 17:01:39.416701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 9/19] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:01:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 17:01:39.428991 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-70de65eb-f83b-4efa-ad0a-a843e5d8ec88 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:39.429623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-70de65eb-f83b-4efa-ad0a-a843e5d8ec88 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:39.556295 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f10bc775-9575-43ec-99fd-7112bea486f7 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:39.557381 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f10bc775-9575-43ec-99fd-7112bea486f7 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:39.603423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-70de65eb-f83b-4efa-ad0a-a843e5d8ec88 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:39.611804 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-70de65eb-f83b-4efa-ad0a-a843e5d8ec88 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1221 microversion: 2.1 time: 0.186628 Sep 05 17:01:39.630346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 11/20] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:39 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1221 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:39.755183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ba9a040f-f5a9-4736-bbae-2ec09e7bf2f7 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b013790>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:39.816060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f10bc775-9575-43ec-99fd-7112bea486f7 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:39.830056 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ba9a040f-f5a9-4736-bbae-2ec09e7bf2f7 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 288 microversion: 2.1 time: 0.090190 Sep 05 17:01:39.831262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 12/21] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:39 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:39.840314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1093871472", "imageRef": "c1a4f3d3-4d68-489a-a57b-bae7854beb29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:01:39.848945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f10bc775-9575-43ec-99fd-7112bea486f7 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1215 microversion: 2.1 time: 0.300227 Sep 05 17:01:39.850000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 10/22] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:39 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1215 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:39.879936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d27c32a5-8483-4e93-9777-61db12fa72d4 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b887550>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:39.966606 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.network.neutron [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] validate_networks() for [('c7cd5467-6640-4175-bb4b-ee1f5e095448', None, None, None, None, None)] {{(pid=120733) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:01:40.097228 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d27c32a5-8483-4e93-9777-61db12fa72d4 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 202 len: 0 microversion: 2.1 time: 0.245868 Sep 05 17:01:40.098510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1254 bytes} [Mon Sep 5 17:01:39 2022] DELETE /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:01:40.107413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cbdaa8b5-fab8-4c11-9b46-d2126d985b2c tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b016160>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:40.201056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cbdaa8b5-fab8-4c11-9b46-d2126d985b2c tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 287 microversion: 2.1 time: 0.097317 Sep 05 17:01:40.201666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:40 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:01:40.583060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Flavor limits 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:01:40.584093 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Image limits 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:01:40.584838 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Flavor pref 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:01:40.585701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Image pref 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:01:40.587162 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:01:40.601206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:40.603241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:40.603827 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:40.605228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:40.605951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:40.606527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:40.658260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Getting quotas for project cdbd9f06f3484da6a6fd14977b82f384. Resources: {'ram', 'cores', 'instances'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:01:40.667089 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Getting quotas for user 06e60909a8b04008af659620527e3236 and project cdbd9f06f3484da6a6fd14977b82f384. Resources: {'ram', 'cores', 'instances'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:01:40.687237 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1571265578", "imageRef": "c1a4f3d3-4d68-489a-a57b-bae7854beb29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d006ed92-0ea2-4b32-aeec-4c7eba6dad1e"}], "security_groups": [{"name": "tempest-securitygroup--337684834"}], "key_name": "tempest-keypair-428398837", "user_data": "}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:01:40.706697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Going to run 1 instances... {{(pid=120733) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:01:40.712414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a4f3d3-4d68-489a-a57b-bae7854beb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120733) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:01:40.890608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2167702c-7f9a-4699-ab52-a0952886d899 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.057340 Sep 05 17:01:40.894720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] validate_networks() for [('d006ed92-0ea2-4b32-aeec-4c7eba6dad1e', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:01:40.901939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 13/25] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:01:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 17:01:40.912445 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-037feae9-450a-42c2-b63e-363cadb4556b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:40.926884 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-037feae9-450a-42c2-b63e-363cadb4556b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:40.942049 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-037feae9-450a-42c2-b63e-363cadb4556b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:40.942615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-037feae9-450a-42c2-b63e-363cadb4556b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:40.943057 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-037feae9-450a-42c2-b63e-363cadb4556b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:40.943771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-037feae9-450a-42c2-b63e-363cadb4556b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:40.944328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-037feae9-450a-42c2-b63e-363cadb4556b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:40.944758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-037feae9-450a-42c2-b63e-363cadb4556b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:41.348321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-037feae9-450a-42c2-b63e-363cadb4556b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:41.401595 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-037feae9-450a-42c2-b63e-363cadb4556b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1219 microversion: 2.1 time: 0.492781 Sep 05 17:01:41.402813 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 14/26] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:40 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1219 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:41.410995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c47ead79-5d6c-481e-afe5-a431da8c774f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:41.411647 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c47ead79-5d6c-481e-afe5-a431da8c774f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:41.603752 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c47ead79-5d6c-481e-afe5-a431da8c774f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:41.614023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c47ead79-5d6c-481e-afe5-a431da8c774f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1222 microversion: 2.1 time: 0.208149 Sep 05 17:01:41.615208 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 15/27] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:41 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1222 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:41.622527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-97089061-fd63-4679-8be2-f25783728324 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b015b80>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:41.669336 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-97089061-fd63-4679-8be2-f25783728324 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 287 microversion: 2.1 time: 0.051857 Sep 05 17:01:41.676059 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 16/28] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:41 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:41.735128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:01:41.735605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:01:41.736641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:01:41.737153 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:01:41.737832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:01:41.747836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:41.748501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:41.749005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:41.749785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:41.750349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:41.751015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:41.774256 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Getting quotas for project e933bc308b31482a9db533a7e89aeb4b. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:01:41.779025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Getting quotas for user c53ac49fbc054c01a5a1ef41e04bf253 and project e933bc308b31482a9db533a7e89aeb4b. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:01:41.791485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:01:41.794102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a4f3d3-4d68-489a-a57b-bae7854beb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:01:41.856861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-37e54297-29b6-4496-900e-a7d476b290d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.176821 Sep 05 17:01:41.858105 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 13/29] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Sep 5 17:01:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 05 17:01:41.870198 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b790c93c-dfa0-4df7-b2b3-817080795753 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:41.871038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b790c93c-dfa0-4df7-b2b3-817080795753 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:41.932028 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b790c93c-dfa0-4df7-b2b3-817080795753 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:41.943108 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b790c93c-dfa0-4df7-b2b3-817080795753 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:41.944856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b790c93c-dfa0-4df7-b2b3-817080795753 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:41.946717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b790c93c-dfa0-4df7-b2b3-817080795753 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1281 microversion: 2.20 time: 0.081691 Sep 05 17:01:41.947998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 17/30] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:01:41 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:01:42.427559 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-972da4b9-ec29-4103-922f-8f077a563e50 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:42.428893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-972da4b9-ec29-4103-922f-8f077a563e50 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:42.441052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972da4b9-ec29-4103-922f-8f077a563e50 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:42.448429 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972da4b9-ec29-4103-922f-8f077a563e50 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:42.450422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972da4b9-ec29-4103-922f-8f077a563e50 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:42.451397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972da4b9-ec29-4103-922f-8f077a563e50 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:42.452315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972da4b9-ec29-4103-922f-8f077a563e50 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:42.452926 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972da4b9-ec29-4103-922f-8f077a563e50 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:42.637971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-972da4b9-ec29-4103-922f-8f077a563e50 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:42.639753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4ad7c263-c56e-4c7a-a3f8-4e2f37c4c413 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:42.641347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4ad7c263-c56e-4c7a-a3f8-4e2f37c4c413 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:42.652926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ad7c263-c56e-4c7a-a3f8-4e2f37c4c413 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:42.653717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ad7c263-c56e-4c7a-a3f8-4e2f37c4c413 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:42.654225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ad7c263-c56e-4c7a-a3f8-4e2f37c4c413 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:42.655099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ad7c263-c56e-4c7a-a3f8-4e2f37c4c413 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:42.655700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ad7c263-c56e-4c7a-a3f8-4e2f37c4c413 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:42.656289 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ad7c263-c56e-4c7a-a3f8-4e2f37c4c413 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:42.691619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-972da4b9-ec29-4103-922f-8f077a563e50 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1219 microversion: 2.1 time: 0.270333 Sep 05 17:01:42.694365 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 14/31] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:42 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1219 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:42.707000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9da73fb9-446f-4442-b28e-a71e1334452e tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b887700>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:42.777025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9da73fb9-446f-4442-b28e-a71e1334452e tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 287 microversion: 2.1 time: 0.081444 Sep 05 17:01:42.785355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 15/32] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:42 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:42.826456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4ad7c263-c56e-4c7a-a3f8-4e2f37c4c413 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:42.842538 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4ad7c263-c56e-4c7a-a3f8-4e2f37c4c413 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1226 microversion: 2.1 time: 0.207269 Sep 05 17:01:42.845578 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 18/33] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:42 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1226 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:01:42.971773 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-da285bc8-e9fc-4690-87c5-a4e6ac88fd7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:42.972500 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-da285bc8-e9fc-4690-87c5-a4e6ac88fd7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:42.987978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da285bc8-e9fc-4690-87c5-a4e6ac88fd7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:42.992031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da285bc8-e9fc-4690-87c5-a4e6ac88fd7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:42.992923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da285bc8-e9fc-4690-87c5-a4e6ac88fd7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:42.994264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da285bc8-e9fc-4690-87c5-a4e6ac88fd7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:42.995044 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da285bc8-e9fc-4690-87c5-a4e6ac88fd7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:42.995627 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da285bc8-e9fc-4690-87c5-a4e6ac88fd7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:43.107183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-da285bc8-e9fc-4690-87c5-a4e6ac88fd7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:43.119610 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-da285bc8-e9fc-4690-87c5-a4e6ac88fd7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:43.130551 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-da285bc8-e9fc-4690-87c5-a4e6ac88fd7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:43.131723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-da285bc8-e9fc-4690-87c5-a4e6ac88fd7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1277 microversion: 2.20 time: 0.163987 Sep 05 17:01:43.142151 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 16/34] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:01:42 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:01:43.715829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-09543483-18d1-4aa9-831e-f8fc6ed67cd0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:43.716463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-09543483-18d1-4aa9-831e-f8fc6ed67cd0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:43.723655 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09543483-18d1-4aa9-831e-f8fc6ed67cd0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:43.724178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09543483-18d1-4aa9-831e-f8fc6ed67cd0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:43.724625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09543483-18d1-4aa9-831e-f8fc6ed67cd0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:43.725561 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09543483-18d1-4aa9-831e-f8fc6ed67cd0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:43.726067 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09543483-18d1-4aa9-831e-f8fc6ed67cd0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:43.726475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09543483-18d1-4aa9-831e-f8fc6ed67cd0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:43.791450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a0d2a857-a43f-4aaa-93d9-e66c87f8178c tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3af5caf0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:43.806175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-09543483-18d1-4aa9-831e-f8fc6ed67cd0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:43.817155 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-09543483-18d1-4aa9-831e-f8fc6ed67cd0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1267 microversion: 2.1 time: 0.105508 Sep 05 17:01:43.817976 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 19/35] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:43 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:43.830388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a0d2a857-a43f-4aaa-93d9-e66c87f8178c tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 287 microversion: 2.1 time: 0.043792 Sep 05 17:01:43.831134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 17/36] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:43 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:01:43.869580 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1616f8e6-615d-4c13-a0fe-e69815e3f590 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:43.870309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1616f8e6-615d-4c13-a0fe-e69815e3f590 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:43.881367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1616f8e6-615d-4c13-a0fe-e69815e3f590 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:43.881881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1616f8e6-615d-4c13-a0fe-e69815e3f590 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:43.882537 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1616f8e6-615d-4c13-a0fe-e69815e3f590 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:43.883250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1616f8e6-615d-4c13-a0fe-e69815e3f590 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:43.883959 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1616f8e6-615d-4c13-a0fe-e69815e3f590 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:43.884998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1616f8e6-615d-4c13-a0fe-e69815e3f590 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:43.956641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1616f8e6-615d-4c13-a0fe-e69815e3f590 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:43.966017 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1616f8e6-615d-4c13-a0fe-e69815e3f590 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1274 microversion: 2.1 time: 0.102811 Sep 05 17:01:43.966620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 20/37] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:43 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:44.162408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-809a925f-2c50-423b-9463-d511c288bfff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:44.163034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-809a925f-2c50-423b-9463-d511c288bfff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:44.171006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-809a925f-2c50-423b-9463-d511c288bfff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:44.171695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-809a925f-2c50-423b-9463-d511c288bfff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:44.172349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-809a925f-2c50-423b-9463-d511c288bfff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:44.173199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-809a925f-2c50-423b-9463-d511c288bfff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:44.174422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-809a925f-2c50-423b-9463-d511c288bfff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:44.174860 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-809a925f-2c50-423b-9463-d511c288bfff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:44.262126 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-809a925f-2c50-423b-9463-d511c288bfff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:44.276504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-809a925f-2c50-423b-9463-d511c288bfff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:44.279088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-809a925f-2c50-423b-9463-d511c288bfff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:44.284355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-809a925f-2c50-423b-9463-d511c288bfff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1333 microversion: 2.20 time: 0.123758 Sep 05 17:01:44.296769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 18/38] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:01:44 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1333 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:01:44.846175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-eebd6f34-06ff-4265-9ad1-85cba3205d34 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3afc8280>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:44.847804 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-524e8547-8845-4429-93dc-f9d927f3b606 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:44.849510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-524e8547-8845-4429-93dc-f9d927f3b606 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:44.861933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-524e8547-8845-4429-93dc-f9d927f3b606 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:44.862868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-524e8547-8845-4429-93dc-f9d927f3b606 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:44.863665 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-524e8547-8845-4429-93dc-f9d927f3b606 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:44.864529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-524e8547-8845-4429-93dc-f9d927f3b606 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:44.865067 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-524e8547-8845-4429-93dc-f9d927f3b606 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:44.865539 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-524e8547-8845-4429-93dc-f9d927f3b606 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:44.898195 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-eebd6f34-06ff-4265-9ad1-85cba3205d34 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 287 microversion: 2.1 time: 0.057943 Sep 05 17:01:44.898763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 19/39] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:44 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:01:44.941353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-524e8547-8845-4429-93dc-f9d927f3b606 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:44.951319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-524e8547-8845-4429-93dc-f9d927f3b606 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1267 microversion: 2.1 time: 0.114378 Sep 05 17:01:44.952700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 21/40] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:44 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1267 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:44.992096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a0505129-cc45-4319-b151-efa82b990808 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:44.992784 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a0505129-cc45-4319-b151-efa82b990808 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:45.010941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0505129-cc45-4319-b151-efa82b990808 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:45.011841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0505129-cc45-4319-b151-efa82b990808 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:45.012500 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0505129-cc45-4319-b151-efa82b990808 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:45.013291 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0505129-cc45-4319-b151-efa82b990808 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:45.013753 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0505129-cc45-4319-b151-efa82b990808 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:45.014392 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0505129-cc45-4319-b151-efa82b990808 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:45.089098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a0505129-cc45-4319-b151-efa82b990808 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:45.096944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a0505129-cc45-4319-b151-efa82b990808 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1274 microversion: 2.1 time: 0.109188 Sep 05 17:01:45.097509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 20/41] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:44 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:45.312271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4e91a0cd-5670-418e-b31a-58500250eeef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:45.313039 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4e91a0cd-5670-418e-b31a-58500250eeef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:45.319942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e91a0cd-5670-418e-b31a-58500250eeef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:45.320453 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e91a0cd-5670-418e-b31a-58500250eeef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:45.320891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e91a0cd-5670-418e-b31a-58500250eeef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:45.322057 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e91a0cd-5670-418e-b31a-58500250eeef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:45.322317 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e91a0cd-5670-418e-b31a-58500250eeef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:45.322745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e91a0cd-5670-418e-b31a-58500250eeef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:45.389150 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4e91a0cd-5670-418e-b31a-58500250eeef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:45.397207 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4e91a0cd-5670-418e-b31a-58500250eeef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:45.398696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4e91a0cd-5670-418e-b31a-58500250eeef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:45.399852 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4e91a0cd-5670-418e-b31a-58500250eeef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1333 microversion: 2.20 time: 0.091685 Sep 05 17:01:45.400442 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:01:45 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:01:45.911496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-15395de8-ffb8-4242-ac91-3384ac5757c1 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3afbc8b0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:45.945349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-15395de8-ffb8-4242-ac91-3384ac5757c1 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 287 microversion: 2.1 time: 0.037745 Sep 05 17:01:45.945933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 21/43] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:45 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:45.978467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2849ec3b-82eb-4e3b-a534-7e7b561e5cfc tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:45.979089 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2849ec3b-82eb-4e3b-a534-7e7b561e5cfc tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:45.985584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2849ec3b-82eb-4e3b-a534-7e7b561e5cfc tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:45.986074 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2849ec3b-82eb-4e3b-a534-7e7b561e5cfc tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:45.986603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2849ec3b-82eb-4e3b-a534-7e7b561e5cfc tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:45.987348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2849ec3b-82eb-4e3b-a534-7e7b561e5cfc tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:45.987817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2849ec3b-82eb-4e3b-a534-7e7b561e5cfc tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:45.988315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2849ec3b-82eb-4e3b-a534-7e7b561e5cfc tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:46.060309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2849ec3b-82eb-4e3b-a534-7e7b561e5cfc tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:46.067891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2849ec3b-82eb-4e3b-a534-7e7b561e5cfc tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1267 microversion: 2.1 time: 0.096264 Sep 05 17:01:46.068495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 23/44] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:45 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:46.120601 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2d4be89f-c14a-41db-9dc0-aec2c7aef1e9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:46.121231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2d4be89f-c14a-41db-9dc0-aec2c7aef1e9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:46.127415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d4be89f-c14a-41db-9dc0-aec2c7aef1e9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:46.128017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d4be89f-c14a-41db-9dc0-aec2c7aef1e9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:46.128574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d4be89f-c14a-41db-9dc0-aec2c7aef1e9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:46.129269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d4be89f-c14a-41db-9dc0-aec2c7aef1e9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:46.129740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d4be89f-c14a-41db-9dc0-aec2c7aef1e9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:46.130365 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d4be89f-c14a-41db-9dc0-aec2c7aef1e9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:46.193399 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2d4be89f-c14a-41db-9dc0-aec2c7aef1e9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:46.204590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2d4be89f-c14a-41db-9dc0-aec2c7aef1e9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1274 microversion: 2.1 time: 0.088053 Sep 05 17:01:46.207841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 22/45] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:46 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:46.425414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fa616429-3391-4d1b-b301-50e0f8199460 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:46.426667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fa616429-3391-4d1b-b301-50e0f8199460 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:46.434118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa616429-3391-4d1b-b301-50e0f8199460 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:46.434690 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa616429-3391-4d1b-b301-50e0f8199460 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:46.435324 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa616429-3391-4d1b-b301-50e0f8199460 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:46.436044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa616429-3391-4d1b-b301-50e0f8199460 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:46.436524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa616429-3391-4d1b-b301-50e0f8199460 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:46.437136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa616429-3391-4d1b-b301-50e0f8199460 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:46.506966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fa616429-3391-4d1b-b301-50e0f8199460 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:46.517950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fa616429-3391-4d1b-b301-50e0f8199460 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:46.519844 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fa616429-3391-4d1b-b301-50e0f8199460 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:46.521169 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fa616429-3391-4d1b-b301-50e0f8199460 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1333 microversion: 2.20 time: 0.099758 Sep 05 17:01:46.521790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:01:46 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1333 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:01:46.960317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f0905011-b2af-441d-bcd3-7455db296387 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3afbc9d0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:46.994821 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f0905011-b2af-441d-bcd3-7455db296387 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 287 microversion: 2.1 time: 0.039145 Sep 05 17:01:46.995391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 23/47] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:46 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:47.097102 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fdb1db42-dff6-4549-ac87-829aecbb14a1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:47.098145 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fdb1db42-dff6-4549-ac87-829aecbb14a1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:47.104463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fdb1db42-dff6-4549-ac87-829aecbb14a1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:47.104978 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fdb1db42-dff6-4549-ac87-829aecbb14a1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:47.105398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fdb1db42-dff6-4549-ac87-829aecbb14a1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:47.106101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fdb1db42-dff6-4549-ac87-829aecbb14a1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:47.106558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fdb1db42-dff6-4549-ac87-829aecbb14a1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:47.107005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fdb1db42-dff6-4549-ac87-829aecbb14a1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:47.168052 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fdb1db42-dff6-4549-ac87-829aecbb14a1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:47.176211 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fdb1db42-dff6-4549-ac87-829aecbb14a1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1267 microversion: 2.1 time: 0.087301 Sep 05 17:01:47.176775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 25/48] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:47 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:47.229652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c1805194-b5f2-4e8e-92f9-cb5e99bda2de tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:47.230203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c1805194-b5f2-4e8e-92f9-cb5e99bda2de tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:47.236434 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1805194-b5f2-4e8e-92f9-cb5e99bda2de tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:47.236922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1805194-b5f2-4e8e-92f9-cb5e99bda2de tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:47.237357 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1805194-b5f2-4e8e-92f9-cb5e99bda2de tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:47.238049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1805194-b5f2-4e8e-92f9-cb5e99bda2de tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:47.238504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1805194-b5f2-4e8e-92f9-cb5e99bda2de tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:47.238925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1805194-b5f2-4e8e-92f9-cb5e99bda2de tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:47.303932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c1805194-b5f2-4e8e-92f9-cb5e99bda2de tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:47.328183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c1805194-b5f2-4e8e-92f9-cb5e99bda2de tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1274 microversion: 2.1 time: 0.102439 Sep 05 17:01:47.330179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 24/49] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:47 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:47.546140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ddaa0abe-e64f-452f-b0ee-a722ba92e12f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:47.546765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ddaa0abe-e64f-452f-b0ee-a722ba92e12f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:47.552788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ddaa0abe-e64f-452f-b0ee-a722ba92e12f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:47.553256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ddaa0abe-e64f-452f-b0ee-a722ba92e12f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:47.553682 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ddaa0abe-e64f-452f-b0ee-a722ba92e12f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:47.554409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ddaa0abe-e64f-452f-b0ee-a722ba92e12f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:47.554813 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ddaa0abe-e64f-452f-b0ee-a722ba92e12f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:47.555225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ddaa0abe-e64f-452f-b0ee-a722ba92e12f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:47.616189 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ddaa0abe-e64f-452f-b0ee-a722ba92e12f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:47.625181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ddaa0abe-e64f-452f-b0ee-a722ba92e12f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:47.626642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ddaa0abe-e64f-452f-b0ee-a722ba92e12f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:47.627723 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ddaa0abe-e64f-452f-b0ee-a722ba92e12f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1333 microversion: 2.20 time: 0.085933 Sep 05 17:01:47.628295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:01:47 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:01:48.007735 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d7590867-28a2-4b3c-8534-a790df83f585 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b0313a0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:48.040580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d7590867-28a2-4b3c-8534-a790df83f585 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 200 len: 287 microversion: 2.1 time: 0.037328 Sep 05 17:01:48.041216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 25/51] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:48 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:48.202728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-34be534d-a5ae-4d16-8b55-f14276860b0c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:48.204500 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-34be534d-a5ae-4d16-8b55-f14276860b0c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:48.223729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34be534d-a5ae-4d16-8b55-f14276860b0c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:48.224818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34be534d-a5ae-4d16-8b55-f14276860b0c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:48.229880 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34be534d-a5ae-4d16-8b55-f14276860b0c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:48.231206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34be534d-a5ae-4d16-8b55-f14276860b0c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:48.232082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34be534d-a5ae-4d16-8b55-f14276860b0c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:48.234795 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34be534d-a5ae-4d16-8b55-f14276860b0c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:48.361207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-500a6cd3-cde3-43f6-b22b-f06a27183699 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:48.361956 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-500a6cd3-cde3-43f6-b22b-f06a27183699 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:48.379418 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-500a6cd3-cde3-43f6-b22b-f06a27183699 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:48.380506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-500a6cd3-cde3-43f6-b22b-f06a27183699 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:48.382005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-500a6cd3-cde3-43f6-b22b-f06a27183699 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:48.383242 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-500a6cd3-cde3-43f6-b22b-f06a27183699 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:48.385548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-500a6cd3-cde3-43f6-b22b-f06a27183699 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:48.388382 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-500a6cd3-cde3-43f6-b22b-f06a27183699 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:48.405426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-34be534d-a5ae-4d16-8b55-f14276860b0c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:48.414385 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-34be534d-a5ae-4d16-8b55-f14276860b0c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1275 microversion: 2.1 time: 0.218747 Sep 05 17:01:48.418346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 27/52] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:48 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:01:48.554053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-500a6cd3-cde3-43f6-b22b-f06a27183699 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:48.579684 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-500a6cd3-cde3-43f6-b22b-f06a27183699 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1280 microversion: 2.1 time: 0.228507 Sep 05 17:01:48.600260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 26/53] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:48 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1280 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:01:48.654684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f51fce67-088a-4530-9663-f92e64dc75c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:48.655450 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f51fce67-088a-4530-9663-f92e64dc75c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:48.689563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f51fce67-088a-4530-9663-f92e64dc75c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:48.697897 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f51fce67-088a-4530-9663-f92e64dc75c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:48.701514 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f51fce67-088a-4530-9663-f92e64dc75c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:48.704404 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f51fce67-088a-4530-9663-f92e64dc75c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:48.707120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f51fce67-088a-4530-9663-f92e64dc75c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:48.707771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f51fce67-088a-4530-9663-f92e64dc75c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:48.837870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f51fce67-088a-4530-9663-f92e64dc75c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:48.849437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f51fce67-088a-4530-9663-f92e64dc75c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:48.852926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f51fce67-088a-4530-9663-f92e64dc75c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:48.857036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f51fce67-088a-4530-9663-f92e64dc75c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1339 microversion: 2.20 time: 0.209189 Sep 05 17:01:48.860465 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 28/54] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:01:48 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1339 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:01:49.061031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a92a4373-6e30-4e5e-b66e-31373a818a26 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3af67700>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:49.098830 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-a92a4373-6e30-4e5e-b66e-31373a818a26 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] HTTP exception thrown: Snapshot 5ef289b1-36d1-4606-91d6-53d402eb1ad7 could not be found. Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a92a4373-6e30-4e5e-b66e-31373a818a26 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Request method failure captured: Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 HTTP/1.1 Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFitlyN4dRpbkEyOAv7Hc-UK5bD5AEJ4EsLy56qYB-liVzODk3Fh9Bf2UJE5BUIdfJFX29Ti3eh9G7NFyGYkP5B5xw7FQedITv0ilC4eU716oAZ59b8TH-iKfC1LY-V-LhoXOE3jHa69rF0gncRwNU6HISX_YQ1ml6ckjzNbwfDF6v_s Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: bdc64dc236bf4a87b93a1561ff53293b Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1298965702 Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:01:49.106094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:01:49.107297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bdc64dc236bf4a87b93a1561ff53293b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bdc64dc236bf4a87b93a1561ff53293b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bdc64dc236bf4a87b93a1561ff53293b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bdc64dc236bf4a87b93a1561ff53293b"}]}] Sep 05 17:01:49.107297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1298965702 Sep 05 17:01:49.107297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: bdc64dc236bf4a87b93a1561ff53293b Sep 05 17:01:49.107297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1298965702 Sep 05 17:01:49.107297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-VolumesSnapshotsTestJSON-1298965702-project Sep 05 17:01:49.107297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:01:49.107297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:01:49.107297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: e2d470c0a2624ddcbb015ca02598e5d4 Sep 05 17:01:49.107297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1298965702-project Sep 05 17:01:49.107297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: Sep 05 17:01:49.107297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Snapshot 5ef289b1-36d1-4606-91d6-53d402eb1ad7 could not be found. Sep 05 17:01:49.107297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': '5ef289b1-36d1-4606-91d6-53d402eb1ad7'} Sep 05 17:01:49.107297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5ef289b1-36d1-4606-91d6-53d402eb1ad7 could not be found. (HTTP 404) (Request-ID: req-1ce691de-4441-4053-b9b1-327644e157bc) Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:49.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 17:01:49.108952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5ef289b1-36d1-4606-91d6-53d402eb1ad7 could not be found. Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 05 17:01:49.109891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:01:49.110811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5ef289b1-36d1-4606-91d6-53d402eb1ad7 could not be found. Sep 05 17:01:49.110811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:49.110811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:01:49.110811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:49.110811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:01:49.110811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:01:49.110811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:01:49.110811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:01:49.110811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:01:49.110811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5ef289b1-36d1-4606-91d6-53d402eb1ad7 could not be found. Sep 05 17:01:49.110811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:49.110811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a92a4373-6e30-4e5e-b66e-31373a818a26 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Returning 404 to user: Snapshot 5ef289b1-36d1-4606-91d6-53d402eb1ad7 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:01:49.110811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a92a4373-6e30-4e5e-b66e-31373a818a26 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7" status: 404 len: 111 microversion: 2.1 time: 0.058332 Sep 05 17:01:49.121047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3fbeca9b-254d-469f-b031-522621bc44e5 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3af7ea60>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:49.132532 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 27/55] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:01:49 2022] GET /compute/v2.1/os-snapshots/5ef289b1-36d1-4606-91d6-53d402eb1ad7 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:01:49.242671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3fbeca9b-254d-469f-b031-522621bc44e5 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af" status: 202 len: 0 microversion: 2.1 time: 0.129168 Sep 05 17:01:49.247940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 29/56] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Sep 5 17:01:49 2022] DELETE /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:01:49.253738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c8a337e7-83d4-4a1b-802c-f4f9509aeefb tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3c31d5e0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:49.341136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c8a337e7-83d4-4a1b-802c-f4f9509aeefb tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af" status: 200 len: 345 microversion: 2.1 time: 0.091972 Sep 05 17:01:49.342561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 28/57] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Sep 5 17:01:49 2022] GET /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af => generated 345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:01:49.440868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-39957bb1-3607-4b54-8fe5-1fe4cc3454f0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:49.441750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-39957bb1-3607-4b54-8fe5-1fe4cc3454f0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:49.453296 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-39957bb1-3607-4b54-8fe5-1fe4cc3454f0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:49.453981 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-39957bb1-3607-4b54-8fe5-1fe4cc3454f0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:49.454415 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-39957bb1-3607-4b54-8fe5-1fe4cc3454f0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:49.455118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-39957bb1-3607-4b54-8fe5-1fe4cc3454f0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:49.458247 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-39957bb1-3607-4b54-8fe5-1fe4cc3454f0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:49.461973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-39957bb1-3607-4b54-8fe5-1fe4cc3454f0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:49.499745 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-20721718-7a77-488b-ae73-baab11c493f6 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] Calling method '.version_select at 0x7f1d3b025790>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:49.754428 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-39957bb1-3607-4b54-8fe5-1fe4cc3454f0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:49.777107 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-39957bb1-3607-4b54-8fe5-1fe4cc3454f0 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1273 microversion: 2.1 time: 0.340363 Sep 05 17:01:49.777593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-20721718-7a77-488b-ae73-baab11c493f6 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/9625bf76-c88e-43bc-91fd-a7fc0d6f1852" status: 200 len: 351 microversion: 2.1 time: 0.284158 Sep 05 17:01:49.783528 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 30/58] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:49 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1273 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:49.794646 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 29/59] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Sep 5 17:01:49 2022] GET /compute/v2.1/os-volumes/9625bf76-c88e-43bc-91fd-a7fc0d6f1852 => generated 351 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:01:49.801290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-60f162a9-b175-44b2-ad0d-2265d7b04f6e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:49.803334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-60f162a9-b175-44b2-ad0d-2265d7b04f6e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:49.807350 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-90cd3da5-4391-444f-9f6f-7367fef50885 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] Calling method '.version_select at 0x7f1d3afc8670>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:49.825193 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60f162a9-b175-44b2-ad0d-2265d7b04f6e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:49.830899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60f162a9-b175-44b2-ad0d-2265d7b04f6e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:49.831566 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60f162a9-b175-44b2-ad0d-2265d7b04f6e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:49.832601 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60f162a9-b175-44b2-ad0d-2265d7b04f6e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:49.834936 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60f162a9-b175-44b2-ad0d-2265d7b04f6e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:49.836734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60f162a9-b175-44b2-ad0d-2265d7b04f6e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:50.096807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-90cd3da5-4391-444f-9f6f-7367fef50885 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.300087 Sep 05 17:01:50.097404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 30/60] 10.222.0.23 () {58 vars in 1134 bytes} [Mon Sep 5 17:01:49 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:50.102980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-efe68601-5078-4119-a077-807a3be34e5a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:50.103602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-efe68601-5078-4119-a077-807a3be34e5a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:50.128867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe68601-5078-4119-a077-807a3be34e5a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:50.129362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe68601-5078-4119-a077-807a3be34e5a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:50.129790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe68601-5078-4119-a077-807a3be34e5a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:50.130498 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe68601-5078-4119-a077-807a3be34e5a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:50.130957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe68601-5078-4119-a077-807a3be34e5a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:50.131375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe68601-5078-4119-a077-807a3be34e5a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:50.629228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=4 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:01:50.952809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-efe68601-5078-4119-a077-807a3be34e5a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:50.978982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-efe68601-5078-4119-a077-807a3be34e5a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:50.981793 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-efe68601-5078-4119-a077-807a3be34e5a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:50.987028 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-efe68601-5078-4119-a077-807a3be34e5a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1339 microversion: 2.20 time: 0.888480 Sep 05 17:01:50.998653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 31/61] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:01:50 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1339 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:01:51.025969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-106d505f-c1ca-417d-acee-1ff9ac6015b3 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] Calling method '.version_select at 0x7f1d3af46940>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:51.042230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-60f162a9-b175-44b2-ad0d-2265d7b04f6e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:51.088575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-60f162a9-b175-44b2-ad0d-2265d7b04f6e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 1.296637 Sep 05 17:01:51.093042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 31/62] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:49 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:51.141573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-da0595f7-99e1-48ef-987e-0bad6ffcc80a tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3af91310>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:51.290818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-da0595f7-99e1-48ef-987e-0bad6ffcc80a tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] HTTP exception thrown: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-da0595f7-99e1-48ef-987e-0bad6ffcc80a tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Request method failure captured: Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: GET /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af HTTP/1.1 Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFitlyN4dRpbkEyOAv7Hc-UK5bD5AEJ4EsLy56qYB-liVzODk3Fh9Bf2UJE5BUIdfJFX29Ti3eh9G7NFyGYkP5B5xw7FQedITv0ilC4eU716oAZ59b8TH-iKfC1LY-V-LhoXOE3jHa69rF0gncRwNU6HISX_YQ1ml6ckjzNbwfDF6v_s Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: bdc64dc236bf4a87b93a1561ff53293b Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1298965702 Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:01:51.298393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:01:51.300805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bdc64dc236bf4a87b93a1561ff53293b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bdc64dc236bf4a87b93a1561ff53293b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bdc64dc236bf4a87b93a1561ff53293b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bdc64dc236bf4a87b93a1561ff53293b"}]}] Sep 05 17:01:51.300805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1298965702 Sep 05 17:01:51.300805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: bdc64dc236bf4a87b93a1561ff53293b Sep 05 17:01:51.300805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1298965702 Sep 05 17:01:51.300805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-VolumesSnapshotsTestJSON-1298965702-project Sep 05 17:01:51.300805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:01:51.300805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:01:51.300805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: e2d470c0a2624ddcbb015ca02598e5d4 Sep 05 17:01:51.300805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1298965702-project Sep 05 17:01:51.300805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: Sep 05 17:01:51.300805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. Sep 05 17:01:51.300805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': '374efd2c-df28-45cf-9f07-2fda708ac8af'} Sep 05 17:01:51.300805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. (HTTP 404) (Request-ID: req-4c6e08fc-7352-475c-beb7-d2d424a30a2d) Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:01:51.301768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 17:01:51.303696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 05 17:01:51.306227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:01:51.308603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. Sep 05 17:01:51.308603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.308603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:01:51.308603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.308603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:01:51.308603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:01:51.308603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:01:51.308603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:01:51.308603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:01:51.308603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. Sep 05 17:01:51.308603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.310928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-da0595f7-99e1-48ef-987e-0bad6ffcc80a tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Returning 404 to user: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:01:51.315035 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-da0595f7-99e1-48ef-987e-0bad6ffcc80a tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af" status: 404 len: 109 microversion: 2.1 time: 0.218837 Sep 05 17:01:51.321418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 32/63] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Sep 5 17:01:51 2022] GET /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af => generated 109 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:01:51.337636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ac05ed40-1872-46d5-9128-65f696723a01 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:51.342758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ac05ed40-1872-46d5-9128-65f696723a01 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:51.370449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac05ed40-1872-46d5-9128-65f696723a01 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:51.371269 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac05ed40-1872-46d5-9128-65f696723a01 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:51.372629 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac05ed40-1872-46d5-9128-65f696723a01 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:51.375941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-106d505f-c1ca-417d-acee-1ff9ac6015b3 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.372487 Sep 05 17:01:51.377139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 32/64] 10.222.0.23 () {58 vars in 1149 bytes} [Mon Sep 5 17:01:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:51.379379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac05ed40-1872-46d5-9128-65f696723a01 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:51.380234 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac05ed40-1872-46d5-9128-65f696723a01 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:51.380812 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac05ed40-1872-46d5-9128-65f696723a01 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:51.393407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3710d140-03bc-4f72-889f-90c7f093464c tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3b025820>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:51.460705 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-3710d140-03bc-4f72-889f-90c7f093464c tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] HTTP exception thrown: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3710d140-03bc-4f72-889f-90c7f093464c tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Request method failure captured: Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af HTTP/1.1 Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFitlyN4dRpbkEyOAv7Hc-UK5bD5AEJ4EsLy56qYB-liVzODk3Fh9Bf2UJE5BUIdfJFX29Ti3eh9G7NFyGYkP5B5xw7FQedITv0ilC4eU716oAZ59b8TH-iKfC1LY-V-LhoXOE3jHa69rF0gncRwNU6HISX_YQ1ml6ckjzNbwfDF6v_s Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: bdc64dc236bf4a87b93a1561ff53293b Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1298965702 Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:01:51.463086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:01:51.464424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bdc64dc236bf4a87b93a1561ff53293b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bdc64dc236bf4a87b93a1561ff53293b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bdc64dc236bf4a87b93a1561ff53293b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bdc64dc236bf4a87b93a1561ff53293b"}]}] Sep 05 17:01:51.464424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1298965702 Sep 05 17:01:51.464424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: bdc64dc236bf4a87b93a1561ff53293b Sep 05 17:01:51.464424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1298965702 Sep 05 17:01:51.464424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-VolumesSnapshotsTestJSON-1298965702-project Sep 05 17:01:51.464424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:01:51.464424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:01:51.464424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: e2d470c0a2624ddcbb015ca02598e5d4 Sep 05 17:01:51.464424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1298965702-project Sep 05 17:01:51.464424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: Sep 05 17:01:51.464424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. Sep 05 17:01:51.464424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': '374efd2c-df28-45cf-9f07-2fda708ac8af'} Sep 05 17:01:51.464424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. (HTTP 404) (Request-ID: req-94426d28-8e63-4841-a24c-99fd87d09a8b) Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:01:51.465215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 17:01:51.466219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 05 17:01:51.467102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:01:51.468121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. Sep 05 17:01:51.468121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.468121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:01:51.468121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.468121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:01:51.468121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:01:51.468121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:01:51.468121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:01:51.468121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:01:51.468121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. Sep 05 17:01:51.468121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.468121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3710d140-03bc-4f72-889f-90c7f093464c tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Returning 404 to user: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:01:51.468121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3710d140-03bc-4f72-889f-90c7f093464c tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af" status: 404 len: 109 microversion: 2.1 time: 0.086424 Sep 05 17:01:51.468121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 33/65] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Sep 5 17:01:51 2022] DELETE /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:01:51.479205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f58ee1ff-f198-4bf6-af42-d67b477c5dd2 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] Calling method '.version_select at 0x7f1d3b025ee0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:51.758656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f58ee1ff-f198-4bf6-af42-d67b477c5dd2 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.290826 Sep 05 17:01:51.759735 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 34/66] 10.222.0.23 () {58 vars in 1134 bytes} [Mon Sep 5 17:01:51 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:51.762996 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=4 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:01:51.776870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c6baf6c1-282a-40de-84d2-0777392162a3 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Calling method '.version_select at 0x7f1d3af46d30>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:51.799695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=18 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:01:51.854418 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-c6baf6c1-282a-40de-84d2-0777392162a3 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] HTTP exception thrown: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c6baf6c1-282a-40de-84d2-0777392162a3 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Request method failure captured: Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af HTTP/1.1 Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFitlyN4dRpbkEyOAv7Hc-UK5bD5AEJ4EsLy56qYB-liVzODk3Fh9Bf2UJE5BUIdfJFX29Ti3eh9G7NFyGYkP5B5xw7FQedITv0ilC4eU716oAZ59b8TH-iKfC1LY-V-LhoXOE3jHa69rF0gncRwNU6HISX_YQ1ml6ckjzNbwfDF6v_s Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: bdc64dc236bf4a87b93a1561ff53293b Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1298965702 Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:01:51.856443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:01:51.857771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bdc64dc236bf4a87b93a1561ff53293b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bdc64dc236bf4a87b93a1561ff53293b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bdc64dc236bf4a87b93a1561ff53293b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bdc64dc236bf4a87b93a1561ff53293b"}]}] Sep 05 17:01:51.857771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1298965702 Sep 05 17:01:51.857771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: bdc64dc236bf4a87b93a1561ff53293b Sep 05 17:01:51.857771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1298965702 Sep 05 17:01:51.857771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-VolumesSnapshotsTestJSON-1298965702-project Sep 05 17:01:51.857771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:01:51.857771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:01:51.857771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: e2d470c0a2624ddcbb015ca02598e5d4 Sep 05 17:01:51.857771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1298965702-project Sep 05 17:01:51.857771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: Sep 05 17:01:51.857771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. Sep 05 17:01:51.857771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': '374efd2c-df28-45cf-9f07-2fda708ac8af'} Sep 05 17:01:51.857771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. (HTTP 404) (Request-ID: req-bd51ccf8-1c24-4407-b5a9-aa50a0112fbf) Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:01:51.858598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 17:01:51.859680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 05 17:01:51.860896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:01:51.862269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. Sep 05 17:01:51.862269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.862269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:01:51.862269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.862269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:01:51.862269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:01:51.862269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:01:51.862269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:01:51.862269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:01:51.862269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. Sep 05 17:01:51.862269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:01:51.862269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c6baf6c1-282a-40de-84d2-0777392162a3 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] Returning 404 to user: Volume 374efd2c-df28-45cf-9f07-2fda708ac8af could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:01:51.862269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c6baf6c1-282a-40de-84d2-0777392162a3 tempest-VolumesSnapshotsTestJSON-1298965702 tempest-VolumesSnapshotsTestJSON-1298965702-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af" status: 404 len: 109 microversion: 2.1 time: 0.097107 Sep 05 17:01:51.862269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 35/67] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Sep 5 17:01:51 2022] GET /compute/v2.1/os-volumes/374efd2c-df28-45cf-9f07-2fda708ac8af => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:01:51.882006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-60097101-4c3f-4e29-b58b-e0bbf3def20a tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] Calling method '.version_select at 0x7f1d3afb3af0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:51.937290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=20 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:01:52.189580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-60097101-4c3f-4e29-b58b-e0bbf3def20a tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.329931 Sep 05 17:01:52.190427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 36/68] 10.222.0.23 () {58 vars in 1167 bytes} [Mon Sep 5 17:01:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:52.205620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d1f18ec1-00db-40ad-8a38-6690aeb97bef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:52.206235 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d1f18ec1-00db-40ad-8a38-6690aeb97bef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:52.230506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1f18ec1-00db-40ad-8a38-6690aeb97bef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:52.231051 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1f18ec1-00db-40ad-8a38-6690aeb97bef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:52.236255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1f18ec1-00db-40ad-8a38-6690aeb97bef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:52.239717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1f18ec1-00db-40ad-8a38-6690aeb97bef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:52.240473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1f18ec1-00db-40ad-8a38-6690aeb97bef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:52.244022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1f18ec1-00db-40ad-8a38-6690aeb97bef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:52.388862 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ac05ed40-1872-46d5-9128-65f696723a01 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:52.401826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ac05ed40-1872-46d5-9128-65f696723a01 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 1.077979 Sep 05 17:01:52.402815 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 33/69] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:51 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:52.416272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-43cd86c9-2684-40e2-a228-75e4b4c0295d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:52.420546 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-43cd86c9-2684-40e2-a228-75e4b4c0295d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:52.450091 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43cd86c9-2684-40e2-a228-75e4b4c0295d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:52.450824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43cd86c9-2684-40e2-a228-75e4b4c0295d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:52.452100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43cd86c9-2684-40e2-a228-75e4b4c0295d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:52.453805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43cd86c9-2684-40e2-a228-75e4b4c0295d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:52.455302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43cd86c9-2684-40e2-a228-75e4b4c0295d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:52.458058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43cd86c9-2684-40e2-a228-75e4b4c0295d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:53.427774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d1f18ec1-00db-40ad-8a38-6690aeb97bef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:53.440976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d1f18ec1-00db-40ad-8a38-6690aeb97bef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:53.446704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d1f18ec1-00db-40ad-8a38-6690aeb97bef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:53.448124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d1f18ec1-00db-40ad-8a38-6690aeb97bef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 1.256570 Sep 05 17:01:53.452439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 37/70] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:01:52 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:01:53.463764 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2729dad8-2048-4910-980d-999612c9b52c tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] Calling method '.version_select at 0x7f1d3af460d0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:53.599635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2729dad8-2048-4910-980d-999612c9b52c tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.142969 Sep 05 17:01:53.610708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 38/71] 10.222.0.23 () {58 vars in 1170 bytes} [Mon Sep 5 17:01:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:53.627726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-464b2599-e7ac-4691-b212-caa420cbd73b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:53.628454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-464b2599-e7ac-4691-b212-caa420cbd73b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:53.636179 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-43cd86c9-2684-40e2-a228-75e4b4c0295d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:53.642337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:01:53.651646 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-464b2599-e7ac-4691-b212-caa420cbd73b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:53.652191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-464b2599-e7ac-4691-b212-caa420cbd73b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:53.652632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-464b2599-e7ac-4691-b212-caa420cbd73b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:53.655085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-464b2599-e7ac-4691-b212-caa420cbd73b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:53.655611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-464b2599-e7ac-4691-b212-caa420cbd73b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:53.656983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-43cd86c9-2684-40e2-a228-75e4b4c0295d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 1.252249 Sep 05 17:01:53.659067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-464b2599-e7ac-4691-b212-caa420cbd73b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:53.660104 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 34/72] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:52 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:53.675560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2fbea60a-2c51-4c4e-a6a7-3e9fc65bca29 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] Calling method '.version_select at 0x7f1d3af36b80>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:53.907020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2fbea60a-2c51-4c4e-a6a7-3e9fc65bca29 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.243827 Sep 05 17:01:53.908760 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 35/73] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Sep 5 17:01:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:53.922743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-677eee2e-705e-43a7-bc7d-a2199eb39794 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] Calling method '.version_select at 0x7f1d3af91ee0>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:54.173796 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-677eee2e-705e-43a7-bc7d-a2199eb39794 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.254423 Sep 05 17:01:54.174417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 36/74] 10.222.0.23 () {58 vars in 1188 bytes} [Mon Sep 5 17:01:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:54.189153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1cbdf46e-56d1-40a5-bcb8-fb75ed4d3ca6 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] Calling method '.version_select at 0x7f1d3aea2280>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:54.348586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1cbdf46e-56d1-40a5-bcb8-fb75ed4d3ca6 tempest-VolumesTestJSON-1868086286 tempest-VolumesTestJSON-1868086286-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.163997 Sep 05 17:01:54.349718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 37/75] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Sep 5 17:01:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:54.484764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-285a019e-61be-4013-bbaf-5b0a34b807b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:54.485936 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-285a019e-61be-4013-bbaf-5b0a34b807b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:54.490787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-464b2599-e7ac-4691-b212-caa420cbd73b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:54.497136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-285a019e-61be-4013-bbaf-5b0a34b807b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:54.514757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-285a019e-61be-4013-bbaf-5b0a34b807b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:54.515188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-285a019e-61be-4013-bbaf-5b0a34b807b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:54.515931 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-285a019e-61be-4013-bbaf-5b0a34b807b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:54.516412 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-285a019e-61be-4013-bbaf-5b0a34b807b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:54.516708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-464b2599-e7ac-4691-b212-caa420cbd73b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.901730 Sep 05 17:01:54.516819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-285a019e-61be-4013-bbaf-5b0a34b807b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:54.517869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 39/76] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:53 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:54.689457 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-16247672-9915-4dfd-819e-3838017d9aea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:54.689457 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-16247672-9915-4dfd-819e-3838017d9aea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:54.702393 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16247672-9915-4dfd-819e-3838017d9aea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:54.702904 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16247672-9915-4dfd-819e-3838017d9aea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:54.707188 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16247672-9915-4dfd-819e-3838017d9aea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:54.710259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16247672-9915-4dfd-819e-3838017d9aea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:54.713103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16247672-9915-4dfd-819e-3838017d9aea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:54.714087 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16247672-9915-4dfd-819e-3838017d9aea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:55.342893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-285a019e-61be-4013-bbaf-5b0a34b807b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:55.348464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-285a019e-61be-4013-bbaf-5b0a34b807b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:55.349922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-285a019e-61be-4013-bbaf-5b0a34b807b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:55.351055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-285a019e-61be-4013-bbaf-5b0a34b807b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.870786 Sep 05 17:01:55.363286 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 38/77] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:01:54 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:01:55.544320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-16247672-9915-4dfd-819e-3838017d9aea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:55.547276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2066e61e-59b1-4d2f-af66-084e4e406a24 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:55.548618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2066e61e-59b1-4d2f-af66-084e4e406a24 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:55.558043 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-16247672-9915-4dfd-819e-3838017d9aea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.873239 Sep 05 17:01:55.559769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 40/78] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:54 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:55.583697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2066e61e-59b1-4d2f-af66-084e4e406a24 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:55.584249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2066e61e-59b1-4d2f-af66-084e4e406a24 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:55.585304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2066e61e-59b1-4d2f-af66-084e4e406a24 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:55.587674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2066e61e-59b1-4d2f-af66-084e4e406a24 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:55.588236 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2066e61e-59b1-4d2f-af66-084e4e406a24 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:55.588817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2066e61e-59b1-4d2f-af66-084e4e406a24 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:56.576804 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2066e61e-59b1-4d2f-af66-084e4e406a24 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:56.601435 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2066e61e-59b1-4d2f-af66-084e4e406a24 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 1.054382 Sep 05 17:01:56.604483 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 39/79] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:55 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:01:56.691711 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-ff2133ae-4bff-41d9-a8a9-a9db4296b645 req-350eee8f-caf9-4fd5-9b1c-c3b3301f2bbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97cc15c7-947d-4daf-80e8-8edc37c01e68", "tag": "4a115af6-123d-4baf-bd17-df6792943a2d"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:01:56.747628 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ff2133ae-4bff-41d9-a8a9-a9db4296b645 req-350eee8f-caf9-4fd5-9b1c-c3b3301f2bbe service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:56.749591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ff2133ae-4bff-41d9-a8a9-a9db4296b645 req-350eee8f-caf9-4fd5-9b1c-c3b3301f2bbe service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:56.753751 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ff2133ae-4bff-41d9-a8a9-a9db4296b645 req-350eee8f-caf9-4fd5-9b1c-c3b3301f2bbe service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:56.870437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-ff2133ae-4bff-41d9-a8a9-a9db4296b645 req-350eee8f-caf9-4fd5-9b1c-c3b3301f2bbe service nova] Creating event network-changed:4a115af6-123d-4baf-bd17-df6792943a2d for instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 on hv-cinder-85596 Sep 05 17:01:56.881578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ff2133ae-4bff-41d9-a8a9-a9db4296b645 req-350eee8f-caf9-4fd5-9b1c-c3b3301f2bbe service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 05 17:01:56.884512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ff2133ae-4bff-41d9-a8a9-a9db4296b645 req-350eee8f-caf9-4fd5-9b1c-c3b3301f2bbe service nova] Acquired lock "compute-rpcapi-router" {{(pid=120731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 05 17:01:56.888842 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6942e030-ba94-4899-b99f-b21d38497a10 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:56.893215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6942e030-ba94-4899-b99f-b21d38497a10 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:56.894780 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6942e030-ba94-4899-b99f-b21d38497a10 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:56.896446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6942e030-ba94-4899-b99f-b21d38497a10 None None] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:56.899281 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6942e030-ba94-4899-b99f-b21d38497a10 None None] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:56.900724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6942e030-ba94-4899-b99f-b21d38497a10 None None] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:56.906256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-07285111-260d-4e0c-b875-1f9cd0221fc6 req-d15408c3-e0aa-48c7-9cfb-bc16ee1ce509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfe215ba-4dff-48b0-a561-60ab7593b6d7", "tag": "5dfa4258-3985-4da8-9bdc-73fa86de300a"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:01:56.953590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.compute.rpcapi [None req-6942e030-ba94-4899-b99f-b21d38497a10 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 05 17:01:56.959531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6942e030-ba94-4899-b99f-b21d38497a10 None None] Releasing lock "compute-rpcapi-router" {{(pid=120731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 05 17:01:56.966476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-07285111-260d-4e0c-b875-1f9cd0221fc6 req-d15408c3-e0aa-48c7-9cfb-bc16ee1ce509 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:56.966870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-07285111-260d-4e0c-b875-1f9cd0221fc6 req-d15408c3-e0aa-48c7-9cfb-bc16ee1ce509 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:56.976505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-07285111-260d-4e0c-b875-1f9cd0221fc6 req-d15408c3-e0aa-48c7-9cfb-bc16ee1ce509 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:57.006564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6942e030-ba94-4899-b99f-b21d38497a10 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.771600 Sep 05 17:01:57.014777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 41/80] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:57.033569 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-32a4bbd5-6d69-46a9-a2f3-b454e1911cbe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:57.034874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-32a4bbd5-6d69-46a9-a2f3-b454e1911cbe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:57.035907 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-07285111-260d-4e0c-b875-1f9cd0221fc6 req-d15408c3-e0aa-48c7-9cfb-bc16ee1ce509 service nova] Creating event network-changed:5dfa4258-3985-4da8-9bdc-73fa86de300a for instance bfe215ba-4dff-48b0-a561-60ab7593b6d7 on hv-cinder-85596 Sep 05 17:01:57.038471 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-07285111-260d-4e0c-b875-1f9cd0221fc6 req-d15408c3-e0aa-48c7-9cfb-bc16ee1ce509 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120733) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 05 17:01:57.040598 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-07285111-260d-4e0c-b875-1f9cd0221fc6 req-d15408c3-e0aa-48c7-9cfb-bc16ee1ce509 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120733) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 05 17:01:57.042029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3338ce4-e859-4ff8-b7d3-deec8dca1acc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:57.057642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3338ce4-e859-4ff8-b7d3-deec8dca1acc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:57.057974 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a4bbd5-6d69-46a9-a2f3-b454e1911cbe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:57.058656 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3338ce4-e859-4ff8-b7d3-deec8dca1acc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:57.062358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a4bbd5-6d69-46a9-a2f3-b454e1911cbe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:57.063371 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3338ce4-e859-4ff8-b7d3-deec8dca1acc None None] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:57.064719 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a4bbd5-6d69-46a9-a2f3-b454e1911cbe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:57.065273 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3338ce4-e859-4ff8-b7d3-deec8dca1acc None None] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:57.065838 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3338ce4-e859-4ff8-b7d3-deec8dca1acc None None] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:57.072404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a4bbd5-6d69-46a9-a2f3-b454e1911cbe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:57.073298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a4bbd5-6d69-46a9-a2f3-b454e1911cbe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:57.075372 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a4bbd5-6d69-46a9-a2f3-b454e1911cbe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:57.127636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.compute.rpcapi [None req-f3338ce4-e859-4ff8-b7d3-deec8dca1acc None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 05 17:01:57.128657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3338ce4-e859-4ff8-b7d3-deec8dca1acc None None] Releasing lock "compute-rpcapi-router" {{(pid=120733) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 05 17:01:57.171894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f3338ce4-e859-4ff8-b7d3-deec8dca1acc None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.564444 Sep 05 17:01:57.172926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 40/81] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:01:57.188419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-36190279-bf2a-4448-9def-56ad55c722dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:57.192451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-36190279-bf2a-4448-9def-56ad55c722dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:57.215343 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36190279-bf2a-4448-9def-56ad55c722dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:57.221467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36190279-bf2a-4448-9def-56ad55c722dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:57.224023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36190279-bf2a-4448-9def-56ad55c722dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:57.225282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36190279-bf2a-4448-9def-56ad55c722dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:57.234083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36190279-bf2a-4448-9def-56ad55c722dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:57.234931 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36190279-bf2a-4448-9def-56ad55c722dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:58.151723 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-36190279-bf2a-4448-9def-56ad55c722dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:58.160804 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-36190279-bf2a-4448-9def-56ad55c722dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.986683 Sep 05 17:01:58.161398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 41/82] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:57 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:58.180966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5944316b-b479-40eb-aee9-8a16b154b5d2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:58.188321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5944316b-b479-40eb-aee9-8a16b154b5d2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:58.198144 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5944316b-b479-40eb-aee9-8a16b154b5d2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:58.198977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5944316b-b479-40eb-aee9-8a16b154b5d2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:58.199872 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5944316b-b479-40eb-aee9-8a16b154b5d2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:58.201800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5944316b-b479-40eb-aee9-8a16b154b5d2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:58.204064 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5944316b-b479-40eb-aee9-8a16b154b5d2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:58.204752 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5944316b-b479-40eb-aee9-8a16b154b5d2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:58.361931 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-32a4bbd5-6d69-46a9-a2f3-b454e1911cbe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:58.378794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-32a4bbd5-6d69-46a9-a2f3-b454e1911cbe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:58.387012 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-32a4bbd5-6d69-46a9-a2f3-b454e1911cbe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:58.390696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-32a4bbd5-6d69-46a9-a2f3-b454e1911cbe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 1.374349 Sep 05 17:01:58.393147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 42/83] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:01:57 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:01:58.819173 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5944316b-b479-40eb-aee9-8a16b154b5d2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:58.835458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5944316b-b479-40eb-aee9-8a16b154b5d2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.658330 Sep 05 17:01:58.838122 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 42/84] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:58 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:01:59.190117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1dc54b65-4cbf-4a9c-9e56-495e578ce4b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:59.191180 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1dc54b65-4cbf-4a9c-9e56-495e578ce4b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:59.200082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:01:59.204034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1dc54b65-4cbf-4a9c-9e56-495e578ce4b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:59.205104 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1dc54b65-4cbf-4a9c-9e56-495e578ce4b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:59.205867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1dc54b65-4cbf-4a9c-9e56-495e578ce4b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:59.207320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1dc54b65-4cbf-4a9c-9e56-495e578ce4b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:59.208709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1dc54b65-4cbf-4a9c-9e56-495e578ce4b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:59.209284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1dc54b65-4cbf-4a9c-9e56-495e578ce4b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:59.341532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-7f6c979a-5936-44a5-97d0-be95df7ea8b8 req-fb7aaf3c-1601-41a1-a0ab-bd6d06af0ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f618fb-422b-4e8b-b55d-634720b8646c", "tag": "fc6aadfe-bed1-4d6d-ae24-330d4a9efe98"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:01:59.379165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-7f6c979a-5936-44a5-97d0-be95df7ea8b8 req-fb7aaf3c-1601-41a1-a0ab-bd6d06af0ac1 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:59.379763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-7f6c979a-5936-44a5-97d0-be95df7ea8b8 req-fb7aaf3c-1601-41a1-a0ab-bd6d06af0ac1 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:59.380697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-7f6c979a-5936-44a5-97d0-be95df7ea8b8 req-fb7aaf3c-1601-41a1-a0ab-bd6d06af0ac1 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:59.402735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-7f6c979a-5936-44a5-97d0-be95df7ea8b8 req-fb7aaf3c-1601-41a1-a0ab-bd6d06af0ac1 service nova] Creating event network-changed:fc6aadfe-bed1-4d6d-ae24-330d4a9efe98 for instance a7f618fb-422b-4e8b-b55d-634720b8646c on hv-cinder-85596 Sep 05 17:01:59.424337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-7f6c979a-5936-44a5-97d0-be95df7ea8b8 req-fb7aaf3c-1601-41a1-a0ab-bd6d06af0ac1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087701 Sep 05 17:01:59.436579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 43/85] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:01:59.444994 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2ae69c06-7f2c-41da-afaa-9856ab1c3b8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:01:59.445819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2ae69c06-7f2c-41da-afaa-9856ab1c3b8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:01:59.458986 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ae69c06-7f2c-41da-afaa-9856ab1c3b8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:59.459617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ae69c06-7f2c-41da-afaa-9856ab1c3b8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:59.467736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ae69c06-7f2c-41da-afaa-9856ab1c3b8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:59.469204 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ae69c06-7f2c-41da-afaa-9856ab1c3b8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:01:59.469816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ae69c06-7f2c-41da-afaa-9856ab1c3b8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:01:59.470436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ae69c06-7f2c-41da-afaa-9856ab1c3b8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:01:59.954759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1dc54b65-4cbf-4a9c-9e56-495e578ce4b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:01:59.973431 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1dc54b65-4cbf-4a9c-9e56-495e578ce4b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.787985 Sep 05 17:01:59.986352 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 43/86] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:01:59 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:00.014605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-c9748f8e-5563-4a0c-b035-c9c366eb9836 req-38211bcc-c12c-4994-9ebc-3a7129bf2295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb25ed7-1069-41a4-b3d3-25231e7322e7", "tag": "69dc6b0f-11b6-4dd3-860d-3b29a41d0e34"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:02:00.059010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-c9748f8e-5563-4a0c-b035-c9c366eb9836 req-38211bcc-c12c-4994-9ebc-3a7129bf2295 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:00.060007 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-c9748f8e-5563-4a0c-b035-c9c366eb9836 req-38211bcc-c12c-4994-9ebc-3a7129bf2295 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:00.060794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-c9748f8e-5563-4a0c-b035-c9c366eb9836 req-38211bcc-c12c-4994-9ebc-3a7129bf2295 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:00.098314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-c9748f8e-5563-4a0c-b035-c9c366eb9836 req-38211bcc-c12c-4994-9ebc-3a7129bf2295 service nova] Creating event network-changed:69dc6b0f-11b6-4dd3-860d-3b29a41d0e34 for instance 2fb25ed7-1069-41a4-b3d3-25231e7322e7 on hv-cinder-85596 Sep 05 17:02:00.111782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-c9748f8e-5563-4a0c-b035-c9c366eb9836 req-38211bcc-c12c-4994-9ebc-3a7129bf2295 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118989 Sep 05 17:02:00.124099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 44/87] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:02:00.131276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2ae69c06-7f2c-41da-afaa-9856ab1c3b8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:00.149839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6003022a-0084-4539-9240-539d6e0ea89c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:00.150564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6003022a-0084-4539-9240-539d6e0ea89c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:00.158865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2ae69c06-7f2c-41da-afaa-9856ab1c3b8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:00.161608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2ae69c06-7f2c-41da-afaa-9856ab1c3b8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:00.163031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2ae69c06-7f2c-41da-afaa-9856ab1c3b8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.724958 Sep 05 17:02:00.164054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 44/88] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:01:59 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:00.195034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6003022a-0084-4539-9240-539d6e0ea89c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:00.195534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6003022a-0084-4539-9240-539d6e0ea89c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:00.196032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6003022a-0084-4539-9240-539d6e0ea89c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:00.206573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6003022a-0084-4539-9240-539d6e0ea89c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:00.207070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6003022a-0084-4539-9240-539d6e0ea89c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:00.207507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6003022a-0084-4539-9240-539d6e0ea89c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:01.002511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cd0ce756-c9ce-4301-bf2d-61457e620fab tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:01.004335 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cd0ce756-c9ce-4301-bf2d-61457e620fab tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:01.029521 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd0ce756-c9ce-4301-bf2d-61457e620fab tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:01.030416 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd0ce756-c9ce-4301-bf2d-61457e620fab tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:01.031066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd0ce756-c9ce-4301-bf2d-61457e620fab tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:01.031977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd0ce756-c9ce-4301-bf2d-61457e620fab tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:01.032942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd0ce756-c9ce-4301-bf2d-61457e620fab tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:01.033676 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd0ce756-c9ce-4301-bf2d-61457e620fab tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:01.236747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6003022a-0084-4539-9240-539d6e0ea89c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:01.250725 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6003022a-0084-4539-9240-539d6e0ea89c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 1.121673 Sep 05 17:02:01.251754 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 45/89] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:00 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:01.280828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fa7fe301-daee-4667-85c9-907e019d3adb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:01.284430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fa7fe301-daee-4667-85c9-907e019d3adb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:01.297402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa7fe301-daee-4667-85c9-907e019d3adb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:01.298211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa7fe301-daee-4667-85c9-907e019d3adb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:01.298938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa7fe301-daee-4667-85c9-907e019d3adb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:01.301131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa7fe301-daee-4667-85c9-907e019d3adb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:01.303038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa7fe301-daee-4667-85c9-907e019d3adb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:01.303620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa7fe301-daee-4667-85c9-907e019d3adb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:01.676178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cd0ce756-c9ce-4301-bf2d-61457e620fab tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:01.691737 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cd0ce756-c9ce-4301-bf2d-61457e620fab tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.693996 Sep 05 17:02:01.692848 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 45/90] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:00 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:02:01.774909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fa7fe301-daee-4667-85c9-907e019d3adb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:01.779534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:02:01.786962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fa7fe301-daee-4667-85c9-907e019d3adb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:01.791361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fa7fe301-daee-4667-85c9-907e019d3adb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:01.794160 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fa7fe301-daee-4667-85c9-907e019d3adb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.532540 Sep 05 17:02:01.797172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 46/91] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:01 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:02.275505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d7075218-4de4-4417-83b1-e081f286f456 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:02.276191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d7075218-4de4-4417-83b1-e081f286f456 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:02.283783 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d7075218-4de4-4417-83b1-e081f286f456 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:02.288361 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d7075218-4de4-4417-83b1-e081f286f456 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:02.288928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d7075218-4de4-4417-83b1-e081f286f456 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:02.289766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d7075218-4de4-4417-83b1-e081f286f456 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:02.290870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d7075218-4de4-4417-83b1-e081f286f456 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:02.292469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d7075218-4de4-4417-83b1-e081f286f456 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:02.460288 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d7075218-4de4-4417-83b1-e081f286f456 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:02.470684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d7075218-4de4-4417-83b1-e081f286f456 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.199041 Sep 05 17:02:02.472217 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 46/92] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:02 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:02.721047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ab4b14ab-ca0d-4abe-a54d-e4677a1aef77 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:02.722338 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ab4b14ab-ca0d-4abe-a54d-e4677a1aef77 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:02.729226 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab4b14ab-ca0d-4abe-a54d-e4677a1aef77 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:02.729998 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab4b14ab-ca0d-4abe-a54d-e4677a1aef77 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:02.730607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab4b14ab-ca0d-4abe-a54d-e4677a1aef77 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:02.731302 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab4b14ab-ca0d-4abe-a54d-e4677a1aef77 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:02.731783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab4b14ab-ca0d-4abe-a54d-e4677a1aef77 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:02.732201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab4b14ab-ca0d-4abe-a54d-e4677a1aef77 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:02.823764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-229ec71e-3232-4365-aa75-92e7a4815dcf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:02.824509 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-229ec71e-3232-4365-aa75-92e7a4815dcf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:02.831515 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:02:02.833233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-229ec71e-3232-4365-aa75-92e7a4815dcf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:02.836327 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-229ec71e-3232-4365-aa75-92e7a4815dcf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:02.838204 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-229ec71e-3232-4365-aa75-92e7a4815dcf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:02.839620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-229ec71e-3232-4365-aa75-92e7a4815dcf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:02.840645 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-229ec71e-3232-4365-aa75-92e7a4815dcf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:02.841075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-229ec71e-3232-4365-aa75-92e7a4815dcf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:02.943777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ab4b14ab-ca0d-4abe-a54d-e4677a1aef77 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:02.957636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ab4b14ab-ca0d-4abe-a54d-e4677a1aef77 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.239029 Sep 05 17:02:02.958251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 47/93] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:02 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:02:03.033081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-229ec71e-3232-4365-aa75-92e7a4815dcf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:03.043048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-229ec71e-3232-4365-aa75-92e7a4815dcf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:03.044549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-229ec71e-3232-4365-aa75-92e7a4815dcf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:03.046095 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-229ec71e-3232-4365-aa75-92e7a4815dcf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.226933 Sep 05 17:02:03.060972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 47/94] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:02 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 17:02:03.498817 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4ff07271-2846-4fcc-bbac-24a194547a41 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:03.499715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4ff07271-2846-4fcc-bbac-24a194547a41 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:03.518676 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ff07271-2846-4fcc-bbac-24a194547a41 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:03.520604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ff07271-2846-4fcc-bbac-24a194547a41 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:03.522504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ff07271-2846-4fcc-bbac-24a194547a41 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:03.525423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ff07271-2846-4fcc-bbac-24a194547a41 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:03.526738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ff07271-2846-4fcc-bbac-24a194547a41 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:03.529073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ff07271-2846-4fcc-bbac-24a194547a41 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:03.981349 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-30bbde8e-6318-4d70-899e-cf04e351f433 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:03.982863 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-30bbde8e-6318-4d70-899e-cf04e351f433 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:03.991897 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-30bbde8e-6318-4d70-899e-cf04e351f433 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:03.992443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-30bbde8e-6318-4d70-899e-cf04e351f433 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:03.992900 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-30bbde8e-6318-4d70-899e-cf04e351f433 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:03.993642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-30bbde8e-6318-4d70-899e-cf04e351f433 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:03.994092 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-30bbde8e-6318-4d70-899e-cf04e351f433 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:03.999693 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-30bbde8e-6318-4d70-899e-cf04e351f433 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:04.300675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4ff07271-2846-4fcc-bbac-24a194547a41 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:04.309426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4ff07271-2846-4fcc-bbac-24a194547a41 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.816401 Sep 05 17:02:04.310399 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 48/95] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:03 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:04.330676 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dd5401ec-19ca-4ecb-8381-5350aba41e23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:04.331656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dd5401ec-19ca-4ecb-8381-5350aba41e23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:04.337944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd5401ec-19ca-4ecb-8381-5350aba41e23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:04.338420 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd5401ec-19ca-4ecb-8381-5350aba41e23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:04.338842 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd5401ec-19ca-4ecb-8381-5350aba41e23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:04.339763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd5401ec-19ca-4ecb-8381-5350aba41e23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:04.340244 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd5401ec-19ca-4ecb-8381-5350aba41e23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:04.340662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd5401ec-19ca-4ecb-8381-5350aba41e23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:04.364726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-30bbde8e-6318-4d70-899e-cf04e351f433 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:04.389493 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-30bbde8e-6318-4d70-899e-cf04e351f433 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.412751 Sep 05 17:02:04.390656 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 48/96] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:03 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:04.645876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dd5401ec-19ca-4ecb-8381-5350aba41e23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:04.676985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dd5401ec-19ca-4ecb-8381-5350aba41e23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:04.681573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dd5401ec-19ca-4ecb-8381-5350aba41e23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:04.684811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dd5401ec-19ca-4ecb-8381-5350aba41e23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.362191 Sep 05 17:02:04.687652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 49/97] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:04 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:05.338205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e6176641-38e0-461b-81fb-ef02de243e85 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:05.338966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e6176641-38e0-461b-81fb-ef02de243e85 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:05.351135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6176641-38e0-461b-81fb-ef02de243e85 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:05.351866 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6176641-38e0-461b-81fb-ef02de243e85 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:05.353359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6176641-38e0-461b-81fb-ef02de243e85 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:05.356757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6176641-38e0-461b-81fb-ef02de243e85 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:05.357937 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6176641-38e0-461b-81fb-ef02de243e85 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:05.359550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6176641-38e0-461b-81fb-ef02de243e85 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:05.412266 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e1c44a91-db89-40e8-9721-70d971e007b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:05.413055 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e1c44a91-db89-40e8-9721-70d971e007b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:05.419119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c44a91-db89-40e8-9721-70d971e007b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:05.419642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c44a91-db89-40e8-9721-70d971e007b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:05.420057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c44a91-db89-40e8-9721-70d971e007b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:05.420869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c44a91-db89-40e8-9721-70d971e007b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:05.421318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c44a91-db89-40e8-9721-70d971e007b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:05.421839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c44a91-db89-40e8-9721-70d971e007b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:05.960666 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e6176641-38e0-461b-81fb-ef02de243e85 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:05.971613 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e6176641-38e0-461b-81fb-ef02de243e85 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.636890 Sep 05 17:02:05.973877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 49/98] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:05 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:05.987057 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b025ae7f-5bd1-43d8-b107-749886e8a15f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:05.987737 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b025ae7f-5bd1-43d8-b107-749886e8a15f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:05.993944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e1c44a91-db89-40e8-9721-70d971e007b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:06.003471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e1c44a91-db89-40e8-9721-70d971e007b3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.594965 Sep 05 17:02:06.005819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b025ae7f-5bd1-43d8-b107-749886e8a15f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:06.007081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 50/99] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:05 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:02:06.007698 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b025ae7f-5bd1-43d8-b107-749886e8a15f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:06.009143 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b025ae7f-5bd1-43d8-b107-749886e8a15f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:06.010591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b025ae7f-5bd1-43d8-b107-749886e8a15f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:06.012969 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b025ae7f-5bd1-43d8-b107-749886e8a15f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:06.016086 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b025ae7f-5bd1-43d8-b107-749886e8a15f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:06.348579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b025ae7f-5bd1-43d8-b107-749886e8a15f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:06.361872 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b025ae7f-5bd1-43d8-b107-749886e8a15f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:06.363547 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b025ae7f-5bd1-43d8-b107-749886e8a15f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:06.366387 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b025ae7f-5bd1-43d8-b107-749886e8a15f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.391525 Sep 05 17:02:06.371087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 50/100] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:05 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:06.996797 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:02:07.001083 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5a74c3b6-1540-4fc7-a2db-b15405df5957 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:07.001760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5a74c3b6-1540-4fc7-a2db-b15405df5957 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:07.009027 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a74c3b6-1540-4fc7-a2db-b15405df5957 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:07.009943 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a74c3b6-1540-4fc7-a2db-b15405df5957 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:07.010679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a74c3b6-1540-4fc7-a2db-b15405df5957 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:07.011827 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a74c3b6-1540-4fc7-a2db-b15405df5957 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:07.012495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a74c3b6-1540-4fc7-a2db-b15405df5957 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:07.013084 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a74c3b6-1540-4fc7-a2db-b15405df5957 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:07.039157 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a0a5c8bc-d889-4a5a-9d5e-2462effb37c9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:07.040054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a0a5c8bc-d889-4a5a-9d5e-2462effb37c9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:07.047663 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0a5c8bc-d889-4a5a-9d5e-2462effb37c9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:07.048136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0a5c8bc-d889-4a5a-9d5e-2462effb37c9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:07.048588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0a5c8bc-d889-4a5a-9d5e-2462effb37c9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:07.049283 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0a5c8bc-d889-4a5a-9d5e-2462effb37c9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:07.049725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0a5c8bc-d889-4a5a-9d5e-2462effb37c9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:07.050138 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0a5c8bc-d889-4a5a-9d5e-2462effb37c9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:07.105586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=2 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:02:07.261014 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5a74c3b6-1540-4fc7-a2db-b15405df5957 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:07.270506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5a74c3b6-1540-4fc7-a2db-b15405df5957 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.274722 Sep 05 17:02:07.271647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 51/101] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:06 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:07.343697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a0a5c8bc-d889-4a5a-9d5e-2462effb37c9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:07.353722 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a0a5c8bc-d889-4a5a-9d5e-2462effb37c9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.318542 Sep 05 17:02:07.354658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 51/102] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:07 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:07.401319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d91d56a5-8ab9-4403-a401-d81086c5f501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:07.401930 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d91d56a5-8ab9-4403-a401-d81086c5f501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:07.417958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d91d56a5-8ab9-4403-a401-d81086c5f501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:07.418456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d91d56a5-8ab9-4403-a401-d81086c5f501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:07.418884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d91d56a5-8ab9-4403-a401-d81086c5f501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:07.419589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d91d56a5-8ab9-4403-a401-d81086c5f501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:07.420037 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d91d56a5-8ab9-4403-a401-d81086c5f501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:07.420509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d91d56a5-8ab9-4403-a401-d81086c5f501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:07.652894 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d91d56a5-8ab9-4403-a401-d81086c5f501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:07.670206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d91d56a5-8ab9-4403-a401-d81086c5f501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:07.673490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d91d56a5-8ab9-4403-a401-d81086c5f501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:07.675971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d91d56a5-8ab9-4403-a401-d81086c5f501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.278882 Sep 05 17:02:07.695843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 52/103] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:07 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:08.296331 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0f62286a-46a4-4789-ac46-5680d2c64e19 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:08.297282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0f62286a-46a4-4789-ac46-5680d2c64e19 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:08.303644 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f62286a-46a4-4789-ac46-5680d2c64e19 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:08.304132 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f62286a-46a4-4789-ac46-5680d2c64e19 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:08.304585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f62286a-46a4-4789-ac46-5680d2c64e19 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:08.305902 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f62286a-46a4-4789-ac46-5680d2c64e19 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:08.306619 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f62286a-46a4-4789-ac46-5680d2c64e19 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:08.307183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f62286a-46a4-4789-ac46-5680d2c64e19 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:08.377800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4046ea3c-e5af-4e2c-99bd-cc07b022cb94 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:08.378399 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4046ea3c-e5af-4e2c-99bd-cc07b022cb94 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:08.389801 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4046ea3c-e5af-4e2c-99bd-cc07b022cb94 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:08.390495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4046ea3c-e5af-4e2c-99bd-cc07b022cb94 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:08.391214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4046ea3c-e5af-4e2c-99bd-cc07b022cb94 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:08.392329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4046ea3c-e5af-4e2c-99bd-cc07b022cb94 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:08.393671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4046ea3c-e5af-4e2c-99bd-cc07b022cb94 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:08.394403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4046ea3c-e5af-4e2c-99bd-cc07b022cb94 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:08.482025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0f62286a-46a4-4789-ac46-5680d2c64e19 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:08.495411 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0f62286a-46a4-4789-ac46-5680d2c64e19 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.201289 Sep 05 17:02:08.495879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 52/104] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:08 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:08.571123 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4046ea3c-e5af-4e2c-99bd-cc07b022cb94 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:08.580878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4046ea3c-e5af-4e2c-99bd-cc07b022cb94 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.206894 Sep 05 17:02:08.581822 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 53/105] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:08 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:08.703233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b10eb784-08b4-41a4-8cef-1fe6fa04df4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:08.703844 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b10eb784-08b4-41a4-8cef-1fe6fa04df4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:08.710315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b10eb784-08b4-41a4-8cef-1fe6fa04df4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:08.710811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b10eb784-08b4-41a4-8cef-1fe6fa04df4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:08.711293 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b10eb784-08b4-41a4-8cef-1fe6fa04df4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:08.711995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b10eb784-08b4-41a4-8cef-1fe6fa04df4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:08.712479 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b10eb784-08b4-41a4-8cef-1fe6fa04df4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:08.712932 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b10eb784-08b4-41a4-8cef-1fe6fa04df4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:08.892339 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b10eb784-08b4-41a4-8cef-1fe6fa04df4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:08.901799 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b10eb784-08b4-41a4-8cef-1fe6fa04df4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:08.903274 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b10eb784-08b4-41a4-8cef-1fe6fa04df4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:08.904944 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b10eb784-08b4-41a4-8cef-1fe6fa04df4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.205710 Sep 05 17:02:08.905963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 53/106] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:08 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:09.517462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f351040f-8493-4dcc-9fa3-2870a8057073 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:09.521041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f351040f-8493-4dcc-9fa3-2870a8057073 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:09.530544 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f351040f-8493-4dcc-9fa3-2870a8057073 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:09.531468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f351040f-8493-4dcc-9fa3-2870a8057073 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:09.532278 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f351040f-8493-4dcc-9fa3-2870a8057073 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:09.533190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f351040f-8493-4dcc-9fa3-2870a8057073 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:09.534206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f351040f-8493-4dcc-9fa3-2870a8057073 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:09.534839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f351040f-8493-4dcc-9fa3-2870a8057073 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:09.605261 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-23767a9b-dc48-4292-9cf5-9f3969c2bf40 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:09.605882 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-23767a9b-dc48-4292-9cf5-9f3969c2bf40 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:09.615422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23767a9b-dc48-4292-9cf5-9f3969c2bf40 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:09.615921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23767a9b-dc48-4292-9cf5-9f3969c2bf40 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:09.619166 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23767a9b-dc48-4292-9cf5-9f3969c2bf40 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:09.619999 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23767a9b-dc48-4292-9cf5-9f3969c2bf40 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:09.620507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23767a9b-dc48-4292-9cf5-9f3969c2bf40 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:09.620938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23767a9b-dc48-4292-9cf5-9f3969c2bf40 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:09.743595 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f351040f-8493-4dcc-9fa3-2870a8057073 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:09.751612 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f351040f-8493-4dcc-9fa3-2870a8057073 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.238419 Sep 05 17:02:09.752398 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 54/107] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:09 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:09.808541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-23767a9b-dc48-4292-9cf5-9f3969c2bf40 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:09.820482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-23767a9b-dc48-4292-9cf5-9f3969c2bf40 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.219999 Sep 05 17:02:09.821993 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 54/108] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:09 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:02:09.930314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e2f5f7aa-30d5-48ff-a9cb-e62b5c438ac4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:09.931056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e2f5f7aa-30d5-48ff-a9cb-e62b5c438ac4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:09.937616 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2f5f7aa-30d5-48ff-a9cb-e62b5c438ac4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:09.938185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2f5f7aa-30d5-48ff-a9cb-e62b5c438ac4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:09.938611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2f5f7aa-30d5-48ff-a9cb-e62b5c438ac4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:09.939299 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2f5f7aa-30d5-48ff-a9cb-e62b5c438ac4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:09.939739 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2f5f7aa-30d5-48ff-a9cb-e62b5c438ac4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:09.940170 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2f5f7aa-30d5-48ff-a9cb-e62b5c438ac4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:10.085196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e2f5f7aa-30d5-48ff-a9cb-e62b5c438ac4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:10.093862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e2f5f7aa-30d5-48ff-a9cb-e62b5c438ac4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:10.100456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e2f5f7aa-30d5-48ff-a9cb-e62b5c438ac4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:10.100456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e2f5f7aa-30d5-48ff-a9cb-e62b5c438ac4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.171439 Sep 05 17:02:10.100456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 55/109] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:09 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:10.776474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f5202b38-8611-4085-9b33-8257a9fa56ee tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:10.778146 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f5202b38-8611-4085-9b33-8257a9fa56ee tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:10.785294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5202b38-8611-4085-9b33-8257a9fa56ee tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:10.786273 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5202b38-8611-4085-9b33-8257a9fa56ee tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:10.787142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5202b38-8611-4085-9b33-8257a9fa56ee tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:10.788099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5202b38-8611-4085-9b33-8257a9fa56ee tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:10.789299 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5202b38-8611-4085-9b33-8257a9fa56ee tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:10.790620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5202b38-8611-4085-9b33-8257a9fa56ee tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:10.832492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:02:10.845621 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3d0e2cab-9334-482d-9b19-a60e6fb80fbf tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:10.847043 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3d0e2cab-9334-482d-9b19-a60e6fb80fbf tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:10.855697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d0e2cab-9334-482d-9b19-a60e6fb80fbf tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:10.856570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d0e2cab-9334-482d-9b19-a60e6fb80fbf tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:10.857194 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d0e2cab-9334-482d-9b19-a60e6fb80fbf tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:10.858185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d0e2cab-9334-482d-9b19-a60e6fb80fbf tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:10.858968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d0e2cab-9334-482d-9b19-a60e6fb80fbf tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:10.859702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d0e2cab-9334-482d-9b19-a60e6fb80fbf tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:11.072698 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f5202b38-8611-4085-9b33-8257a9fa56ee tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:11.083311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f5202b38-8611-4085-9b33-8257a9fa56ee tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.312218 Sep 05 17:02:11.087243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 55/110] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:10 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:11.127829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5fe46fe1-69b3-4ff5-806f-6cc47c68ea70 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:11.128549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5fe46fe1-69b3-4ff5-806f-6cc47c68ea70 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:11.139504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fe46fe1-69b3-4ff5-806f-6cc47c68ea70 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:11.141276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fe46fe1-69b3-4ff5-806f-6cc47c68ea70 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:11.141708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fe46fe1-69b3-4ff5-806f-6cc47c68ea70 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:11.142422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fe46fe1-69b3-4ff5-806f-6cc47c68ea70 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:11.143071 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fe46fe1-69b3-4ff5-806f-6cc47c68ea70 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:11.143843 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fe46fe1-69b3-4ff5-806f-6cc47c68ea70 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:11.179795 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3d0e2cab-9334-482d-9b19-a60e6fb80fbf tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:11.193012 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3d0e2cab-9334-482d-9b19-a60e6fb80fbf tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.351563 Sep 05 17:02:11.195707 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 56/111] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:10 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:11.327369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5fe46fe1-69b3-4ff5-806f-6cc47c68ea70 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:11.337663 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5fe46fe1-69b3-4ff5-806f-6cc47c68ea70 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:11.339347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5fe46fe1-69b3-4ff5-806f-6cc47c68ea70 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:11.340756 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5fe46fe1-69b3-4ff5-806f-6cc47c68ea70 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.220587 Sep 05 17:02:11.344396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 56/112] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:11 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:12.112655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ea272fbd-0478-4e5d-aa24-e1def2ddf77c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:12.113124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ea272fbd-0478-4e5d-aa24-e1def2ddf77c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:12.119407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea272fbd-0478-4e5d-aa24-e1def2ddf77c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:12.120099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea272fbd-0478-4e5d-aa24-e1def2ddf77c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:12.120715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea272fbd-0478-4e5d-aa24-e1def2ddf77c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:12.121568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea272fbd-0478-4e5d-aa24-e1def2ddf77c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:12.122012 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea272fbd-0478-4e5d-aa24-e1def2ddf77c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:12.122715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea272fbd-0478-4e5d-aa24-e1def2ddf77c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:12.215783 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-07f3f378-da50-4b70-acbf-662184a4ddc3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:12.216845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-07f3f378-da50-4b70-acbf-662184a4ddc3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:12.222812 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-07f3f378-da50-4b70-acbf-662184a4ddc3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:12.223293 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-07f3f378-da50-4b70-acbf-662184a4ddc3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:12.223883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-07f3f378-da50-4b70-acbf-662184a4ddc3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:12.224764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-07f3f378-da50-4b70-acbf-662184a4ddc3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:12.225993 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-07f3f378-da50-4b70-acbf-662184a4ddc3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:12.227011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-07f3f378-da50-4b70-acbf-662184a4ddc3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:12.265889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ea272fbd-0478-4e5d-aa24-e1def2ddf77c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:12.277195 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ea272fbd-0478-4e5d-aa24-e1def2ddf77c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.168744 Sep 05 17:02:12.277784 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 57/113] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:12 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:12.367427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f01a9f4f-32e4-41df-9521-53495c2f5154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:12.369505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f01a9f4f-32e4-41df-9521-53495c2f5154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:12.376602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f01a9f4f-32e4-41df-9521-53495c2f5154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:12.377340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f01a9f4f-32e4-41df-9521-53495c2f5154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:12.377979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f01a9f4f-32e4-41df-9521-53495c2f5154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:12.379075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f01a9f4f-32e4-41df-9521-53495c2f5154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:12.379738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f01a9f4f-32e4-41df-9521-53495c2f5154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:12.380392 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f01a9f4f-32e4-41df-9521-53495c2f5154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:12.396586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-07f3f378-da50-4b70-acbf-662184a4ddc3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:12.405282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-07f3f378-da50-4b70-acbf-662184a4ddc3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.193594 Sep 05 17:02:12.405870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 57/114] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:12 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:12.775298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f01a9f4f-32e4-41df-9521-53495c2f5154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:12.783729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f01a9f4f-32e4-41df-9521-53495c2f5154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:12.785516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f01a9f4f-32e4-41df-9521-53495c2f5154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:12.786905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f01a9f4f-32e4-41df-9521-53495c2f5154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.423635 Sep 05 17:02:12.787616 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 58/115] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:12 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 17:02:13.301002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b4652252-2029-4b86-8491-4a378383e27e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:13.301748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b4652252-2029-4b86-8491-4a378383e27e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:13.309970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b4652252-2029-4b86-8491-4a378383e27e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:13.310457 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b4652252-2029-4b86-8491-4a378383e27e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:13.310883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b4652252-2029-4b86-8491-4a378383e27e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:13.311569 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b4652252-2029-4b86-8491-4a378383e27e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:13.312020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b4652252-2029-4b86-8491-4a378383e27e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:13.312454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b4652252-2029-4b86-8491-4a378383e27e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:13.428640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-06a3a2d4-54f8-4527-a4cd-23520ef6386a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:13.430157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-06a3a2d4-54f8-4527-a4cd-23520ef6386a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:13.437207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06a3a2d4-54f8-4527-a4cd-23520ef6386a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:13.437852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06a3a2d4-54f8-4527-a4cd-23520ef6386a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:13.438451 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06a3a2d4-54f8-4527-a4cd-23520ef6386a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:13.440067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06a3a2d4-54f8-4527-a4cd-23520ef6386a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:13.440684 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06a3a2d4-54f8-4527-a4cd-23520ef6386a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:13.441412 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06a3a2d4-54f8-4527-a4cd-23520ef6386a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:13.467478 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b4652252-2029-4b86-8491-4a378383e27e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:13.476792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b4652252-2029-4b86-8491-4a378383e27e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.180081 Sep 05 17:02:13.478204 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 58/116] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:13 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:13.635498 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-06a3a2d4-54f8-4527-a4cd-23520ef6386a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:13.643622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-06a3a2d4-54f8-4527-a4cd-23520ef6386a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.219803 Sep 05 17:02:13.644215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 59/117] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:13 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:13.812179 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-50e7e3a2-90d4-491a-a628-bd8492e9cf3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:13.812865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-50e7e3a2-90d4-491a-a628-bd8492e9cf3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:13.819179 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50e7e3a2-90d4-491a-a628-bd8492e9cf3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:13.819660 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50e7e3a2-90d4-491a-a628-bd8492e9cf3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:13.820085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50e7e3a2-90d4-491a-a628-bd8492e9cf3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:13.820887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50e7e3a2-90d4-491a-a628-bd8492e9cf3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:13.821336 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50e7e3a2-90d4-491a-a628-bd8492e9cf3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:13.821756 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50e7e3a2-90d4-491a-a628-bd8492e9cf3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:13.955214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-50e7e3a2-90d4-491a-a628-bd8492e9cf3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:13.964183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-50e7e3a2-90d4-491a-a628-bd8492e9cf3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:13.965727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-50e7e3a2-90d4-491a-a628-bd8492e9cf3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:13.966938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-50e7e3a2-90d4-491a-a628-bd8492e9cf3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.158843 Sep 05 17:02:13.971247 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 59/118] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:13 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:14.505832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8baf28c1-9b52-484f-9024-f0251c300dde tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:14.506666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8baf28c1-9b52-484f-9024-f0251c300dde tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:14.513681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8baf28c1-9b52-484f-9024-f0251c300dde tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:14.514165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8baf28c1-9b52-484f-9024-f0251c300dde tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:14.514590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8baf28c1-9b52-484f-9024-f0251c300dde tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:14.515274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8baf28c1-9b52-484f-9024-f0251c300dde tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:14.515723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8baf28c1-9b52-484f-9024-f0251c300dde tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:14.516114 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8baf28c1-9b52-484f-9024-f0251c300dde tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:14.653909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8baf28c1-9b52-484f-9024-f0251c300dde tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:14.661583 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8baf28c1-9b52-484f-9024-f0251c300dde tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.161489 Sep 05 17:02:14.662156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 60/119] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:14 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:14.666554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-63b6107c-e2e1-4e81-8d38-f83777e0c46f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:14.667231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-63b6107c-e2e1-4e81-8d38-f83777e0c46f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:14.673271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63b6107c-e2e1-4e81-8d38-f83777e0c46f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:14.673828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63b6107c-e2e1-4e81-8d38-f83777e0c46f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:14.674320 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63b6107c-e2e1-4e81-8d38-f83777e0c46f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:14.675069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63b6107c-e2e1-4e81-8d38-f83777e0c46f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:14.675585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63b6107c-e2e1-4e81-8d38-f83777e0c46f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:14.676083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63b6107c-e2e1-4e81-8d38-f83777e0c46f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:14.808418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-63b6107c-e2e1-4e81-8d38-f83777e0c46f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:14.816551 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-63b6107c-e2e1-4e81-8d38-f83777e0c46f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.154109 Sep 05 17:02:14.817129 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 60/120] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:14 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:02:14.996164 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c72e2314-cf48-4ca0-811a-c1da15aaa704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:14.996921 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c72e2314-cf48-4ca0-811a-c1da15aaa704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:15.003427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c72e2314-cf48-4ca0-811a-c1da15aaa704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:15.003929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c72e2314-cf48-4ca0-811a-c1da15aaa704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:15.004403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c72e2314-cf48-4ca0-811a-c1da15aaa704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:15.005075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c72e2314-cf48-4ca0-811a-c1da15aaa704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:15.005524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c72e2314-cf48-4ca0-811a-c1da15aaa704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:15.005937 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c72e2314-cf48-4ca0-811a-c1da15aaa704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:15.151052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c72e2314-cf48-4ca0-811a-c1da15aaa704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:15.159534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c72e2314-cf48-4ca0-811a-c1da15aaa704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:15.161032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c72e2314-cf48-4ca0-811a-c1da15aaa704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:15.162142 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c72e2314-cf48-4ca0-811a-c1da15aaa704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.170694 Sep 05 17:02:15.162675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 61/121] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:14 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:15.685811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-099f1d74-cabf-4183-9c1e-6d65df9813ac tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:15.686426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-099f1d74-cabf-4183-9c1e-6d65df9813ac tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:15.692857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-099f1d74-cabf-4183-9c1e-6d65df9813ac tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:15.693507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-099f1d74-cabf-4183-9c1e-6d65df9813ac tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:15.693930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-099f1d74-cabf-4183-9c1e-6d65df9813ac tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:15.694631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-099f1d74-cabf-4183-9c1e-6d65df9813ac tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:15.695071 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-099f1d74-cabf-4183-9c1e-6d65df9813ac tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:15.695478 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-099f1d74-cabf-4183-9c1e-6d65df9813ac tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:15.829757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-099f1d74-cabf-4183-9c1e-6d65df9813ac tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:15.837484 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-099f1d74-cabf-4183-9c1e-6d65df9813ac tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.156987 Sep 05 17:02:15.838277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 61/122] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:15 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:15.839790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4082fd40-e846-4302-af84-46c37bcb0f3f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:15.840427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4082fd40-e846-4302-af84-46c37bcb0f3f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:15.846780 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4082fd40-e846-4302-af84-46c37bcb0f3f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:15.847262 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4082fd40-e846-4302-af84-46c37bcb0f3f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:15.847690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4082fd40-e846-4302-af84-46c37bcb0f3f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:15.848426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4082fd40-e846-4302-af84-46c37bcb0f3f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:15.848874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4082fd40-e846-4302-af84-46c37bcb0f3f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:15.849290 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4082fd40-e846-4302-af84-46c37bcb0f3f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:15.980564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4082fd40-e846-4302-af84-46c37bcb0f3f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:15.989093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4082fd40-e846-4302-af84-46c37bcb0f3f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.153965 Sep 05 17:02:15.989669 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 62/123] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:15 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:16.186287 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-72f7c7ac-d18e-4d50-8710-dd313e5a4832 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:16.186817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-72f7c7ac-d18e-4d50-8710-dd313e5a4832 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:16.193227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72f7c7ac-d18e-4d50-8710-dd313e5a4832 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:16.193702 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72f7c7ac-d18e-4d50-8710-dd313e5a4832 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:16.194121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72f7c7ac-d18e-4d50-8710-dd313e5a4832 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:16.194792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72f7c7ac-d18e-4d50-8710-dd313e5a4832 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:16.195230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72f7c7ac-d18e-4d50-8710-dd313e5a4832 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:16.195667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72f7c7ac-d18e-4d50-8710-dd313e5a4832 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:16.335995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-72f7c7ac-d18e-4d50-8710-dd313e5a4832 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:16.345335 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-72f7c7ac-d18e-4d50-8710-dd313e5a4832 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:16.347078 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-72f7c7ac-d18e-4d50-8710-dd313e5a4832 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:16.347864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-72f7c7ac-d18e-4d50-8710-dd313e5a4832 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.165609 Sep 05 17:02:16.348442 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 62/124] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:16 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:16.865291 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-19079701-446e-4c70-808b-285586744870 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:16.866345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-19079701-446e-4c70-808b-285586744870 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:16.874098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19079701-446e-4c70-808b-285586744870 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:16.874522 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19079701-446e-4c70-808b-285586744870 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:16.874926 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19079701-446e-4c70-808b-285586744870 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:16.876106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19079701-446e-4c70-808b-285586744870 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:16.876106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19079701-446e-4c70-808b-285586744870 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:16.876548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19079701-446e-4c70-808b-285586744870 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:16.895636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:02:17.013174 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-19079701-446e-4c70-808b-285586744870 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:17.015140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-606be235-27c8-4d87-8090-91f35ff6e8b4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:17.016316 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-606be235-27c8-4d87-8090-91f35ff6e8b4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:17.021273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-19079701-446e-4c70-808b-285586744870 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.162643 Sep 05 17:02:17.021931 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 63/125] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:16 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:17.022370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-606be235-27c8-4d87-8090-91f35ff6e8b4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:17.022939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-606be235-27c8-4d87-8090-91f35ff6e8b4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:17.023372 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-606be235-27c8-4d87-8090-91f35ff6e8b4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:17.024072 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-606be235-27c8-4d87-8090-91f35ff6e8b4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:17.024596 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-606be235-27c8-4d87-8090-91f35ff6e8b4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:17.025014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-606be235-27c8-4d87-8090-91f35ff6e8b4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:17.159525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-606be235-27c8-4d87-8090-91f35ff6e8b4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:17.167599 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-606be235-27c8-4d87-8090-91f35ff6e8b4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.158550 Sep 05 17:02:17.168191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 63/126] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:17 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:17.373400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aa7ac671-09fa-4f29-a2ed-ff0425f5419f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:17.374013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aa7ac671-09fa-4f29-a2ed-ff0425f5419f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:17.380978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa7ac671-09fa-4f29-a2ed-ff0425f5419f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:17.381639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa7ac671-09fa-4f29-a2ed-ff0425f5419f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:17.382181 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa7ac671-09fa-4f29-a2ed-ff0425f5419f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:17.383262 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa7ac671-09fa-4f29-a2ed-ff0425f5419f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:17.383869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa7ac671-09fa-4f29-a2ed-ff0425f5419f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:17.384447 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa7ac671-09fa-4f29-a2ed-ff0425f5419f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:17.537231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aa7ac671-09fa-4f29-a2ed-ff0425f5419f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:17.547176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aa7ac671-09fa-4f29-a2ed-ff0425f5419f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:17.549877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aa7ac671-09fa-4f29-a2ed-ff0425f5419f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:17.551819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aa7ac671-09fa-4f29-a2ed-ff0425f5419f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.182230 Sep 05 17:02:17.552768 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 64/127] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:17 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:18.047864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-368ffced-5682-44f5-85e3-cf51d883245f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:18.048642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-368ffced-5682-44f5-85e3-cf51d883245f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:18.060277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-368ffced-5682-44f5-85e3-cf51d883245f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:18.060774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-368ffced-5682-44f5-85e3-cf51d883245f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:18.061390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-368ffced-5682-44f5-85e3-cf51d883245f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:18.062348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-368ffced-5682-44f5-85e3-cf51d883245f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:18.062891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-368ffced-5682-44f5-85e3-cf51d883245f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:18.063344 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-368ffced-5682-44f5-85e3-cf51d883245f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:18.190204 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-47e3f38b-c430-4764-8a58-aa8373d70307 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:18.190767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-47e3f38b-c430-4764-8a58-aa8373d70307 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:18.197150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e3f38b-c430-4764-8a58-aa8373d70307 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:18.197642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e3f38b-c430-4764-8a58-aa8373d70307 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:18.198324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e3f38b-c430-4764-8a58-aa8373d70307 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:18.199001 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e3f38b-c430-4764-8a58-aa8373d70307 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:18.199483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e3f38b-c430-4764-8a58-aa8373d70307 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:18.199906 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e3f38b-c430-4764-8a58-aa8373d70307 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:18.203987 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-368ffced-5682-44f5-85e3-cf51d883245f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:18.212054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-368ffced-5682-44f5-85e3-cf51d883245f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.172055 Sep 05 17:02:18.212672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 64/128] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:18 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:18.336746 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-47e3f38b-c430-4764-8a58-aa8373d70307 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:18.345387 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-47e3f38b-c430-4764-8a58-aa8373d70307 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.159273 Sep 05 17:02:18.345968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 65/129] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:18 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:18.580042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d96caa3c-ab93-4543-b206-655f7a05ae72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:18.580715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d96caa3c-ab93-4543-b206-655f7a05ae72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:18.587420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d96caa3c-ab93-4543-b206-655f7a05ae72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:18.587897 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d96caa3c-ab93-4543-b206-655f7a05ae72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:18.588354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d96caa3c-ab93-4543-b206-655f7a05ae72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:18.589100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d96caa3c-ab93-4543-b206-655f7a05ae72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:18.589541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d96caa3c-ab93-4543-b206-655f7a05ae72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:18.589932 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d96caa3c-ab93-4543-b206-655f7a05ae72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:18.735672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d96caa3c-ab93-4543-b206-655f7a05ae72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:18.744683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d96caa3c-ab93-4543-b206-655f7a05ae72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:18.746330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d96caa3c-ab93-4543-b206-655f7a05ae72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:18.747496 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d96caa3c-ab93-4543-b206-655f7a05ae72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.172604 Sep 05 17:02:18.748023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 65/130] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:18 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:19.235014 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f0a905eb-ca1e-42d1-92ff-62a7c8ba535b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:19.235636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f0a905eb-ca1e-42d1-92ff-62a7c8ba535b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:19.241982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0a905eb-ca1e-42d1-92ff-62a7c8ba535b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:19.242474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0a905eb-ca1e-42d1-92ff-62a7c8ba535b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:19.242921 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0a905eb-ca1e-42d1-92ff-62a7c8ba535b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:19.243609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0a905eb-ca1e-42d1-92ff-62a7c8ba535b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:19.244047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0a905eb-ca1e-42d1-92ff-62a7c8ba535b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:19.244503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0a905eb-ca1e-42d1-92ff-62a7c8ba535b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:19.370239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c88f55ba-c6c3-4e19-b5ba-256bbcb3faec tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:19.371047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c88f55ba-c6c3-4e19-b5ba-256bbcb3faec tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:19.377981 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c88f55ba-c6c3-4e19-b5ba-256bbcb3faec tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:19.378596 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c88f55ba-c6c3-4e19-b5ba-256bbcb3faec tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:19.379125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c88f55ba-c6c3-4e19-b5ba-256bbcb3faec tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:19.379888 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c88f55ba-c6c3-4e19-b5ba-256bbcb3faec tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:19.380389 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c88f55ba-c6c3-4e19-b5ba-256bbcb3faec tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:19.381053 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c88f55ba-c6c3-4e19-b5ba-256bbcb3faec tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:19.399169 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f0a905eb-ca1e-42d1-92ff-62a7c8ba535b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:19.407693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f0a905eb-ca1e-42d1-92ff-62a7c8ba535b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.176601 Sep 05 17:02:19.408695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 66/131] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:19 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:19.544096 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c88f55ba-c6c3-4e19-b5ba-256bbcb3faec tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:19.554529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c88f55ba-c6c3-4e19-b5ba-256bbcb3faec tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.188680 Sep 05 17:02:19.555613 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 66/132] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:19 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:02:19.680308 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-3df40f5e-53f9-472f-9ba3-6000b3560c30 req-7445df7c-2529-485a-a4a8-76e583f409e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfe215ba-4dff-48b0-a561-60ab7593b6d7", "name": "network-vif-plugged", "status": "completed", "tag": "5dfa4258-3985-4da8-9bdc-73fa86de300a"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:02:19.690521 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-3df40f5e-53f9-472f-9ba3-6000b3560c30 req-7445df7c-2529-485a-a4a8-76e583f409e8 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:19.691063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-3df40f5e-53f9-472f-9ba3-6000b3560c30 req-7445df7c-2529-485a-a4a8-76e583f409e8 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:19.691484 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-3df40f5e-53f9-472f-9ba3-6000b3560c30 req-7445df7c-2529-485a-a4a8-76e583f409e8 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:19.705917 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-3df40f5e-53f9-472f-9ba3-6000b3560c30 req-7445df7c-2529-485a-a4a8-76e583f409e8 service nova] Creating event network-vif-plugged:5dfa4258-3985-4da8-9bdc-73fa86de300a for instance bfe215ba-4dff-48b0-a561-60ab7593b6d7 on hv-cinder-85596 Sep 05 17:02:19.711441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-3df40f5e-53f9-472f-9ba3-6000b3560c30 req-7445df7c-2529-485a-a4a8-76e583f409e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095167 Sep 05 17:02:19.712265 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 67/133] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:02:19.775996 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-490ec4b9-de8d-401d-bf11-d85efd27ef78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:19.776666 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-490ec4b9-de8d-401d-bf11-d85efd27ef78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:19.783032 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-490ec4b9-de8d-401d-bf11-d85efd27ef78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:19.783519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-490ec4b9-de8d-401d-bf11-d85efd27ef78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:19.783944 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-490ec4b9-de8d-401d-bf11-d85efd27ef78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:19.784659 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-490ec4b9-de8d-401d-bf11-d85efd27ef78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:19.785100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-490ec4b9-de8d-401d-bf11-d85efd27ef78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:19.785517 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-490ec4b9-de8d-401d-bf11-d85efd27ef78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:19.926383 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-490ec4b9-de8d-401d-bf11-d85efd27ef78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:19.936798 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-490ec4b9-de8d-401d-bf11-d85efd27ef78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:19.938375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-490ec4b9-de8d-401d-bf11-d85efd27ef78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:19.939744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-490ec4b9-de8d-401d-bf11-d85efd27ef78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.167756 Sep 05 17:02:19.952854 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 67/134] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:19 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 17:02:20.434955 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8a209f95-4347-48ab-a62d-8df6c19f4048 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:20.435698 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8a209f95-4347-48ab-a62d-8df6c19f4048 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:20.443772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a209f95-4347-48ab-a62d-8df6c19f4048 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:20.444477 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a209f95-4347-48ab-a62d-8df6c19f4048 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:20.444962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a209f95-4347-48ab-a62d-8df6c19f4048 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:20.445745 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a209f95-4347-48ab-a62d-8df6c19f4048 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:20.446261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a209f95-4347-48ab-a62d-8df6c19f4048 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:20.446734 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a209f95-4347-48ab-a62d-8df6c19f4048 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:20.578678 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-526a391e-0360-4d28-93fc-b50f3a245744 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:20.579237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-526a391e-0360-4d28-93fc-b50f3a245744 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:20.584073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8a209f95-4347-48ab-a62d-8df6c19f4048 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:20.585566 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-526a391e-0360-4d28-93fc-b50f3a245744 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:20.586023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-526a391e-0360-4d28-93fc-b50f3a245744 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:20.586446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-526a391e-0360-4d28-93fc-b50f3a245744 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:20.587133 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-526a391e-0360-4d28-93fc-b50f3a245744 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:20.587584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-526a391e-0360-4d28-93fc-b50f3a245744 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:20.588000 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-526a391e-0360-4d28-93fc-b50f3a245744 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:20.591909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8a209f95-4347-48ab-a62d-8df6c19f4048 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.163226 Sep 05 17:02:20.592507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 68/135] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:20 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:20.715080 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-526a391e-0360-4d28-93fc-b50f3a245744 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:20.722761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-526a391e-0360-4d28-93fc-b50f3a245744 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.148012 Sep 05 17:02:20.723300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 68/136] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:20 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:20.970451 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bdf8471a-f76b-4592-b62b-ad8c5dfc6d09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:20.971437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bdf8471a-f76b-4592-b62b-ad8c5dfc6d09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:20.981367 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdf8471a-f76b-4592-b62b-ad8c5dfc6d09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:20.981842 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdf8471a-f76b-4592-b62b-ad8c5dfc6d09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:20.982265 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdf8471a-f76b-4592-b62b-ad8c5dfc6d09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:20.982966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdf8471a-f76b-4592-b62b-ad8c5dfc6d09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:20.983410 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdf8471a-f76b-4592-b62b-ad8c5dfc6d09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:20.983820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdf8471a-f76b-4592-b62b-ad8c5dfc6d09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:21.118804 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bdf8471a-f76b-4592-b62b-ad8c5dfc6d09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:21.127468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bdf8471a-f76b-4592-b62b-ad8c5dfc6d09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:21.128954 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bdf8471a-f76b-4592-b62b-ad8c5dfc6d09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:21.130058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bdf8471a-f76b-4592-b62b-ad8c5dfc6d09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.166426 Sep 05 17:02:21.136988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 69/137] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:20 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:21.619447 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0f1f41d2-ec5b-4b82-bae1-04b39949a1c7 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:21.620856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0f1f41d2-ec5b-4b82-bae1-04b39949a1c7 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:21.630901 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f1f41d2-ec5b-4b82-bae1-04b39949a1c7 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:21.631697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f1f41d2-ec5b-4b82-bae1-04b39949a1c7 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:21.632459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f1f41d2-ec5b-4b82-bae1-04b39949a1c7 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:21.633756 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f1f41d2-ec5b-4b82-bae1-04b39949a1c7 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:21.634541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f1f41d2-ec5b-4b82-bae1-04b39949a1c7 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:21.635221 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f1f41d2-ec5b-4b82-bae1-04b39949a1c7 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:21.753794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a710b817-25d1-44da-a534-96ebe3e26db1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:21.754411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a710b817-25d1-44da-a534-96ebe3e26db1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:21.760791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a710b817-25d1-44da-a534-96ebe3e26db1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:21.761280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a710b817-25d1-44da-a534-96ebe3e26db1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:21.761705 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a710b817-25d1-44da-a534-96ebe3e26db1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:21.762391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a710b817-25d1-44da-a534-96ebe3e26db1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:21.762834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a710b817-25d1-44da-a534-96ebe3e26db1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:21.763243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a710b817-25d1-44da-a534-96ebe3e26db1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:21.763991 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0f1f41d2-ec5b-4b82-bae1-04b39949a1c7 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:21.771883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0f1f41d2-ec5b-4b82-bae1-04b39949a1c7 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.158992 Sep 05 17:02:21.772455 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 69/138] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:21 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:21.890568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a710b817-25d1-44da-a534-96ebe3e26db1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:21.902651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a710b817-25d1-44da-a534-96ebe3e26db1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.152752 Sep 05 17:02:21.903227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 70/139] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:21 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:22.156403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-49c9eeeb-c2a3-45c6-8fdc-ed4b9f65862e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:22.157127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-49c9eeeb-c2a3-45c6-8fdc-ed4b9f65862e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:22.163488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49c9eeeb-c2a3-45c6-8fdc-ed4b9f65862e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:22.164084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49c9eeeb-c2a3-45c6-8fdc-ed4b9f65862e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:22.164561 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49c9eeeb-c2a3-45c6-8fdc-ed4b9f65862e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:22.165242 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49c9eeeb-c2a3-45c6-8fdc-ed4b9f65862e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:22.165828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49c9eeeb-c2a3-45c6-8fdc-ed4b9f65862e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:22.166237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49c9eeeb-c2a3-45c6-8fdc-ed4b9f65862e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:22.302721 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-49c9eeeb-c2a3-45c6-8fdc-ed4b9f65862e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:22.311662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-49c9eeeb-c2a3-45c6-8fdc-ed4b9f65862e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:22.313121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-49c9eeeb-c2a3-45c6-8fdc-ed4b9f65862e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:22.314216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-49c9eeeb-c2a3-45c6-8fdc-ed4b9f65862e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.162025 Sep 05 17:02:22.314810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 70/140] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:22 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:22.795089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c455a477-5f6d-4e74-9a16-35b8f696a789 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:22.795702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c455a477-5f6d-4e74-9a16-35b8f696a789 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:22.803119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c455a477-5f6d-4e74-9a16-35b8f696a789 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:22.803592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c455a477-5f6d-4e74-9a16-35b8f696a789 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:22.804015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c455a477-5f6d-4e74-9a16-35b8f696a789 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:22.805126 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c455a477-5f6d-4e74-9a16-35b8f696a789 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:22.805828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c455a477-5f6d-4e74-9a16-35b8f696a789 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:22.806232 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c455a477-5f6d-4e74-9a16-35b8f696a789 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:22.925986 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-75649292-2a4f-4121-bd4f-0378e6ee5fd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:22.926573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-75649292-2a4f-4121-bd4f-0378e6ee5fd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:22.933184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-75649292-2a4f-4121-bd4f-0378e6ee5fd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:22.933674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-75649292-2a4f-4121-bd4f-0378e6ee5fd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:22.934104 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-75649292-2a4f-4121-bd4f-0378e6ee5fd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:22.934790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-75649292-2a4f-4121-bd4f-0378e6ee5fd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:22.935241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-75649292-2a4f-4121-bd4f-0378e6ee5fd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:22.935667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-75649292-2a4f-4121-bd4f-0378e6ee5fd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:22.942267 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c455a477-5f6d-4e74-9a16-35b8f696a789 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:22.950471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c455a477-5f6d-4e74-9a16-35b8f696a789 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.159594 Sep 05 17:02:22.951046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 71/141] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:22 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:23.071019 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-75649292-2a4f-4121-bd4f-0378e6ee5fd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:23.079376 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-75649292-2a4f-4121-bd4f-0378e6ee5fd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.158481 Sep 05 17:02:23.079953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 71/142] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:22 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:23.343036 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-557349ff-c6da-489b-ab47-6ba53d2c7260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:23.343639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-557349ff-c6da-489b-ab47-6ba53d2c7260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:23.349994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557349ff-c6da-489b-ab47-6ba53d2c7260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:23.350503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557349ff-c6da-489b-ab47-6ba53d2c7260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:23.350930 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557349ff-c6da-489b-ab47-6ba53d2c7260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:23.351620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557349ff-c6da-489b-ab47-6ba53d2c7260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:23.352064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557349ff-c6da-489b-ab47-6ba53d2c7260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:23.352854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557349ff-c6da-489b-ab47-6ba53d2c7260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:23.498073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-557349ff-c6da-489b-ab47-6ba53d2c7260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:23.506765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-557349ff-c6da-489b-ab47-6ba53d2c7260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:23.508185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-557349ff-c6da-489b-ab47-6ba53d2c7260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:23.509332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-557349ff-c6da-489b-ab47-6ba53d2c7260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.170801 Sep 05 17:02:23.509971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 72/143] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:23 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:23.978005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-90613426-e1fb-4d57-bd69-40dcf2396d63 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:23.978972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-90613426-e1fb-4d57-bd69-40dcf2396d63 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:23.985922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90613426-e1fb-4d57-bd69-40dcf2396d63 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:23.986399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90613426-e1fb-4d57-bd69-40dcf2396d63 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:23.986837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90613426-e1fb-4d57-bd69-40dcf2396d63 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:23.987665 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90613426-e1fb-4d57-bd69-40dcf2396d63 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:23.988096 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90613426-e1fb-4d57-bd69-40dcf2396d63 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:23.988589 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90613426-e1fb-4d57-bd69-40dcf2396d63 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:23.992946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:02:24.103166 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dd71d67e-7af2-441c-8111-8d1a867e2e61 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:24.103779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dd71d67e-7af2-441c-8111-8d1a867e2e61 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:24.110271 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd71d67e-7af2-441c-8111-8d1a867e2e61 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:24.110767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd71d67e-7af2-441c-8111-8d1a867e2e61 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:24.111199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd71d67e-7af2-441c-8111-8d1a867e2e61 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:24.111894 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd71d67e-7af2-441c-8111-8d1a867e2e61 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:24.112378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd71d67e-7af2-441c-8111-8d1a867e2e61 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:24.112799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd71d67e-7af2-441c-8111-8d1a867e2e61 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:24.125846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-90613426-e1fb-4d57-bd69-40dcf2396d63 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:24.134104 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-90613426-e1fb-4d57-bd69-40dcf2396d63 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.163026 Sep 05 17:02:24.134781 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 72/144] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:23 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:24.245844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dd71d67e-7af2-441c-8111-8d1a867e2e61 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:24.254100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dd71d67e-7af2-441c-8111-8d1a867e2e61 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.155070 Sep 05 17:02:24.254786 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 73/145] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:24 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:24.535409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-41beeef6-2f50-4989-9f10-d50bf1ee38e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:24.536353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-41beeef6-2f50-4989-9f10-d50bf1ee38e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:24.542950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-41beeef6-2f50-4989-9f10-d50bf1ee38e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:24.543393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-41beeef6-2f50-4989-9f10-d50bf1ee38e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:24.543864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-41beeef6-2f50-4989-9f10-d50bf1ee38e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:24.544612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-41beeef6-2f50-4989-9f10-d50bf1ee38e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:24.545048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-41beeef6-2f50-4989-9f10-d50bf1ee38e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:24.545623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-41beeef6-2f50-4989-9f10-d50bf1ee38e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:24.682459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-41beeef6-2f50-4989-9f10-d50bf1ee38e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:24.692447 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-41beeef6-2f50-4989-9f10-d50bf1ee38e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:24.693223 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-41beeef6-2f50-4989-9f10-d50bf1ee38e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:24.694394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-41beeef6-2f50-4989-9f10-d50bf1ee38e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.163111 Sep 05 17:02:24.694971 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 73/146] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:24 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:25.157753 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7c7285fa-6539-470c-9e02-17a0d9b69d18 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:25.158319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7c7285fa-6539-470c-9e02-17a0d9b69d18 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:25.164479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c7285fa-6539-470c-9e02-17a0d9b69d18 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:25.164947 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c7285fa-6539-470c-9e02-17a0d9b69d18 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:25.165386 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c7285fa-6539-470c-9e02-17a0d9b69d18 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:25.166069 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c7285fa-6539-470c-9e02-17a0d9b69d18 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:25.166512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c7285fa-6539-470c-9e02-17a0d9b69d18 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:25.166965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c7285fa-6539-470c-9e02-17a0d9b69d18 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:25.278440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b48d23e9-1aae-4ba5-846e-8243ba9c3260 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:25.280700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b48d23e9-1aae-4ba5-846e-8243ba9c3260 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:25.287283 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b48d23e9-1aae-4ba5-846e-8243ba9c3260 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:25.288041 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b48d23e9-1aae-4ba5-846e-8243ba9c3260 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:25.288699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b48d23e9-1aae-4ba5-846e-8243ba9c3260 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:25.292542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b48d23e9-1aae-4ba5-846e-8243ba9c3260 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:25.293638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b48d23e9-1aae-4ba5-846e-8243ba9c3260 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:25.295102 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b48d23e9-1aae-4ba5-846e-8243ba9c3260 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:25.322243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7c7285fa-6539-470c-9e02-17a0d9b69d18 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:25.334231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7c7285fa-6539-470c-9e02-17a0d9b69d18 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.180347 Sep 05 17:02:25.345761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 74/147] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:25 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:25.518082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b48d23e9-1aae-4ba5-846e-8243ba9c3260 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:25.526624 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b48d23e9-1aae-4ba5-846e-8243ba9c3260 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.252284 Sep 05 17:02:25.527299 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 74/148] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:25 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:02:25.720010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-951acf16-903f-482f-ad22-5a9bbb6b88ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:25.720650 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-951acf16-903f-482f-ad22-5a9bbb6b88ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:25.726928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-951acf16-903f-482f-ad22-5a9bbb6b88ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:25.727741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-951acf16-903f-482f-ad22-5a9bbb6b88ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:25.728165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-951acf16-903f-482f-ad22-5a9bbb6b88ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:25.728866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-951acf16-903f-482f-ad22-5a9bbb6b88ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:25.729311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-951acf16-903f-482f-ad22-5a9bbb6b88ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:25.729717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-951acf16-903f-482f-ad22-5a9bbb6b88ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:25.869314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-951acf16-903f-482f-ad22-5a9bbb6b88ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:25.878323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-951acf16-903f-482f-ad22-5a9bbb6b88ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:25.879773 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-951acf16-903f-482f-ad22-5a9bbb6b88ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:25.880993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-951acf16-903f-482f-ad22-5a9bbb6b88ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.165846 Sep 05 17:02:25.881562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 75/149] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:25 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:26.363744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-60db2c45-28ff-454b-8d37-b9ed71246dc3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:26.364540 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-60db2c45-28ff-454b-8d37-b9ed71246dc3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:26.372809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60db2c45-28ff-454b-8d37-b9ed71246dc3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:26.373445 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60db2c45-28ff-454b-8d37-b9ed71246dc3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:26.374201 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60db2c45-28ff-454b-8d37-b9ed71246dc3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:26.375114 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60db2c45-28ff-454b-8d37-b9ed71246dc3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:26.376335 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60db2c45-28ff-454b-8d37-b9ed71246dc3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:26.376765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60db2c45-28ff-454b-8d37-b9ed71246dc3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:26.514473 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-60db2c45-28ff-454b-8d37-b9ed71246dc3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:26.522476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-60db2c45-28ff-454b-8d37-b9ed71246dc3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.164653 Sep 05 17:02:26.523052 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 75/150] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:26 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:26.554135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d8c22e9e-99ea-4627-847d-0b307c706de1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:26.554735 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d8c22e9e-99ea-4627-847d-0b307c706de1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:26.560934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8c22e9e-99ea-4627-847d-0b307c706de1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:26.561411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8c22e9e-99ea-4627-847d-0b307c706de1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:26.562395 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8c22e9e-99ea-4627-847d-0b307c706de1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:26.563224 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8c22e9e-99ea-4627-847d-0b307c706de1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:26.563676 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8c22e9e-99ea-4627-847d-0b307c706de1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:26.564098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8c22e9e-99ea-4627-847d-0b307c706de1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:26.696587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d8c22e9e-99ea-4627-847d-0b307c706de1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:26.704276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d8c22e9e-99ea-4627-847d-0b307c706de1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.154706 Sep 05 17:02:26.704873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 76/151] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:26 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:26.905998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f5b922a9-bff3-47a5-b7c8-b0639955a98c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:26.907810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f5b922a9-bff3-47a5-b7c8-b0639955a98c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:26.915269 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5b922a9-bff3-47a5-b7c8-b0639955a98c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:26.915826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5b922a9-bff3-47a5-b7c8-b0639955a98c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:26.916281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5b922a9-bff3-47a5-b7c8-b0639955a98c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:26.916968 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5b922a9-bff3-47a5-b7c8-b0639955a98c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:26.917407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5b922a9-bff3-47a5-b7c8-b0639955a98c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:26.917802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5b922a9-bff3-47a5-b7c8-b0639955a98c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:27.111264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f5b922a9-bff3-47a5-b7c8-b0639955a98c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:27.121297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f5b922a9-bff3-47a5-b7c8-b0639955a98c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:27.123037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f5b922a9-bff3-47a5-b7c8-b0639955a98c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:27.124704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f5b922a9-bff3-47a5-b7c8-b0639955a98c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.222558 Sep 05 17:02:27.125905 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 76/152] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:26 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:27.545495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c8a2d802-7595-4383-8f63-f9f0c6e3fa9e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:27.546131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c8a2d802-7595-4383-8f63-f9f0c6e3fa9e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:27.553191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8a2d802-7595-4383-8f63-f9f0c6e3fa9e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:27.553692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8a2d802-7595-4383-8f63-f9f0c6e3fa9e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:27.554134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8a2d802-7595-4383-8f63-f9f0c6e3fa9e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:27.555069 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8a2d802-7595-4383-8f63-f9f0c6e3fa9e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:27.555662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8a2d802-7595-4383-8f63-f9f0c6e3fa9e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:27.556240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8a2d802-7595-4383-8f63-f9f0c6e3fa9e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:27.697518 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c8a2d802-7595-4383-8f63-f9f0c6e3fa9e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:27.708735 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c8a2d802-7595-4383-8f63-f9f0c6e3fa9e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.167044 Sep 05 17:02:27.709748 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 77/153] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:27 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:27.728575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b9d1106b-20e5-40aa-a97b-0a7eec09fae5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:27.729334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b9d1106b-20e5-40aa-a97b-0a7eec09fae5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:27.735661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b9d1106b-20e5-40aa-a97b-0a7eec09fae5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:27.736229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b9d1106b-20e5-40aa-a97b-0a7eec09fae5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:27.736689 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b9d1106b-20e5-40aa-a97b-0a7eec09fae5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:27.737379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b9d1106b-20e5-40aa-a97b-0a7eec09fae5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:27.737834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b9d1106b-20e5-40aa-a97b-0a7eec09fae5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:27.738254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b9d1106b-20e5-40aa-a97b-0a7eec09fae5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:27.867593 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b9d1106b-20e5-40aa-a97b-0a7eec09fae5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:27.875980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b9d1106b-20e5-40aa-a97b-0a7eec09fae5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.151916 Sep 05 17:02:27.876898 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 77/154] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:27 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:28.150225 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5f091164-cfbc-478c-a3b4-03451544be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:28.150920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5f091164-cfbc-478c-a3b4-03451544be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:28.157292 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f091164-cfbc-478c-a3b4-03451544be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:28.157794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f091164-cfbc-478c-a3b4-03451544be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:28.158207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f091164-cfbc-478c-a3b4-03451544be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:28.158890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f091164-cfbc-478c-a3b4-03451544be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:28.159324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f091164-cfbc-478c-a3b4-03451544be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:28.159740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f091164-cfbc-478c-a3b4-03451544be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:28.305372 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f091164-cfbc-478c-a3b4-03451544be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:28.317218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f091164-cfbc-478c-a3b4-03451544be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:28.318975 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f091164-cfbc-478c-a3b4-03451544be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:28.320444 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5f091164-cfbc-478c-a3b4-03451544be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.174143 Sep 05 17:02:28.321451 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 78/155] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:28 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:28.733004 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-be82caa5-195d-40ba-9df1-c18138233d86 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:28.733532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-be82caa5-195d-40ba-9df1-c18138233d86 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:28.740213 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-be82caa5-195d-40ba-9df1-c18138233d86 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:28.741309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-be82caa5-195d-40ba-9df1-c18138233d86 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:28.741766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-be82caa5-195d-40ba-9df1-c18138233d86 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:28.742995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-be82caa5-195d-40ba-9df1-c18138233d86 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:28.746617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-be82caa5-195d-40ba-9df1-c18138233d86 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:28.746617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-be82caa5-195d-40ba-9df1-c18138233d86 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:28.898294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-be82caa5-195d-40ba-9df1-c18138233d86 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:28.902004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cae4570c-785e-4d64-9b63-3fecedc770c3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:28.903175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cae4570c-785e-4d64-9b63-3fecedc770c3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:28.910056 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-be82caa5-195d-40ba-9df1-c18138233d86 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.181282 Sep 05 17:02:28.910658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 78/156] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:28 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:28.912944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cae4570c-785e-4d64-9b63-3fecedc770c3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:28.913992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cae4570c-785e-4d64-9b63-3fecedc770c3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:28.914494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cae4570c-785e-4d64-9b63-3fecedc770c3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:28.915344 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cae4570c-785e-4d64-9b63-3fecedc770c3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:28.916351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cae4570c-785e-4d64-9b63-3fecedc770c3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:28.916351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cae4570c-785e-4d64-9b63-3fecedc770c3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:29.056022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cae4570c-785e-4d64-9b63-3fecedc770c3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:29.065227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cae4570c-785e-4d64-9b63-3fecedc770c3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.168076 Sep 05 17:02:29.066031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 79/157] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:28 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:29.349112 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f35c6981-faf2-45e8-8f80-ddd8e82b92bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:29.350789 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f35c6981-faf2-45e8-8f80-ddd8e82b92bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:29.358010 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f35c6981-faf2-45e8-8f80-ddd8e82b92bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:29.358553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f35c6981-faf2-45e8-8f80-ddd8e82b92bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:29.359040 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f35c6981-faf2-45e8-8f80-ddd8e82b92bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:29.368216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f35c6981-faf2-45e8-8f80-ddd8e82b92bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:29.368792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f35c6981-faf2-45e8-8f80-ddd8e82b92bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:29.369230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f35c6981-faf2-45e8-8f80-ddd8e82b92bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:29.522693 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f35c6981-faf2-45e8-8f80-ddd8e82b92bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:29.531041 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f35c6981-faf2-45e8-8f80-ddd8e82b92bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:29.532581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f35c6981-faf2-45e8-8f80-ddd8e82b92bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:29.533715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f35c6981-faf2-45e8-8f80-ddd8e82b92bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.190154 Sep 05 17:02:29.534297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 79/158] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:29 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:29.937160 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d0a29050-c11d-43d2-aeb2-1778588cd69d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:29.938573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d0a29050-c11d-43d2-aeb2-1778588cd69d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:29.940938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=74 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:02:29.948807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0a29050-c11d-43d2-aeb2-1778588cd69d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:29.949480 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0a29050-c11d-43d2-aeb2-1778588cd69d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:29.950067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0a29050-c11d-43d2-aeb2-1778588cd69d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:29.951016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0a29050-c11d-43d2-aeb2-1778588cd69d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:29.951655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0a29050-c11d-43d2-aeb2-1778588cd69d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:29.952375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0a29050-c11d-43d2-aeb2-1778588cd69d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:30.089241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-43b349dc-16ad-486e-8f67-87c4b02a422c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:30.089955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-43b349dc-16ad-486e-8f67-87c4b02a422c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:30.096699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43b349dc-16ad-486e-8f67-87c4b02a422c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:30.097172 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43b349dc-16ad-486e-8f67-87c4b02a422c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:30.097597 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43b349dc-16ad-486e-8f67-87c4b02a422c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:30.098287 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43b349dc-16ad-486e-8f67-87c4b02a422c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:30.098940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43b349dc-16ad-486e-8f67-87c4b02a422c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:30.099341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43b349dc-16ad-486e-8f67-87c4b02a422c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:30.106079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d0a29050-c11d-43d2-aeb2-1778588cd69d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:30.109621 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:02:30.114222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d0a29050-c11d-43d2-aeb2-1778588cd69d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.182800 Sep 05 17:02:30.114949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 80/159] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:29 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:30.230802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-43b349dc-16ad-486e-8f67-87c4b02a422c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:30.242472 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-43b349dc-16ad-486e-8f67-87c4b02a422c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.156827 Sep 05 17:02:30.243196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 80/160] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:30 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:30.559016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b14ea407-6f0f-44cd-beb5-b8c9cc3d8c95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:30.559623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b14ea407-6f0f-44cd-beb5-b8c9cc3d8c95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:30.566069 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b14ea407-6f0f-44cd-beb5-b8c9cc3d8c95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:30.566557 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b14ea407-6f0f-44cd-beb5-b8c9cc3d8c95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:30.566959 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b14ea407-6f0f-44cd-beb5-b8c9cc3d8c95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:30.567674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b14ea407-6f0f-44cd-beb5-b8c9cc3d8c95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:30.568133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b14ea407-6f0f-44cd-beb5-b8c9cc3d8c95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:30.568591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b14ea407-6f0f-44cd-beb5-b8c9cc3d8c95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:30.710770 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b14ea407-6f0f-44cd-beb5-b8c9cc3d8c95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:30.718950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b14ea407-6f0f-44cd-beb5-b8c9cc3d8c95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:30.720582 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b14ea407-6f0f-44cd-beb5-b8c9cc3d8c95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:30.721695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b14ea407-6f0f-44cd-beb5-b8c9cc3d8c95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.167065 Sep 05 17:02:30.722293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 81/161] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:30 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:31.143256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c293af91-4f01-478b-887b-9c93418f9c3f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:31.143877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c293af91-4f01-478b-887b-9c93418f9c3f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:31.150549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c293af91-4f01-478b-887b-9c93418f9c3f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:31.151034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c293af91-4f01-478b-887b-9c93418f9c3f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:31.151455 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c293af91-4f01-478b-887b-9c93418f9c3f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:31.152133 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c293af91-4f01-478b-887b-9c93418f9c3f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:31.152686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c293af91-4f01-478b-887b-9c93418f9c3f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:31.153136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c293af91-4f01-478b-887b-9c93418f9c3f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:31.268936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a871e89c-dab5-4958-a9f2-b1df57ec8215 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:31.269946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a871e89c-dab5-4958-a9f2-b1df57ec8215 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:31.277486 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a871e89c-dab5-4958-a9f2-b1df57ec8215 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:31.277973 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a871e89c-dab5-4958-a9f2-b1df57ec8215 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:31.278401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a871e89c-dab5-4958-a9f2-b1df57ec8215 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:31.279197 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a871e89c-dab5-4958-a9f2-b1df57ec8215 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:31.279946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a871e89c-dab5-4958-a9f2-b1df57ec8215 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:31.280510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a871e89c-dab5-4958-a9f2-b1df57ec8215 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:31.291862 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c293af91-4f01-478b-887b-9c93418f9c3f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:31.299721 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c293af91-4f01-478b-887b-9c93418f9c3f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.162120 Sep 05 17:02:31.300347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 81/162] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:31 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:31.413808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a871e89c-dab5-4958-a9f2-b1df57ec8215 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:31.421829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a871e89c-dab5-4958-a9f2-b1df57ec8215 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.157793 Sep 05 17:02:31.422479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 82/163] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:31 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:02:31.748895 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-291825da-8e91-425a-a1fd-5e995764f988 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:31.749742 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-291825da-8e91-425a-a1fd-5e995764f988 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:31.756916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-291825da-8e91-425a-a1fd-5e995764f988 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:31.757395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-291825da-8e91-425a-a1fd-5e995764f988 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:31.757823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-291825da-8e91-425a-a1fd-5e995764f988 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:31.758504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-291825da-8e91-425a-a1fd-5e995764f988 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:31.758950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-291825da-8e91-425a-a1fd-5e995764f988 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:31.759368 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-291825da-8e91-425a-a1fd-5e995764f988 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:31.898155 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-291825da-8e91-425a-a1fd-5e995764f988 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:31.906331 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-291825da-8e91-425a-a1fd-5e995764f988 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:31.907808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-291825da-8e91-425a-a1fd-5e995764f988 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:31.908950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-291825da-8e91-425a-a1fd-5e995764f988 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.165738 Sep 05 17:02:31.909504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 82/164] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:31 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:32.322809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bfef1a88-e2c3-46b9-9e1c-f083f6e90cc2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:32.324060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bfef1a88-e2c3-46b9-9e1c-f083f6e90cc2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:32.330563 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfef1a88-e2c3-46b9-9e1c-f083f6e90cc2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:32.331037 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfef1a88-e2c3-46b9-9e1c-f083f6e90cc2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:32.331483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfef1a88-e2c3-46b9-9e1c-f083f6e90cc2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:32.332185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfef1a88-e2c3-46b9-9e1c-f083f6e90cc2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:32.332655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfef1a88-e2c3-46b9-9e1c-f083f6e90cc2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:32.333061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfef1a88-e2c3-46b9-9e1c-f083f6e90cc2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:32.390219 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-0f7d9341-5923-4cd4-a709-b2354120a4f9 req-fa156b80-82f2-4c26-9033-88aad2df11aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97cc15c7-947d-4daf-80e8-8edc37c01e68", "name": "network-vif-plugged", "status": "completed", "tag": "4a115af6-123d-4baf-bd17-df6792943a2d"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:02:32.414020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-0f7d9341-5923-4cd4-a709-b2354120a4f9 req-fa156b80-82f2-4c26-9033-88aad2df11aa service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:32.414707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-0f7d9341-5923-4cd4-a709-b2354120a4f9 req-fa156b80-82f2-4c26-9033-88aad2df11aa service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:32.415675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-0f7d9341-5923-4cd4-a709-b2354120a4f9 req-fa156b80-82f2-4c26-9033-88aad2df11aa service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:32.432964 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-0f7d9341-5923-4cd4-a709-b2354120a4f9 req-fa156b80-82f2-4c26-9033-88aad2df11aa service nova] Creating event network-vif-plugged:4a115af6-123d-4baf-bd17-df6792943a2d for instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 on hv-cinder-85596 Sep 05 17:02:32.438895 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-0f7d9341-5923-4cd4-a709-b2354120a4f9 req-fa156b80-82f2-4c26-9033-88aad2df11aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053157 Sep 05 17:02:32.439719 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 83/165] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:02:32.446944 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-35ba24c1-b784-442f-94ab-8ceeb72f8f1e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:32.447953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-35ba24c1-b784-442f-94ab-8ceeb72f8f1e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:32.456000 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35ba24c1-b784-442f-94ab-8ceeb72f8f1e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:32.456466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35ba24c1-b784-442f-94ab-8ceeb72f8f1e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:32.456895 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35ba24c1-b784-442f-94ab-8ceeb72f8f1e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:32.457599 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35ba24c1-b784-442f-94ab-8ceeb72f8f1e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:32.458055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35ba24c1-b784-442f-94ab-8ceeb72f8f1e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:32.458466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35ba24c1-b784-442f-94ab-8ceeb72f8f1e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:32.484506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bfef1a88-e2c3-46b9-9e1c-f083f6e90cc2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:32.495673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bfef1a88-e2c3-46b9-9e1c-f083f6e90cc2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.176794 Sep 05 17:02:32.496283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 83/166] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:32 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:32.606474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-35ba24c1-b784-442f-94ab-8ceeb72f8f1e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:32.615659 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-35ba24c1-b784-442f-94ab-8ceeb72f8f1e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.173446 Sep 05 17:02:32.616272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 84/167] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:32 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:02:32.939765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-847c0a35-9687-4c7c-a9af-8035d7185cc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:32.940522 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-847c0a35-9687-4c7c-a9af-8035d7185cc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:32.946946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-847c0a35-9687-4c7c-a9af-8035d7185cc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:32.947509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-847c0a35-9687-4c7c-a9af-8035d7185cc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:32.948046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-847c0a35-9687-4c7c-a9af-8035d7185cc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:32.948768 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-847c0a35-9687-4c7c-a9af-8035d7185cc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:32.949227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-847c0a35-9687-4c7c-a9af-8035d7185cc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:32.949643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-847c0a35-9687-4c7c-a9af-8035d7185cc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:33.079315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-847c0a35-9687-4c7c-a9af-8035d7185cc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:33.087770 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-847c0a35-9687-4c7c-a9af-8035d7185cc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:33.089267 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-847c0a35-9687-4c7c-a9af-8035d7185cc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:33.090367 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-847c0a35-9687-4c7c-a9af-8035d7185cc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.155280 Sep 05 17:02:33.090919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 84/168] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:32 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:33.521471 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2443bbf7-8120-4772-9df7-21a5d016132a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:33.522127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2443bbf7-8120-4772-9df7-21a5d016132a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:33.524464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=75 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:02:33.530841 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2443bbf7-8120-4772-9df7-21a5d016132a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:33.531393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2443bbf7-8120-4772-9df7-21a5d016132a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:33.531885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2443bbf7-8120-4772-9df7-21a5d016132a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:33.532711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2443bbf7-8120-4772-9df7-21a5d016132a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:33.533234 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2443bbf7-8120-4772-9df7-21a5d016132a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:33.533714 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2443bbf7-8120-4772-9df7-21a5d016132a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:33.638912 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-89dc6f53-0692-46bb-87f0-3f59eaec42ba tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:33.639502 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-89dc6f53-0692-46bb-87f0-3f59eaec42ba tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:33.646657 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89dc6f53-0692-46bb-87f0-3f59eaec42ba tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:33.647147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89dc6f53-0692-46bb-87f0-3f59eaec42ba tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:33.647566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89dc6f53-0692-46bb-87f0-3f59eaec42ba tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:33.648361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89dc6f53-0692-46bb-87f0-3f59eaec42ba tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:33.648812 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89dc6f53-0692-46bb-87f0-3f59eaec42ba tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:33.649232 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89dc6f53-0692-46bb-87f0-3f59eaec42ba tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:33.670284 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2443bbf7-8120-4772-9df7-21a5d016132a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:33.680457 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2443bbf7-8120-4772-9df7-21a5d016132a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.163836 Sep 05 17:02:33.681042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 85/169] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:33 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:33.791716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-89dc6f53-0692-46bb-87f0-3f59eaec42ba tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:33.799436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-89dc6f53-0692-46bb-87f0-3f59eaec42ba tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.165737 Sep 05 17:02:33.799998 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 85/170] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:33 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:34.118000 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-80315105-a317-42aa-ac65-8c08fc8988ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:34.118700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-80315105-a317-42aa-ac65-8c08fc8988ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:34.126928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80315105-a317-42aa-ac65-8c08fc8988ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:34.127583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80315105-a317-42aa-ac65-8c08fc8988ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:34.128186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80315105-a317-42aa-ac65-8c08fc8988ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:34.129111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80315105-a317-42aa-ac65-8c08fc8988ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:34.129713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80315105-a317-42aa-ac65-8c08fc8988ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:34.130270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80315105-a317-42aa-ac65-8c08fc8988ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:34.268009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-80315105-a317-42aa-ac65-8c08fc8988ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:34.276830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-80315105-a317-42aa-ac65-8c08fc8988ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:34.278289 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-80315105-a317-42aa-ac65-8c08fc8988ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:34.279399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-80315105-a317-42aa-ac65-8c08fc8988ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.166950 Sep 05 17:02:34.279985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 86/171] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:34 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:34.708933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6a67d0f1-d2b8-427f-a678-ba5c1e719dad tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:34.709765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6a67d0f1-d2b8-427f-a678-ba5c1e719dad tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:34.720231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a67d0f1-d2b8-427f-a678-ba5c1e719dad tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:34.720721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a67d0f1-d2b8-427f-a678-ba5c1e719dad tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:34.721152 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a67d0f1-d2b8-427f-a678-ba5c1e719dad tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:34.721837 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a67d0f1-d2b8-427f-a678-ba5c1e719dad tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:34.722281 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a67d0f1-d2b8-427f-a678-ba5c1e719dad tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:34.722699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a67d0f1-d2b8-427f-a678-ba5c1e719dad tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:34.821795 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4f1023de-cae6-44de-b549-c7235d00b42c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:34.822422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4f1023de-cae6-44de-b549-c7235d00b42c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:34.828631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f1023de-cae6-44de-b549-c7235d00b42c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:34.829483 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f1023de-cae6-44de-b549-c7235d00b42c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:34.830084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f1023de-cae6-44de-b549-c7235d00b42c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:34.830786 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f1023de-cae6-44de-b549-c7235d00b42c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:34.831209 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f1023de-cae6-44de-b549-c7235d00b42c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:34.831783 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f1023de-cae6-44de-b549-c7235d00b42c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:34.858156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6a67d0f1-d2b8-427f-a678-ba5c1e719dad tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:34.865950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6a67d0f1-d2b8-427f-a678-ba5c1e719dad tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.164196 Sep 05 17:02:34.866612 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 86/172] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:34 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:34.960766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4f1023de-cae6-44de-b549-c7235d00b42c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:34.968313 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4f1023de-cae6-44de-b549-c7235d00b42c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.150430 Sep 05 17:02:34.968882 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 87/173] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:34 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:35.305465 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f1f33f4c-5199-4d1f-bd45-47b216ac06ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:35.305971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f1f33f4c-5199-4d1f-bd45-47b216ac06ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:35.312731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1f33f4c-5199-4d1f-bd45-47b216ac06ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:35.313211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1f33f4c-5199-4d1f-bd45-47b216ac06ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:35.313883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1f33f4c-5199-4d1f-bd45-47b216ac06ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:35.314999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1f33f4c-5199-4d1f-bd45-47b216ac06ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:35.315452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1f33f4c-5199-4d1f-bd45-47b216ac06ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:35.315871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1f33f4c-5199-4d1f-bd45-47b216ac06ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:35.464008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f1f33f4c-5199-4d1f-bd45-47b216ac06ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:35.472504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f1f33f4c-5199-4d1f-bd45-47b216ac06ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:35.473937 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f1f33f4c-5199-4d1f-bd45-47b216ac06ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:35.475019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f1f33f4c-5199-4d1f-bd45-47b216ac06ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.174045 Sep 05 17:02:35.475590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 87/174] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:35 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:35.888418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-95bad899-4081-4e03-8011-e787fd1166c1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:35.889015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-95bad899-4081-4e03-8011-e787fd1166c1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:35.895362 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95bad899-4081-4e03-8011-e787fd1166c1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:35.895840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95bad899-4081-4e03-8011-e787fd1166c1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:35.896298 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95bad899-4081-4e03-8011-e787fd1166c1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:35.897054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95bad899-4081-4e03-8011-e787fd1166c1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:35.897505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95bad899-4081-4e03-8011-e787fd1166c1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:35.897918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95bad899-4081-4e03-8011-e787fd1166c1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:35.990823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8d9a448e-b358-487c-912c-ef5ee59171b7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:35.992257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8d9a448e-b358-487c-912c-ef5ee59171b7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:35.999640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d9a448e-b358-487c-912c-ef5ee59171b7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:36.000122 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d9a448e-b358-487c-912c-ef5ee59171b7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:36.000572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d9a448e-b358-487c-912c-ef5ee59171b7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:36.001261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d9a448e-b358-487c-912c-ef5ee59171b7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:36.002042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d9a448e-b358-487c-912c-ef5ee59171b7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:36.002460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d9a448e-b358-487c-912c-ef5ee59171b7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:36.033255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-95bad899-4081-4e03-8011-e787fd1166c1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:36.041248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-95bad899-4081-4e03-8011-e787fd1166c1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.156796 Sep 05 17:02:36.041786 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 88/175] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:35 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:36.134962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8d9a448e-b358-487c-912c-ef5ee59171b7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:36.143599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8d9a448e-b358-487c-912c-ef5ee59171b7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.157382 Sep 05 17:02:36.144273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 88/176] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:35 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:02:36.503785 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a2842c00-e266-4e6f-8cd3-cf20687bcda7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:36.504430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a2842c00-e266-4e6f-8cd3-cf20687bcda7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:36.510745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2842c00-e266-4e6f-8cd3-cf20687bcda7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:36.511227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2842c00-e266-4e6f-8cd3-cf20687bcda7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:36.511655 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2842c00-e266-4e6f-8cd3-cf20687bcda7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:36.512379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2842c00-e266-4e6f-8cd3-cf20687bcda7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:36.512830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2842c00-e266-4e6f-8cd3-cf20687bcda7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:36.513247 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2842c00-e266-4e6f-8cd3-cf20687bcda7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:36.532306 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:02:36.646555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a2842c00-e266-4e6f-8cd3-cf20687bcda7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:36.654880 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a2842c00-e266-4e6f-8cd3-cf20687bcda7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:36.656369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a2842c00-e266-4e6f-8cd3-cf20687bcda7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:36.657482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a2842c00-e266-4e6f-8cd3-cf20687bcda7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.159579 Sep 05 17:02:36.658083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 89/177] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:36 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:37.065255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-106ba2f2-06f1-407f-a6fe-d77e1a649774 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:37.065986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-106ba2f2-06f1-407f-a6fe-d77e1a649774 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:37.072300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-106ba2f2-06f1-407f-a6fe-d77e1a649774 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:37.072796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-106ba2f2-06f1-407f-a6fe-d77e1a649774 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:37.073256 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-106ba2f2-06f1-407f-a6fe-d77e1a649774 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:37.074015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-106ba2f2-06f1-407f-a6fe-d77e1a649774 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:37.074479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-106ba2f2-06f1-407f-a6fe-d77e1a649774 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:37.074887 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-106ba2f2-06f1-407f-a6fe-d77e1a649774 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:37.169088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d033f884-47b7-4a8f-ada5-905c10454a50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:37.169795 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d033f884-47b7-4a8f-ada5-905c10454a50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:37.176723 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d033f884-47b7-4a8f-ada5-905c10454a50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:37.177312 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d033f884-47b7-4a8f-ada5-905c10454a50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:37.177826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d033f884-47b7-4a8f-ada5-905c10454a50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:37.178622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d033f884-47b7-4a8f-ada5-905c10454a50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:37.179304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d033f884-47b7-4a8f-ada5-905c10454a50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:37.179803 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d033f884-47b7-4a8f-ada5-905c10454a50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:37.234473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-106ba2f2-06f1-407f-a6fe-d77e1a649774 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:37.242578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-106ba2f2-06f1-407f-a6fe-d77e1a649774 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.181385 Sep 05 17:02:37.243185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 89/178] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:37 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:37.320541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d033f884-47b7-4a8f-ada5-905c10454a50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:37.328640 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d033f884-47b7-4a8f-ada5-905c10454a50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.163860 Sep 05 17:02:37.329241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 90/179] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:37 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:37.684699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-58f98252-b2c6-41d8-8ae9-bf0fafaf3305 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:37.685584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-58f98252-b2c6-41d8-8ae9-bf0fafaf3305 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:37.694180 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58f98252-b2c6-41d8-8ae9-bf0fafaf3305 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:37.694820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58f98252-b2c6-41d8-8ae9-bf0fafaf3305 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:37.695394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58f98252-b2c6-41d8-8ae9-bf0fafaf3305 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:37.696345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58f98252-b2c6-41d8-8ae9-bf0fafaf3305 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:37.696944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58f98252-b2c6-41d8-8ae9-bf0fafaf3305 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:37.697501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58f98252-b2c6-41d8-8ae9-bf0fafaf3305 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:37.965082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-58f98252-b2c6-41d8-8ae9-bf0fafaf3305 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:37.975219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-58f98252-b2c6-41d8-8ae9-bf0fafaf3305 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:37.976858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-58f98252-b2c6-41d8-8ae9-bf0fafaf3305 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:37.978427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-58f98252-b2c6-41d8-8ae9-bf0fafaf3305 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.299240 Sep 05 17:02:37.979096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 90/180] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:37 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:38.269094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0163a284-d28f-47e9-be29-007787d11000 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:38.269883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0163a284-d28f-47e9-be29-007787d11000 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:38.278420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0163a284-d28f-47e9-be29-007787d11000 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:38.281808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0163a284-d28f-47e9-be29-007787d11000 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:38.282484 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0163a284-d28f-47e9-be29-007787d11000 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:38.285857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0163a284-d28f-47e9-be29-007787d11000 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:38.286479 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0163a284-d28f-47e9-be29-007787d11000 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:38.287193 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0163a284-d28f-47e9-be29-007787d11000 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:38.368834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-757ded6a-4c00-4087-a16e-33f05b2dcbbb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:38.370547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-757ded6a-4c00-4087-a16e-33f05b2dcbbb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:38.388362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-757ded6a-4c00-4087-a16e-33f05b2dcbbb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:38.389079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-757ded6a-4c00-4087-a16e-33f05b2dcbbb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:38.389666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-757ded6a-4c00-4087-a16e-33f05b2dcbbb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:38.390530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-757ded6a-4c00-4087-a16e-33f05b2dcbbb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:38.391121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-757ded6a-4c00-4087-a16e-33f05b2dcbbb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:38.391923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-757ded6a-4c00-4087-a16e-33f05b2dcbbb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:38.811623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0163a284-d28f-47e9-be29-007787d11000 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:38.820566 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0163a284-d28f-47e9-be29-007787d11000 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.557788 Sep 05 17:02:38.821251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 91/181] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:38 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:38.826280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-757ded6a-4c00-4087-a16e-33f05b2dcbbb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:38.835018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-757ded6a-4c00-4087-a16e-33f05b2dcbbb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.485072 Sep 05 17:02:38.835655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 91/182] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:38 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:39.011484 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-bcc25321-4412-4391-8316-19fb3440687d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:39.012458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-bcc25321-4412-4391-8316-19fb3440687d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:39.028833 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bcc25321-4412-4391-8316-19fb3440687d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:39.029313 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bcc25321-4412-4391-8316-19fb3440687d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:39.029744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bcc25321-4412-4391-8316-19fb3440687d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:39.030444 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bcc25321-4412-4391-8316-19fb3440687d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:39.030894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bcc25321-4412-4391-8316-19fb3440687d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:39.031298 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bcc25321-4412-4391-8316-19fb3440687d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:39.188763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bcc25321-4412-4391-8316-19fb3440687d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:39.198944 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bcc25321-4412-4391-8316-19fb3440687d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:39.200691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bcc25321-4412-4391-8316-19fb3440687d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:39.202139 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-bcc25321-4412-4391-8316-19fb3440687d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.198669 Sep 05 17:02:39.202886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 92/183] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:39 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:39.847847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-82273e9d-3051-4440-87eb-a448946ca7bd tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:39.848890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-82273e9d-3051-4440-87eb-a448946ca7bd tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:39.859007 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82273e9d-3051-4440-87eb-a448946ca7bd tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:39.859798 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82273e9d-3051-4440-87eb-a448946ca7bd tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:39.860583 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82273e9d-3051-4440-87eb-a448946ca7bd tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:39.861711 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82273e9d-3051-4440-87eb-a448946ca7bd tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:39.861959 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f41d220e-eb59-4e03-8cd6-fedfabc3fc80 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:39.862370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82273e9d-3051-4440-87eb-a448946ca7bd tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:39.862633 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f41d220e-eb59-4e03-8cd6-fedfabc3fc80 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:39.862773 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82273e9d-3051-4440-87eb-a448946ca7bd tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:39.869175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f41d220e-eb59-4e03-8cd6-fedfabc3fc80 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:39.869823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f41d220e-eb59-4e03-8cd6-fedfabc3fc80 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:39.870246 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f41d220e-eb59-4e03-8cd6-fedfabc3fc80 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:39.870925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f41d220e-eb59-4e03-8cd6-fedfabc3fc80 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:39.871368 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f41d220e-eb59-4e03-8cd6-fedfabc3fc80 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:39.871782 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f41d220e-eb59-4e03-8cd6-fedfabc3fc80 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:40.054863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-82273e9d-3051-4440-87eb-a448946ca7bd tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:40.057863 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f41d220e-eb59-4e03-8cd6-fedfabc3fc80 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:40.062847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-82273e9d-3051-4440-87eb-a448946ca7bd tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.221435 Sep 05 17:02:40.063407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 92/184] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:39 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:40.065804 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f41d220e-eb59-4e03-8cd6-fedfabc3fc80 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.210309 Sep 05 17:02:40.066370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 93/185] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:39 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:02:40.231591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-89ccb441-60e9-4953-b7be-a78918b24503 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:40.232541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-89ccb441-60e9-4953-b7be-a78918b24503 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:40.242767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89ccb441-60e9-4953-b7be-a78918b24503 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:40.243559 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89ccb441-60e9-4953-b7be-a78918b24503 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:40.244366 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89ccb441-60e9-4953-b7be-a78918b24503 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:40.245527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89ccb441-60e9-4953-b7be-a78918b24503 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:40.246265 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89ccb441-60e9-4953-b7be-a78918b24503 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:40.246950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89ccb441-60e9-4953-b7be-a78918b24503 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:40.405595 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-89ccb441-60e9-4953-b7be-a78918b24503 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:40.414657 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-89ccb441-60e9-4953-b7be-a78918b24503 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:40.416083 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-89ccb441-60e9-4953-b7be-a78918b24503 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:40.417218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-89ccb441-60e9-4953-b7be-a78918b24503 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.192761 Sep 05 17:02:40.417770 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 93/186] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:40 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:41.088661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ee457cd6-7e1a-4fd3-8883-358ba959fd5c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:41.089448 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ee457cd6-7e1a-4fd3-8883-358ba959fd5c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:41.090143 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0d701b9e-9041-437f-ad42-d53c01f4866b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:41.090947 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0d701b9e-9041-437f-ad42-d53c01f4866b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:41.097378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee457cd6-7e1a-4fd3-8883-358ba959fd5c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:41.097888 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee457cd6-7e1a-4fd3-8883-358ba959fd5c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:41.098313 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee457cd6-7e1a-4fd3-8883-358ba959fd5c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:41.098996 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee457cd6-7e1a-4fd3-8883-358ba959fd5c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:41.099148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d701b9e-9041-437f-ad42-d53c01f4866b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:41.099467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee457cd6-7e1a-4fd3-8883-358ba959fd5c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:41.099621 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d701b9e-9041-437f-ad42-d53c01f4866b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:41.099882 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee457cd6-7e1a-4fd3-8883-358ba959fd5c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:41.100033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d701b9e-9041-437f-ad42-d53c01f4866b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:41.100608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d701b9e-9041-437f-ad42-d53c01f4866b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:41.101056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d701b9e-9041-437f-ad42-d53c01f4866b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:41.101474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d701b9e-9041-437f-ad42-d53c01f4866b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:41.291370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ee457cd6-7e1a-4fd3-8883-358ba959fd5c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:41.294634 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0d701b9e-9041-437f-ad42-d53c01f4866b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:41.299277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ee457cd6-7e1a-4fd3-8883-358ba959fd5c tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.216087 Sep 05 17:02:41.299850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 94/187] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:41 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:41.303163 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0d701b9e-9041-437f-ad42-d53c01f4866b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.218148 Sep 05 17:02:41.303742 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 94/188] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:41 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:41.441436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3dffccaa-41e2-4342-b199-e39fc3e46c43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:41.442034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3dffccaa-41e2-4342-b199-e39fc3e46c43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:41.448601 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dffccaa-41e2-4342-b199-e39fc3e46c43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:41.449075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dffccaa-41e2-4342-b199-e39fc3e46c43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:41.449491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dffccaa-41e2-4342-b199-e39fc3e46c43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:41.450162 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dffccaa-41e2-4342-b199-e39fc3e46c43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:41.450603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dffccaa-41e2-4342-b199-e39fc3e46c43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:41.451011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dffccaa-41e2-4342-b199-e39fc3e46c43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:41.594140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3dffccaa-41e2-4342-b199-e39fc3e46c43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:41.603620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3dffccaa-41e2-4342-b199-e39fc3e46c43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:41.605079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3dffccaa-41e2-4342-b199-e39fc3e46c43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:41.606206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3dffccaa-41e2-4342-b199-e39fc3e46c43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.168823 Sep 05 17:02:41.606749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 95/189] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:41 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:42.323415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-19c4842b-6e93-4346-b8bf-e6cee15fb558 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:42.324059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-19c4842b-6e93-4346-b8bf-e6cee15fb558 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:42.326270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1e03e15e-703a-42d3-a947-7a6c0d1b4dd6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:42.326938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1e03e15e-703a-42d3-a947-7a6c0d1b4dd6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:42.331358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19c4842b-6e93-4346-b8bf-e6cee15fb558 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:42.331923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19c4842b-6e93-4346-b8bf-e6cee15fb558 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:42.332436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19c4842b-6e93-4346-b8bf-e6cee15fb558 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:42.333287 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19c4842b-6e93-4346-b8bf-e6cee15fb558 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:42.333781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19c4842b-6e93-4346-b8bf-e6cee15fb558 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:42.333960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e03e15e-703a-42d3-a947-7a6c0d1b4dd6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:42.334245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19c4842b-6e93-4346-b8bf-e6cee15fb558 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:42.334422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e03e15e-703a-42d3-a947-7a6c0d1b4dd6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:42.334868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e03e15e-703a-42d3-a947-7a6c0d1b4dd6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:42.335597 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e03e15e-703a-42d3-a947-7a6c0d1b4dd6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:42.336077 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e03e15e-703a-42d3-a947-7a6c0d1b4dd6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:42.336587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e03e15e-703a-42d3-a947-7a6c0d1b4dd6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:42.532982 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1e03e15e-703a-42d3-a947-7a6c0d1b4dd6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:42.536403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-19c4842b-6e93-4346-b8bf-e6cee15fb558 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:42.541705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1e03e15e-703a-42d3-a947-7a6c0d1b4dd6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.219639 Sep 05 17:02:42.542253 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 96/190] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:42 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:42.544585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-19c4842b-6e93-4346-b8bf-e6cee15fb558 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.225403 Sep 05 17:02:42.545148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 95/191] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:42 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:42.631325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-446d0a30-39b2-4ebd-9fdd-de9c8df9334c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:42.631919 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-446d0a30-39b2-4ebd-9fdd-de9c8df9334c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:42.638109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-446d0a30-39b2-4ebd-9fdd-de9c8df9334c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:42.638582 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-446d0a30-39b2-4ebd-9fdd-de9c8df9334c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:42.638998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-446d0a30-39b2-4ebd-9fdd-de9c8df9334c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:42.639671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-446d0a30-39b2-4ebd-9fdd-de9c8df9334c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:42.640111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-446d0a30-39b2-4ebd-9fdd-de9c8df9334c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:42.640554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-446d0a30-39b2-4ebd-9fdd-de9c8df9334c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:42.770527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-446d0a30-39b2-4ebd-9fdd-de9c8df9334c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:42.779202 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-446d0a30-39b2-4ebd-9fdd-de9c8df9334c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:42.780666 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-446d0a30-39b2-4ebd-9fdd-de9c8df9334c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:42.781756 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-446d0a30-39b2-4ebd-9fdd-de9c8df9334c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.154732 Sep 05 17:02:42.782295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 97/192] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:42 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:43.565694 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-46f28ed3-5485-4c82-8232-fd21e24baf20 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:43.566860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3b1946f1-1861-46a7-948e-0864205aa4b8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:43.567307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-46f28ed3-5485-4c82-8232-fd21e24baf20 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:43.567564 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3b1946f1-1861-46a7-948e-0864205aa4b8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:43.574815 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b1946f1-1861-46a7-948e-0864205aa4b8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:43.575589 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b1946f1-1861-46a7-948e-0864205aa4b8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:43.576505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b1946f1-1861-46a7-948e-0864205aa4b8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:43.577165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b1946f1-1861-46a7-948e-0864205aa4b8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:43.577494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46f28ed3-5485-4c82-8232-fd21e24baf20 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:43.577781 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b1946f1-1861-46a7-948e-0864205aa4b8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:43.578119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46f28ed3-5485-4c82-8232-fd21e24baf20 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:43.578642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b1946f1-1861-46a7-948e-0864205aa4b8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:43.578920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46f28ed3-5485-4c82-8232-fd21e24baf20 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:43.579936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46f28ed3-5485-4c82-8232-fd21e24baf20 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:43.580530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46f28ed3-5485-4c82-8232-fd21e24baf20 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:43.581060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46f28ed3-5485-4c82-8232-fd21e24baf20 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:43.793700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3b1946f1-1861-46a7-948e-0864205aa4b8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:43.799974 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-46f28ed3-5485-4c82-8232-fd21e24baf20 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:43.801888 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3b1946f1-1861-46a7-948e-0864205aa4b8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.238972 Sep 05 17:02:43.802468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 98/193] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:43 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:43.810489 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-46f28ed3-5485-4c82-8232-fd21e24baf20 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.249757 Sep 05 17:02:43.822132 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-de8a7987-f0ce-4313-a21b-8ee9ed084e34 req-180f5fd4-cc87-467b-8fcd-8e5cd109bf0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f618fb-422b-4e8b-b55d-634720b8646c", "name": "network-vif-plugged", "status": "completed", "tag": "fc6aadfe-bed1-4d6d-ae24-330d4a9efe98"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:02:43.827026 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 96/194] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:43 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:43.831886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-de8a7987-f0ce-4313-a21b-8ee9ed084e34 req-180f5fd4-cc87-467b-8fcd-8e5cd109bf0a service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:43.832422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-adc0eb58-6350-4b11-b8da-d66d9218746a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:43.832985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-de8a7987-f0ce-4313-a21b-8ee9ed084e34 req-180f5fd4-cc87-467b-8fcd-8e5cd109bf0a service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:43.832985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-de8a7987-f0ce-4313-a21b-8ee9ed084e34 req-180f5fd4-cc87-467b-8fcd-8e5cd109bf0a service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:43.833823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-adc0eb58-6350-4b11-b8da-d66d9218746a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:43.840288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adc0eb58-6350-4b11-b8da-d66d9218746a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:43.841261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adc0eb58-6350-4b11-b8da-d66d9218746a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:43.841714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adc0eb58-6350-4b11-b8da-d66d9218746a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:43.842596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adc0eb58-6350-4b11-b8da-d66d9218746a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:43.842856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adc0eb58-6350-4b11-b8da-d66d9218746a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:43.843269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adc0eb58-6350-4b11-b8da-d66d9218746a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:43.845225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-de8a7987-f0ce-4313-a21b-8ee9ed084e34 req-180f5fd4-cc87-467b-8fcd-8e5cd109bf0a service nova] Creating event network-vif-plugged:fc6aadfe-bed1-4d6d-ae24-330d4a9efe98 for instance a7f618fb-422b-4e8b-b55d-634720b8646c on hv-cinder-85596 Sep 05 17:02:43.850583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-de8a7987-f0ce-4313-a21b-8ee9ed084e34 req-180f5fd4-cc87-467b-8fcd-8e5cd109bf0a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032953 Sep 05 17:02:43.851185 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 99/195] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:02:43.864971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:02:44.014971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-adc0eb58-6350-4b11-b8da-d66d9218746a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:44.024771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-adc0eb58-6350-4b11-b8da-d66d9218746a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:44.027085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-adc0eb58-6350-4b11-b8da-d66d9218746a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:44.028928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-adc0eb58-6350-4b11-b8da-d66d9218746a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.200860 Sep 05 17:02:44.032369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 97/196] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:43 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:44.829754 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-eafb88ea-1d13-4a31-9739-e6ad3dc35413 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:44.830654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-eafb88ea-1d13-4a31-9739-e6ad3dc35413 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:44.835199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-49633474-9aac-46f0-a80b-7e9cacf98604 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:44.835780 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-49633474-9aac-46f0-a80b-7e9cacf98604 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:44.837396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eafb88ea-1d13-4a31-9739-e6ad3dc35413 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:44.837878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eafb88ea-1d13-4a31-9739-e6ad3dc35413 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:44.838307 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eafb88ea-1d13-4a31-9739-e6ad3dc35413 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:44.838999 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eafb88ea-1d13-4a31-9739-e6ad3dc35413 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:44.839451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eafb88ea-1d13-4a31-9739-e6ad3dc35413 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:44.839855 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eafb88ea-1d13-4a31-9739-e6ad3dc35413 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:44.842068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49633474-9aac-46f0-a80b-7e9cacf98604 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:44.842549 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49633474-9aac-46f0-a80b-7e9cacf98604 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:44.842972 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49633474-9aac-46f0-a80b-7e9cacf98604 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:44.843656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49633474-9aac-46f0-a80b-7e9cacf98604 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:44.844389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49633474-9aac-46f0-a80b-7e9cacf98604 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:44.844948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49633474-9aac-46f0-a80b-7e9cacf98604 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:45.060110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-eafb88ea-1d13-4a31-9739-e6ad3dc35413 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:45.062716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-49633474-9aac-46f0-a80b-7e9cacf98604 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:45.069754 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-eafb88ea-1d13-4a31-9739-e6ad3dc35413 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.244431 Sep 05 17:02:45.070378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 100/197] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:44 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:45.071539 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-49633474-9aac-46f0-a80b-7e9cacf98604 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.240716 Sep 05 17:02:45.074901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 98/198] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:44 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:45.078004 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fa8e6cbd-d21d-45b8-81cd-947d8d818fa6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:45.078666 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fa8e6cbd-d21d-45b8-81cd-947d8d818fa6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:45.086240 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa8e6cbd-d21d-45b8-81cd-947d8d818fa6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:45.086714 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa8e6cbd-d21d-45b8-81cd-947d8d818fa6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:45.087138 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa8e6cbd-d21d-45b8-81cd-947d8d818fa6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:45.087823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa8e6cbd-d21d-45b8-81cd-947d8d818fa6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:45.088292 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa8e6cbd-d21d-45b8-81cd-947d8d818fa6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:45.088701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa8e6cbd-d21d-45b8-81cd-947d8d818fa6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:45.227937 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fa8e6cbd-d21d-45b8-81cd-947d8d818fa6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:45.236043 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fa8e6cbd-d21d-45b8-81cd-947d8d818fa6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:45.237517 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fa8e6cbd-d21d-45b8-81cd-947d8d818fa6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:45.238734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fa8e6cbd-d21d-45b8-81cd-947d8d818fa6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.167069 Sep 05 17:02:45.239535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 101/199] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:45 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:46.092947 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d8139ecc-4263-49ca-9ae3-f7eb0adede28 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:46.093559 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d8139ecc-4263-49ca-9ae3-f7eb0adede28 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:46.095148 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-84ac7680-a08d-401a-8308-61c3d4437c7b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:46.096343 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-84ac7680-a08d-401a-8308-61c3d4437c7b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:46.100284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8139ecc-4263-49ca-9ae3-f7eb0adede28 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:46.100769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8139ecc-4263-49ca-9ae3-f7eb0adede28 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:46.101196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8139ecc-4263-49ca-9ae3-f7eb0adede28 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:46.101894 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8139ecc-4263-49ca-9ae3-f7eb0adede28 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:46.102675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8139ecc-4263-49ca-9ae3-f7eb0adede28 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:46.103088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8139ecc-4263-49ca-9ae3-f7eb0adede28 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:46.103881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84ac7680-a08d-401a-8308-61c3d4437c7b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:46.104486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84ac7680-a08d-401a-8308-61c3d4437c7b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:46.104979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84ac7680-a08d-401a-8308-61c3d4437c7b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:46.105734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84ac7680-a08d-401a-8308-61c3d4437c7b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:46.106348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84ac7680-a08d-401a-8308-61c3d4437c7b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:46.106831 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84ac7680-a08d-401a-8308-61c3d4437c7b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:46.347374 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d8139ecc-4263-49ca-9ae3-f7eb0adede28 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:46.352896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-84ac7680-a08d-401a-8308-61c3d4437c7b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:46.359949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d8139ecc-4263-49ca-9ae3-f7eb0adede28 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.270809 Sep 05 17:02:46.360568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 99/200] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:46 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:46.360909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-84ac7680-a08d-401a-8308-61c3d4437c7b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.269901 Sep 05 17:02:46.372377 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 102/201] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:46 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:46.372571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-77a057a5-3d51-45c5-a0c7-b21857cc0bda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:46.372571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-77a057a5-3d51-45c5-a0c7-b21857cc0bda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:46.378619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77a057a5-3d51-45c5-a0c7-b21857cc0bda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:46.378619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77a057a5-3d51-45c5-a0c7-b21857cc0bda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:46.378619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77a057a5-3d51-45c5-a0c7-b21857cc0bda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:46.378619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77a057a5-3d51-45c5-a0c7-b21857cc0bda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:46.379342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77a057a5-3d51-45c5-a0c7-b21857cc0bda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:46.379342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77a057a5-3d51-45c5-a0c7-b21857cc0bda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:46.543181 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-77a057a5-3d51-45c5-a0c7-b21857cc0bda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:46.552915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-77a057a5-3d51-45c5-a0c7-b21857cc0bda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:46.554923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-77a057a5-3d51-45c5-a0c7-b21857cc0bda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:46.556823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-77a057a5-3d51-45c5-a0c7-b21857cc0bda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.194858 Sep 05 17:02:46.557783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 100/202] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:46 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:47.387914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-46e63423-43bc-4aa9-a8a9-a48ddd47e11e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:47.388476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c8322442-867e-4efd-a86f-5b8943b0471b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:47.388835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-46e63423-43bc-4aa9-a8a9-a48ddd47e11e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:47.389386 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c8322442-867e-4efd-a86f-5b8943b0471b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:47.396829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46e63423-43bc-4aa9-a8a9-a48ddd47e11e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:47.397107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8322442-867e-4efd-a86f-5b8943b0471b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:47.397267 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46e63423-43bc-4aa9-a8a9-a48ddd47e11e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:47.397703 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46e63423-43bc-4aa9-a8a9-a48ddd47e11e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:47.397844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8322442-867e-4efd-a86f-5b8943b0471b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:47.398140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8322442-867e-4efd-a86f-5b8943b0471b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:47.398387 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46e63423-43bc-4aa9-a8a9-a48ddd47e11e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:47.398827 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46e63423-43bc-4aa9-a8a9-a48ddd47e11e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:47.398974 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8322442-867e-4efd-a86f-5b8943b0471b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:47.399237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46e63423-43bc-4aa9-a8a9-a48ddd47e11e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:47.399375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8322442-867e-4efd-a86f-5b8943b0471b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:47.399683 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8322442-867e-4efd-a86f-5b8943b0471b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:47.608624 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-46e63423-43bc-4aa9-a8a9-a48ddd47e11e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:47.612785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c8322442-867e-4efd-a86f-5b8943b0471b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:47.617179 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-46e63423-43bc-4aa9-a8a9-a48ddd47e11e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.235111 Sep 05 17:02:47.617731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 103/203] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:47 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:47.620539 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c8322442-867e-4efd-a86f-5b8943b0471b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.237982 Sep 05 17:02:47.621132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 101/204] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:47 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:47.622212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-76571a63-6e65-4d61-b47c-41fd99232076 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:47.622808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-76571a63-6e65-4d61-b47c-41fd99232076 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:47.628716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-76571a63-6e65-4d61-b47c-41fd99232076 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:47.629176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-76571a63-6e65-4d61-b47c-41fd99232076 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:47.629734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-76571a63-6e65-4d61-b47c-41fd99232076 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:47.630409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-76571a63-6e65-4d61-b47c-41fd99232076 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:47.630870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-76571a63-6e65-4d61-b47c-41fd99232076 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:47.631263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-76571a63-6e65-4d61-b47c-41fd99232076 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:47.778455 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-76571a63-6e65-4d61-b47c-41fd99232076 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:47.786981 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-76571a63-6e65-4d61-b47c-41fd99232076 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:47.788453 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-76571a63-6e65-4d61-b47c-41fd99232076 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:47.789559 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-76571a63-6e65-4d61-b47c-41fd99232076 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.170887 Sep 05 17:02:47.790105 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 104/205] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:47 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:48.640435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f9f08bbf-d7aa-4413-acd4-c534e050eee8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:48.641035 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f9f08bbf-d7aa-4413-acd4-c534e050eee8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:48.642885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d2f3dae1-63db-4439-97cc-583755088558 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:48.643530 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d2f3dae1-63db-4439-97cc-583755088558 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:48.647854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f08bbf-d7aa-4413-acd4-c534e050eee8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:48.648368 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f08bbf-d7aa-4413-acd4-c534e050eee8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:48.648878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f08bbf-d7aa-4413-acd4-c534e050eee8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:48.649573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f08bbf-d7aa-4413-acd4-c534e050eee8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:48.650031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f08bbf-d7aa-4413-acd4-c534e050eee8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:48.650158 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2f3dae1-63db-4439-97cc-583755088558 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:48.650427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f08bbf-d7aa-4413-acd4-c534e050eee8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:48.650530 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2f3dae1-63db-4439-97cc-583755088558 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:48.651039 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2f3dae1-63db-4439-97cc-583755088558 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:48.651634 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2f3dae1-63db-4439-97cc-583755088558 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:48.652078 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2f3dae1-63db-4439-97cc-583755088558 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:48.652522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2f3dae1-63db-4439-97cc-583755088558 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:48.842297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f9f08bbf-d7aa-4413-acd4-c534e050eee8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:48.844559 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d2f3dae1-63db-4439-97cc-583755088558 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:48.850149 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f9f08bbf-d7aa-4413-acd4-c534e050eee8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.213662 Sep 05 17:02:48.851009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 102/206] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:48 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:48.852962 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d2f3dae1-63db-4439-97cc-583755088558 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.213867 Sep 05 17:02:48.853669 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 105/207] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:48 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:48.855771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8de79b6a-da5b-43cc-830f-1d50a2b47f4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:48.856405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8de79b6a-da5b-43cc-830f-1d50a2b47f4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:48.862301 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8de79b6a-da5b-43cc-830f-1d50a2b47f4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:48.862928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8de79b6a-da5b-43cc-830f-1d50a2b47f4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:48.863350 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8de79b6a-da5b-43cc-830f-1d50a2b47f4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:48.864033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8de79b6a-da5b-43cc-830f-1d50a2b47f4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:48.864524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8de79b6a-da5b-43cc-830f-1d50a2b47f4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:48.864998 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8de79b6a-da5b-43cc-830f-1d50a2b47f4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:49.009409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8de79b6a-da5b-43cc-830f-1d50a2b47f4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:49.021766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8de79b6a-da5b-43cc-830f-1d50a2b47f4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:49.023216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8de79b6a-da5b-43cc-830f-1d50a2b47f4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:49.024393 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8de79b6a-da5b-43cc-830f-1d50a2b47f4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.172409 Sep 05 17:02:49.024956 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 103/208] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:48 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:49.873273 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1a1e3f88-ee48-4180-a66b-8396df488d34 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:49.874502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1a1e3f88-ee48-4180-a66b-8396df488d34 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:49.876417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-011eafcc-5643-44f8-8874-a514a9d2da13 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:49.877030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-011eafcc-5643-44f8-8874-a514a9d2da13 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:49.881784 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a1e3f88-ee48-4180-a66b-8396df488d34 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:49.882489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a1e3f88-ee48-4180-a66b-8396df488d34 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:49.883134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a1e3f88-ee48-4180-a66b-8396df488d34 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:49.884206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a1e3f88-ee48-4180-a66b-8396df488d34 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:49.884850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a1e3f88-ee48-4180-a66b-8396df488d34 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:49.885048 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-011eafcc-5643-44f8-8874-a514a9d2da13 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:49.885539 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a1e3f88-ee48-4180-a66b-8396df488d34 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:49.885726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-011eafcc-5643-44f8-8874-a514a9d2da13 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:49.886161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-011eafcc-5643-44f8-8874-a514a9d2da13 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:49.886854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-011eafcc-5643-44f8-8874-a514a9d2da13 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:49.887301 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-011eafcc-5643-44f8-8874-a514a9d2da13 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:49.887858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-011eafcc-5643-44f8-8874-a514a9d2da13 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:50.085504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1a1e3f88-ee48-4180-a66b-8396df488d34 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:50.089077 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:02:50.089238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-011eafcc-5643-44f8-8874-a514a9d2da13 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:50.094197 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1a1e3f88-ee48-4180-a66b-8396df488d34 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.224956 Sep 05 17:02:50.094803 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 106/209] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:49 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:50.097572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-011eafcc-5643-44f8-8874-a514a9d2da13 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.225358 Sep 05 17:02:50.098282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 104/210] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:49 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:50.101508 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6cddf6b7-1d1a-4a8b-8f86-b42fe5839a16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:50.102448 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6cddf6b7-1d1a-4a8b-8f86-b42fe5839a16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:50.108886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6cddf6b7-1d1a-4a8b-8f86-b42fe5839a16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:50.109365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6cddf6b7-1d1a-4a8b-8f86-b42fe5839a16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:50.109806 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6cddf6b7-1d1a-4a8b-8f86-b42fe5839a16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:50.110482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6cddf6b7-1d1a-4a8b-8f86-b42fe5839a16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:50.110920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6cddf6b7-1d1a-4a8b-8f86-b42fe5839a16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:50.111330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6cddf6b7-1d1a-4a8b-8f86-b42fe5839a16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:50.250186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6cddf6b7-1d1a-4a8b-8f86-b42fe5839a16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:50.259214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6cddf6b7-1d1a-4a8b-8f86-b42fe5839a16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:50.260773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6cddf6b7-1d1a-4a8b-8f86-b42fe5839a16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:50.262050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6cddf6b7-1d1a-4a8b-8f86-b42fe5839a16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.165750 Sep 05 17:02:50.263263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 107/211] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:50 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:51.118255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-36b25205-416c-41fd-859f-4443f4e90ed2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:51.119456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-36b25205-416c-41fd-859f-4443f4e90ed2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:51.121237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-88d96da8-1d5c-4047-8b88-e267b5f01b0a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:51.121844 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-88d96da8-1d5c-4047-8b88-e267b5f01b0a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:51.125615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36b25205-416c-41fd-859f-4443f4e90ed2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:51.126093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36b25205-416c-41fd-859f-4443f4e90ed2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:51.126521 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36b25205-416c-41fd-859f-4443f4e90ed2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:51.127189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36b25205-416c-41fd-859f-4443f4e90ed2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:51.127823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36b25205-416c-41fd-859f-4443f4e90ed2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:51.128275 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88d96da8-1d5c-4047-8b88-e267b5f01b0a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:51.128497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36b25205-416c-41fd-859f-4443f4e90ed2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:51.128789 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88d96da8-1d5c-4047-8b88-e267b5f01b0a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:51.129221 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88d96da8-1d5c-4047-8b88-e267b5f01b0a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:51.129876 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88d96da8-1d5c-4047-8b88-e267b5f01b0a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:51.130523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88d96da8-1d5c-4047-8b88-e267b5f01b0a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:51.130952 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88d96da8-1d5c-4047-8b88-e267b5f01b0a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:51.349289 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-88d96da8-1d5c-4047-8b88-e267b5f01b0a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:51.352511 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-36b25205-416c-41fd-859f-4443f4e90ed2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:51.357897 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-88d96da8-1d5c-4047-8b88-e267b5f01b0a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.240427 Sep 05 17:02:51.358476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 108/212] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:51 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:02:51.361000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-36b25205-416c-41fd-859f-4443f4e90ed2 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.247085 Sep 05 17:02:51.361618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 105/213] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:51 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:51.366425 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6ea2c67c-6f71-4d04-97ca-929a6311e6ff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:51.367085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6ea2c67c-6f71-4d04-97ca-929a6311e6ff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:51.373511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ea2c67c-6f71-4d04-97ca-929a6311e6ff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:51.374259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ea2c67c-6f71-4d04-97ca-929a6311e6ff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:51.374876 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ea2c67c-6f71-4d04-97ca-929a6311e6ff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:51.375966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ea2c67c-6f71-4d04-97ca-929a6311e6ff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:51.376527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ea2c67c-6f71-4d04-97ca-929a6311e6ff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:51.376955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ea2c67c-6f71-4d04-97ca-929a6311e6ff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:51.517706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6ea2c67c-6f71-4d04-97ca-929a6311e6ff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:51.526301 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6ea2c67c-6f71-4d04-97ca-929a6311e6ff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:51.527821 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6ea2c67c-6f71-4d04-97ca-929a6311e6ff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:51.529020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6ea2c67c-6f71-4d04-97ca-929a6311e6ff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.166546 Sep 05 17:02:51.529578 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 109/214] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:51 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:52.383482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ef98d88b-23d7-43f6-8116-f2a69f8b4ac7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:52.384682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ef98d88b-23d7-43f6-8116-f2a69f8b4ac7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:52.385671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-56d4f99f-c063-475d-9f69-69fc7e5da820 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:52.386277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-56d4f99f-c063-475d-9f69-69fc7e5da820 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:52.391514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef98d88b-23d7-43f6-8116-f2a69f8b4ac7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:52.391971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef98d88b-23d7-43f6-8116-f2a69f8b4ac7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:52.392478 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef98d88b-23d7-43f6-8116-f2a69f8b4ac7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:52.392616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56d4f99f-c063-475d-9f69-69fc7e5da820 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:52.393128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56d4f99f-c063-475d-9f69-69fc7e5da820 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:52.393264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef98d88b-23d7-43f6-8116-f2a69f8b4ac7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:52.393533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56d4f99f-c063-475d-9f69-69fc7e5da820 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:52.393651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef98d88b-23d7-43f6-8116-f2a69f8b4ac7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:52.394072 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef98d88b-23d7-43f6-8116-f2a69f8b4ac7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:52.394283 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56d4f99f-c063-475d-9f69-69fc7e5da820 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:52.394650 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56d4f99f-c063-475d-9f69-69fc7e5da820 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:52.395059 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56d4f99f-c063-475d-9f69-69fc7e5da820 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:52.593040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ef98d88b-23d7-43f6-8116-f2a69f8b4ac7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:52.598637 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-56d4f99f-c063-475d-9f69-69fc7e5da820 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:52.602695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ef98d88b-23d7-43f6-8116-f2a69f8b4ac7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.223913 Sep 05 17:02:52.603290 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 106/215] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:52 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:52.607454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-56d4f99f-c063-475d-9f69-69fc7e5da820 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.225497 Sep 05 17:02:52.608193 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 110/216] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:52 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:52.608706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-22a6ce23-e226-4a36-bea8-ee72e7e7fcb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:52.609304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-22a6ce23-e226-4a36-bea8-ee72e7e7fcb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:52.615325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22a6ce23-e226-4a36-bea8-ee72e7e7fcb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:52.615800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22a6ce23-e226-4a36-bea8-ee72e7e7fcb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:52.616261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22a6ce23-e226-4a36-bea8-ee72e7e7fcb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:52.617161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22a6ce23-e226-4a36-bea8-ee72e7e7fcb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:52.617805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22a6ce23-e226-4a36-bea8-ee72e7e7fcb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:52.618440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22a6ce23-e226-4a36-bea8-ee72e7e7fcb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:52.754782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-22a6ce23-e226-4a36-bea8-ee72e7e7fcb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:52.762969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-22a6ce23-e226-4a36-bea8-ee72e7e7fcb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:52.764663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-22a6ce23-e226-4a36-bea8-ee72e7e7fcb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:52.765766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-22a6ce23-e226-4a36-bea8-ee72e7e7fcb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.161350 Sep 05 17:02:52.766322 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 107/217] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:52 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:53.625788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7a73766e-e092-4763-88c5-e7d72550c476 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:53.626396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7a73766e-e092-4763-88c5-e7d72550c476 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:53.633078 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a73766e-e092-4763-88c5-e7d72550c476 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:53.633772 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a73766e-e092-4763-88c5-e7d72550c476 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:53.634242 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-366a418b-9519-4f7c-a8fa-7b769b82f30e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:53.634691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a73766e-e092-4763-88c5-e7d72550c476 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:53.635087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a73766e-e092-4763-88c5-e7d72550c476 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:53.635539 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a73766e-e092-4763-88c5-e7d72550c476 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:53.635890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-366a418b-9519-4f7c-a8fa-7b769b82f30e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:53.635995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a73766e-e092-4763-88c5-e7d72550c476 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:53.642498 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-366a418b-9519-4f7c-a8fa-7b769b82f30e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:53.642987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-366a418b-9519-4f7c-a8fa-7b769b82f30e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:53.643414 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-366a418b-9519-4f7c-a8fa-7b769b82f30e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:53.644109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-366a418b-9519-4f7c-a8fa-7b769b82f30e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:53.644593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-366a418b-9519-4f7c-a8fa-7b769b82f30e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:53.645013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-366a418b-9519-4f7c-a8fa-7b769b82f30e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:53.868095 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7a73766e-e092-4763-88c5-e7d72550c476 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:53.876347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7a73766e-e092-4763-88c5-e7d72550c476 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.254408 Sep 05 17:02:53.876889 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 111/218] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:53 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:53.882577 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c870d5c7-6818-421c-95b3-b5efb8becaeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:53.883176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c870d5c7-6818-421c-95b3-b5efb8becaeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:53.889178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c870d5c7-6818-421c-95b3-b5efb8becaeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:53.889868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c870d5c7-6818-421c-95b3-b5efb8becaeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:53.890385 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c870d5c7-6818-421c-95b3-b5efb8becaeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:53.891230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c870d5c7-6818-421c-95b3-b5efb8becaeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:53.891926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c870d5c7-6818-421c-95b3-b5efb8becaeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:53.892339 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c870d5c7-6818-421c-95b3-b5efb8becaeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:53.897383 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-366a418b-9519-4f7c-a8fa-7b769b82f30e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:53.906223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-366a418b-9519-4f7c-a8fa-7b769b82f30e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.279440 Sep 05 17:02:53.919545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 108/219] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:53 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:02:54.044959 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c870d5c7-6818-421c-95b3-b5efb8becaeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:54.053469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c870d5c7-6818-421c-95b3-b5efb8becaeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:54.054897 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c870d5c7-6818-421c-95b3-b5efb8becaeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:54.056114 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c870d5c7-6818-421c-95b3-b5efb8becaeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.178053 Sep 05 17:02:54.056712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 112/220] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:53 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:54.900269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e05eb99b-1887-463b-a0a8-3bc3f08a1683 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:54.900986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e05eb99b-1887-463b-a0a8-3bc3f08a1683 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:54.906866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e05eb99b-1887-463b-a0a8-3bc3f08a1683 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:54.907339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e05eb99b-1887-463b-a0a8-3bc3f08a1683 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:54.907762 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e05eb99b-1887-463b-a0a8-3bc3f08a1683 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:54.908452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e05eb99b-1887-463b-a0a8-3bc3f08a1683 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:54.908896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e05eb99b-1887-463b-a0a8-3bc3f08a1683 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:54.909313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e05eb99b-1887-463b-a0a8-3bc3f08a1683 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:54.929582 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cadbe9a9-6e4d-4c38-919b-3a5ccdb056a4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:54.930238 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cadbe9a9-6e4d-4c38-919b-3a5ccdb056a4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:54.936367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cadbe9a9-6e4d-4c38-919b-3a5ccdb056a4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:54.936839 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cadbe9a9-6e4d-4c38-919b-3a5ccdb056a4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:54.937460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cadbe9a9-6e4d-4c38-919b-3a5ccdb056a4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:54.938149 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cadbe9a9-6e4d-4c38-919b-3a5ccdb056a4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:54.938604 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cadbe9a9-6e4d-4c38-919b-3a5ccdb056a4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:54.939023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cadbe9a9-6e4d-4c38-919b-3a5ccdb056a4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:55.101099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e05eb99b-1887-463b-a0a8-3bc3f08a1683 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:55.109941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e05eb99b-1887-463b-a0a8-3bc3f08a1683 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.213618 Sep 05 17:02:55.121188 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 109/221] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:54 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:55.132449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-46682e04-6e48-4745-9f6d-938f476ed9aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:55.133058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-46682e04-6e48-4745-9f6d-938f476ed9aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:55.136258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cadbe9a9-6e4d-4c38-919b-3a5ccdb056a4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:55.139114 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46682e04-6e48-4745-9f6d-938f476ed9aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:55.139601 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46682e04-6e48-4745-9f6d-938f476ed9aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:55.140024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46682e04-6e48-4745-9f6d-938f476ed9aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:55.140750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46682e04-6e48-4745-9f6d-938f476ed9aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:55.141198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46682e04-6e48-4745-9f6d-938f476ed9aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:55.142057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46682e04-6e48-4745-9f6d-938f476ed9aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:55.144493 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cadbe9a9-6e4d-4c38-919b-3a5ccdb056a4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.218551 Sep 05 17:02:55.145170 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 113/222] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:54 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:55.278273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-46682e04-6e48-4745-9f6d-938f476ed9aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:55.288074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-46682e04-6e48-4745-9f6d-938f476ed9aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:55.289720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-46682e04-6e48-4745-9f6d-938f476ed9aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:55.290988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-46682e04-6e48-4745-9f6d-938f476ed9aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.168815 Sep 05 17:02:55.292324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 110/223] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:55 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:56.134928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-bcf13cfd-0383-4b80-9915-f1741c9face0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:56.135533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-bcf13cfd-0383-4b80-9915-f1741c9face0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:56.142131 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bcf13cfd-0383-4b80-9915-f1741c9face0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:56.142608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bcf13cfd-0383-4b80-9915-f1741c9face0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:56.143037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bcf13cfd-0383-4b80-9915-f1741c9face0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:56.143728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bcf13cfd-0383-4b80-9915-f1741c9face0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:56.144182 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bcf13cfd-0383-4b80-9915-f1741c9face0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:56.144607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bcf13cfd-0383-4b80-9915-f1741c9face0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:56.169578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-04f82374-c11d-4e87-952c-e1d7f48407c4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:56.170496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-04f82374-c11d-4e87-952c-e1d7f48407c4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:56.177294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04f82374-c11d-4e87-952c-e1d7f48407c4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:56.177877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04f82374-c11d-4e87-952c-e1d7f48407c4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:56.178475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04f82374-c11d-4e87-952c-e1d7f48407c4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:56.179177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04f82374-c11d-4e87-952c-e1d7f48407c4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:56.179633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04f82374-c11d-4e87-952c-e1d7f48407c4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:56.180082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04f82374-c11d-4e87-952c-e1d7f48407c4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:56.367133 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bcf13cfd-0383-4b80-9915-f1741c9face0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:56.375868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-bcf13cfd-0383-4b80-9915-f1741c9face0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.244613 Sep 05 17:02:56.376494 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 114/224] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:56 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:56.382519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-bd0617aa-6902-418f-8b8f-17667ea28993 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:56.383330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-bd0617aa-6902-418f-8b8f-17667ea28993 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:56.390190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bd0617aa-6902-418f-8b8f-17667ea28993 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:56.390676 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bd0617aa-6902-418f-8b8f-17667ea28993 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:56.391102 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bd0617aa-6902-418f-8b8f-17667ea28993 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:56.391823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bd0617aa-6902-418f-8b8f-17667ea28993 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:56.392295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bd0617aa-6902-418f-8b8f-17667ea28993 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:56.392708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bd0617aa-6902-418f-8b8f-17667ea28993 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:56.397165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-04f82374-c11d-4e87-952c-e1d7f48407c4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:56.405675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-04f82374-c11d-4e87-952c-e1d7f48407c4 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.241134 Sep 05 17:02:56.420253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 111/225] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:56 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:56.525925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bd0617aa-6902-418f-8b8f-17667ea28993 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:56.534424 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bd0617aa-6902-418f-8b8f-17667ea28993 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:56.535866 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bd0617aa-6902-418f-8b8f-17667ea28993 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:56.537107 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-bd0617aa-6902-418f-8b8f-17667ea28993 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.159491 Sep 05 17:02:56.537832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 115/226] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:56 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:57.261091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-92adf0e8-2131-44f1-894d-0c50fd3928f7 req-d1443d7a-0a2b-4965-a04b-b6fe8cd9657a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb25ed7-1069-41a4-b3d3-25231e7322e7", "name": "network-vif-plugged", "status": "completed", "tag": "69dc6b0f-11b6-4dd3-860d-3b29a41d0e34"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:02:57.277100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-92adf0e8-2131-44f1-894d-0c50fd3928f7 req-d1443d7a-0a2b-4965-a04b-b6fe8cd9657a service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:57.277581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-92adf0e8-2131-44f1-894d-0c50fd3928f7 req-d1443d7a-0a2b-4965-a04b-b6fe8cd9657a service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:57.278266 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-92adf0e8-2131-44f1-894d-0c50fd3928f7 req-d1443d7a-0a2b-4965-a04b-b6fe8cd9657a service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:57.290746 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-92adf0e8-2131-44f1-894d-0c50fd3928f7 req-d1443d7a-0a2b-4965-a04b-b6fe8cd9657a service nova] Creating event network-vif-plugged:69dc6b0f-11b6-4dd3-860d-3b29a41d0e34 for instance 2fb25ed7-1069-41a4-b3d3-25231e7322e7 on hv-cinder-85596 Sep 05 17:02:57.299236 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-92adf0e8-2131-44f1-894d-0c50fd3928f7 req-d1443d7a-0a2b-4965-a04b-b6fe8cd9657a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041541 Sep 05 17:02:57.301536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 112/227] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:02:57.401545 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7d6f1c35-87d4-477d-8ea8-d865fff5f299 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:57.402247 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7d6f1c35-87d4-477d-8ea8-d865fff5f299 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:57.408404 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7d6f1c35-87d4-477d-8ea8-d865fff5f299 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:57.409162 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7d6f1c35-87d4-477d-8ea8-d865fff5f299 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:57.409657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7d6f1c35-87d4-477d-8ea8-d865fff5f299 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:57.410411 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7d6f1c35-87d4-477d-8ea8-d865fff5f299 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:57.410935 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7d6f1c35-87d4-477d-8ea8-d865fff5f299 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:57.411486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7d6f1c35-87d4-477d-8ea8-d865fff5f299 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:57.429774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0d92c746-8032-40e4-af11-24b228f76099 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:57.430737 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0d92c746-8032-40e4-af11-24b228f76099 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:57.437456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d92c746-8032-40e4-af11-24b228f76099 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:57.438216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d92c746-8032-40e4-af11-24b228f76099 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:57.438783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d92c746-8032-40e4-af11-24b228f76099 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:57.439536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d92c746-8032-40e4-af11-24b228f76099 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:57.440170 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d92c746-8032-40e4-af11-24b228f76099 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:57.440685 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d92c746-8032-40e4-af11-24b228f76099 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:57.806605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7d6f1c35-87d4-477d-8ea8-d865fff5f299 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:57.811988 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7d6f1c35-87d4-477d-8ea8-d865fff5f299 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.414275 Sep 05 17:02:57.812587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 116/228] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:57 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:57.817354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-765f7791-6526-4af6-ac63-c161098b7a9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:57.818330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-765f7791-6526-4af6-ac63-c161098b7a9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:57.824123 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0d92c746-8032-40e4-af11-24b228f76099 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:57.824902 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-765f7791-6526-4af6-ac63-c161098b7a9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:57.825377 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-765f7791-6526-4af6-ac63-c161098b7a9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:57.825801 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-765f7791-6526-4af6-ac63-c161098b7a9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:57.826475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-765f7791-6526-4af6-ac63-c161098b7a9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:57.826931 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-765f7791-6526-4af6-ac63-c161098b7a9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:57.827372 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-765f7791-6526-4af6-ac63-c161098b7a9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:57.832218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0d92c746-8032-40e4-af11-24b228f76099 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.406633 Sep 05 17:02:57.832788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 113/229] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:57 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:57.960567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-765f7791-6526-4af6-ac63-c161098b7a9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:57.969009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-765f7791-6526-4af6-ac63-c161098b7a9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:57.970538 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-765f7791-6526-4af6-ac63-c161098b7a9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:57.971656 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-765f7791-6526-4af6-ac63-c161098b7a9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1406 microversion: 2.20 time: 0.157839 Sep 05 17:02:57.972249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 117/230] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:57 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:58.835998 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-493d9879-4d4d-48a8-be03-cd8fd3c41d74 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:58.836687 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-493d9879-4d4d-48a8-be03-cd8fd3c41d74 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:58.842677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-493d9879-4d4d-48a8-be03-cd8fd3c41d74 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:58.843377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-493d9879-4d4d-48a8-be03-cd8fd3c41d74 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:58.843810 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-493d9879-4d4d-48a8-be03-cd8fd3c41d74 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:58.844536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-493d9879-4d4d-48a8-be03-cd8fd3c41d74 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:58.844988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-493d9879-4d4d-48a8-be03-cd8fd3c41d74 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:58.845408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-493d9879-4d4d-48a8-be03-cd8fd3c41d74 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:58.855576 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5334a0f7-6465-40ac-b585-8a506cc4d578 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:58.856208 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5334a0f7-6465-40ac-b585-8a506cc4d578 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:58.862375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5334a0f7-6465-40ac-b585-8a506cc4d578 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:58.863026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5334a0f7-6465-40ac-b585-8a506cc4d578 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:58.863623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5334a0f7-6465-40ac-b585-8a506cc4d578 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:58.864528 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5334a0f7-6465-40ac-b585-8a506cc4d578 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:58.865177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5334a0f7-6465-40ac-b585-8a506cc4d578 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:58.865743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5334a0f7-6465-40ac-b585-8a506cc4d578 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:59.058501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5334a0f7-6465-40ac-b585-8a506cc4d578 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:59.059554 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-493d9879-4d4d-48a8-be03-cd8fd3c41d74 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:59.063687 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:02:59.070408 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5334a0f7-6465-40ac-b585-8a506cc4d578 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.218966 Sep 05 17:02:59.071629 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 118/231] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:58 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:02:59.073875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-493d9879-4d4d-48a8-be03-cd8fd3c41d74 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.240391 Sep 05 17:02:59.074667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 114/232] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:02:58 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:02:59.083870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-978c9c3e-4538-41b0-a167-90ddfc52af59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:59.084715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-978c9c3e-4538-41b0-a167-90ddfc52af59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:59.094463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-978c9c3e-4538-41b0-a167-90ddfc52af59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:59.095059 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-978c9c3e-4538-41b0-a167-90ddfc52af59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:59.095726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-978c9c3e-4538-41b0-a167-90ddfc52af59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:59.097256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-978c9c3e-4538-41b0-a167-90ddfc52af59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:59.097812 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-978c9c3e-4538-41b0-a167-90ddfc52af59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:59.098807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-978c9c3e-4538-41b0-a167-90ddfc52af59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:59.234040 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-978c9c3e-4538-41b0-a167-90ddfc52af59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:59.242857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-978c9c3e-4538-41b0-a167-90ddfc52af59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:59.244381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-978c9c3e-4538-41b0-a167-90ddfc52af59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:02:59.245537 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-978c9c3e-4538-41b0-a167-90ddfc52af59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1598 microversion: 2.20 time: 0.172315 Sep 05 17:02:59.246105 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 119/233] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:02:59 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1598 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:02:59.271632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-418eb77c-3315-42b3-8941-343b8c9a0cff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:02:59.272394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-418eb77c-3315-42b3-8941-343b8c9a0cff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:02:59.279085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-418eb77c-3315-42b3-8941-343b8c9a0cff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:59.279570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-418eb77c-3315-42b3-8941-343b8c9a0cff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:59.279997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-418eb77c-3315-42b3-8941-343b8c9a0cff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:59.280708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-418eb77c-3315-42b3-8941-343b8c9a0cff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:02:59.281157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-418eb77c-3315-42b3-8941-343b8c9a0cff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:02:59.281572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-418eb77c-3315-42b3-8941-343b8c9a0cff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:02:59.398263 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-418eb77c-3315-42b3-8941-343b8c9a0cff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.131533 Sep 05 17:02:59.399436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 115/234] 10.222.0.23 () {60 vars in 1316 bytes} [Mon Sep 5 17:02:59 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:03:00.098076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-94eb822c-2ad5-44a6-8084-f4770b207624 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:00.098796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-94eb822c-2ad5-44a6-8084-f4770b207624 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:00.099367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-34be48e8-f6fb-4d91-993d-6925616c9972 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:00.100579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-34be48e8-f6fb-4d91-993d-6925616c9972 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:00.101274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=72 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:03:00.107601 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34be48e8-f6fb-4d91-993d-6925616c9972 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:00.107810 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94eb822c-2ad5-44a6-8084-f4770b207624 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:00.108136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94eb822c-2ad5-44a6-8084-f4770b207624 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:00.108408 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34be48e8-f6fb-4d91-993d-6925616c9972 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:00.108573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94eb822c-2ad5-44a6-8084-f4770b207624 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:00.109008 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34be48e8-f6fb-4d91-993d-6925616c9972 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:00.109264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94eb822c-2ad5-44a6-8084-f4770b207624 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:00.109705 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94eb822c-2ad5-44a6-8084-f4770b207624 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:00.110110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34be48e8-f6fb-4d91-993d-6925616c9972 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:00.110212 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94eb822c-2ad5-44a6-8084-f4770b207624 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:00.110729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34be48e8-f6fb-4d91-993d-6925616c9972 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:00.111237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34be48e8-f6fb-4d91-993d-6925616c9972 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:00.358584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-34be48e8-f6fb-4d91-993d-6925616c9972 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:00.362129 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-94eb822c-2ad5-44a6-8084-f4770b207624 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:00.367334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-34be48e8-f6fb-4d91-993d-6925616c9972 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.273204 Sep 05 17:03:00.381090 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 120/235] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:00 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:00.385313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-94eb822c-2ad5-44a6-8084-f4770b207624 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.288018 Sep 05 17:03:00.388535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 116/236] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:00 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:00.752787 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-15c9c4ba-327a-493f-8b60-c5c8eb80ccea req-d178e940-3c8a-4baf-abb8-35690e984325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97cc15c7-947d-4daf-80e8-8edc37c01e68", "tag": "4a115af6-123d-4baf-bd17-df6792943a2d"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:03:00.762302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-15c9c4ba-327a-493f-8b60-c5c8eb80ccea req-d178e940-3c8a-4baf-abb8-35690e984325 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:00.762767 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-15c9c4ba-327a-493f-8b60-c5c8eb80ccea req-d178e940-3c8a-4baf-abb8-35690e984325 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:00.763180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-15c9c4ba-327a-493f-8b60-c5c8eb80ccea req-d178e940-3c8a-4baf-abb8-35690e984325 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:00.774659 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-15c9c4ba-327a-493f-8b60-c5c8eb80ccea req-d178e940-3c8a-4baf-abb8-35690e984325 service nova] Creating event network-changed:4a115af6-123d-4baf-bd17-df6792943a2d for instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 on hv-cinder-85596 Sep 05 17:03:00.780186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-15c9c4ba-327a-493f-8b60-c5c8eb80ccea req-d178e940-3c8a-4baf-abb8-35690e984325 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031054 Sep 05 17:03:00.780897 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 121/237] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:03:01.392555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-14dc04d8-bdd7-44fd-bfb0-a157534086be tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:01.393326 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-14dc04d8-bdd7-44fd-bfb0-a157534086be tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:01.399913 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14dc04d8-bdd7-44fd-bfb0-a157534086be tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:01.400427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14dc04d8-bdd7-44fd-bfb0-a157534086be tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:01.400840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14dc04d8-bdd7-44fd-bfb0-a157534086be tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:01.401527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14dc04d8-bdd7-44fd-bfb0-a157534086be tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:01.401965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14dc04d8-bdd7-44fd-bfb0-a157534086be tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:01.402371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14dc04d8-bdd7-44fd-bfb0-a157534086be tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:01.405091 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2b927c3b-a3ae-4174-8bc7-4f1c4d82bd71 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:01.405782 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2b927c3b-a3ae-4174-8bc7-4f1c4d82bd71 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:01.412193 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b927c3b-a3ae-4174-8bc7-4f1c4d82bd71 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:01.412683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b927c3b-a3ae-4174-8bc7-4f1c4d82bd71 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:01.413342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b927c3b-a3ae-4174-8bc7-4f1c4d82bd71 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:01.414033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b927c3b-a3ae-4174-8bc7-4f1c4d82bd71 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:01.414482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b927c3b-a3ae-4174-8bc7-4f1c4d82bd71 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:01.414896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b927c3b-a3ae-4174-8bc7-4f1c4d82bd71 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:01.618640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-14dc04d8-bdd7-44fd-bfb0-a157534086be tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:01.626207 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2b927c3b-a3ae-4174-8bc7-4f1c4d82bd71 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:01.630038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-14dc04d8-bdd7-44fd-bfb0-a157534086be tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.241395 Sep 05 17:03:01.630660 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 117/238] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:01 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:01.636589 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2b927c3b-a3ae-4174-8bc7-4f1c4d82bd71 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1322 microversion: 2.1 time: 0.235550 Sep 05 17:03:01.637165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 122/239] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:01 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:02.653110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3a991b51-d620-41e0-991b-2ee97096c869 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:02.653738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3a991b51-d620-41e0-991b-2ee97096c869 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:02.659914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a991b51-d620-41e0-991b-2ee97096c869 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:02.660315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ace4168e-efc3-438a-8006-34b13f9caa65 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:02.660749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a991b51-d620-41e0-991b-2ee97096c869 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:02.660914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a991b51-d620-41e0-991b-2ee97096c869 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:02.661084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ace4168e-efc3-438a-8006-34b13f9caa65 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:02.661631 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a991b51-d620-41e0-991b-2ee97096c869 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:02.662146 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a991b51-d620-41e0-991b-2ee97096c869 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:02.662709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a991b51-d620-41e0-991b-2ee97096c869 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:02.667587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ace4168e-efc3-438a-8006-34b13f9caa65 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:02.668063 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ace4168e-efc3-438a-8006-34b13f9caa65 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:02.668507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ace4168e-efc3-438a-8006-34b13f9caa65 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:02.669229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ace4168e-efc3-438a-8006-34b13f9caa65 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:02.669653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ace4168e-efc3-438a-8006-34b13f9caa65 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:02.670083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ace4168e-efc3-438a-8006-34b13f9caa65 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:02.874841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3a991b51-d620-41e0-991b-2ee97096c869 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:02.877634 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ace4168e-efc3-438a-8006-34b13f9caa65 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:02.882756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3a991b51-d620-41e0-991b-2ee97096c869 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.233595 Sep 05 17:03:02.883384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 118/240] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:02 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:02.886557 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ace4168e-efc3-438a-8006-34b13f9caa65 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1516 microversion: 2.1 time: 0.230102 Sep 05 17:03:02.887122 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 123/241] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:02 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:02.909038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8ccb5b93-e2b9-447d-9ee3-a6b86c167de2 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:03:02.911235 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8ccb5b93-e2b9-447d-9ee3-a6b86c167de2 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:02.917274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ccb5b93-e2b9-447d-9ee3-a6b86c167de2 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:02.917757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ccb5b93-e2b9-447d-9ee3-a6b86c167de2 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:02.918182 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ccb5b93-e2b9-447d-9ee3-a6b86c167de2 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:02.918862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ccb5b93-e2b9-447d-9ee3-a6b86c167de2 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:02.919307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ccb5b93-e2b9-447d-9ee3-a6b86c167de2 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:02.919721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ccb5b93-e2b9-447d-9ee3-a6b86c167de2 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:02.943584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-8ccb5b93-e2b9-447d-9ee3-a6b86c167de2 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lazy-loading 'flavor' on Instance uuid bfe215ba-4dff-48b0-a561-60ab7593b6d7 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:03:03.078747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8ccb5b93-e2b9-447d-9ee3-a6b86c167de2 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "POST /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7/action" status: 200 len: 32 microversion: 2.1 time: 0.173584 Sep 05 17:03:03.079421 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 119/242] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Sep 5 17:03:02 2022] POST /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 17:03:03.088940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e9f4887b-b050-4b12-9866-890f6d2e1301 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:03.089538 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e9f4887b-b050-4b12-9866-890f6d2e1301 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:03.096011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9f4887b-b050-4b12-9866-890f6d2e1301 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:03.096512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9f4887b-b050-4b12-9866-890f6d2e1301 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:03.096936 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9f4887b-b050-4b12-9866-890f6d2e1301 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:03.097604 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9f4887b-b050-4b12-9866-890f6d2e1301 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:03.098011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9f4887b-b050-4b12-9866-890f6d2e1301 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:03.098454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9f4887b-b050-4b12-9866-890f6d2e1301 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:03.103189 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:03:03.245305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e9f4887b-b050-4b12-9866-890f6d2e1301 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:03.252991 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e9f4887b-b050-4b12-9866-890f6d2e1301 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.167907 Sep 05 17:03:03.253558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 124/243] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:03 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:03.908566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-90e8d805-0872-41dd-8d2a-6387d682bdf8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:03.909426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-90e8d805-0872-41dd-8d2a-6387d682bdf8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:03.918056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90e8d805-0872-41dd-8d2a-6387d682bdf8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:03.918682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90e8d805-0872-41dd-8d2a-6387d682bdf8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:03.919208 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90e8d805-0872-41dd-8d2a-6387d682bdf8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:03.920083 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90e8d805-0872-41dd-8d2a-6387d682bdf8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:03.920705 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90e8d805-0872-41dd-8d2a-6387d682bdf8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:03.921221 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90e8d805-0872-41dd-8d2a-6387d682bdf8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:04.065844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-90e8d805-0872-41dd-8d2a-6387d682bdf8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:04.073896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-90e8d805-0872-41dd-8d2a-6387d682bdf8 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.170911 Sep 05 17:03:04.074468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 120/244] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:03 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:04.283279 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-76f35cae-f0dd-422a-b919-886ba2cc8541 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:04.284177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-76f35cae-f0dd-422a-b919-886ba2cc8541 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:04.287295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=80 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:03:04.292807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-76f35cae-f0dd-422a-b919-886ba2cc8541 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:04.293288 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-76f35cae-f0dd-422a-b919-886ba2cc8541 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:04.293722 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-76f35cae-f0dd-422a-b919-886ba2cc8541 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:04.294382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-76f35cae-f0dd-422a-b919-886ba2cc8541 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:04.294845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-76f35cae-f0dd-422a-b919-886ba2cc8541 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:04.295259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-76f35cae-f0dd-422a-b919-886ba2cc8541 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:04.431806 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-76f35cae-f0dd-422a-b919-886ba2cc8541 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:04.439709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-76f35cae-f0dd-422a-b919-886ba2cc8541 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.165951 Sep 05 17:03:04.440388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 125/245] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:04 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:05.100975 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-88e8ccfd-9693-4f98-9c28-d455fc49329d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:05.101719 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-88e8ccfd-9693-4f98-9c28-d455fc49329d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:05.110042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-88e8ccfd-9693-4f98-9c28-d455fc49329d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:05.110634 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-88e8ccfd-9693-4f98-9c28-d455fc49329d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:05.111161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-88e8ccfd-9693-4f98-9c28-d455fc49329d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:05.112005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-88e8ccfd-9693-4f98-9c28-d455fc49329d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:05.112604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-88e8ccfd-9693-4f98-9c28-d455fc49329d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:05.113115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-88e8ccfd-9693-4f98-9c28-d455fc49329d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:05.265560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-88e8ccfd-9693-4f98-9c28-d455fc49329d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:05.275277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-88e8ccfd-9693-4f98-9c28-d455fc49329d tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.180577 Sep 05 17:03:05.275849 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 121/246] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:05 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:05.463873 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-663c93d6-3d7b-44ad-85a9-8ef6c2aadfb9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:05.464519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-663c93d6-3d7b-44ad-85a9-8ef6c2aadfb9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:05.470740 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-663c93d6-3d7b-44ad-85a9-8ef6c2aadfb9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:05.471223 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-663c93d6-3d7b-44ad-85a9-8ef6c2aadfb9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:05.471620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-663c93d6-3d7b-44ad-85a9-8ef6c2aadfb9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:05.472351 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-663c93d6-3d7b-44ad-85a9-8ef6c2aadfb9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:05.472814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-663c93d6-3d7b-44ad-85a9-8ef6c2aadfb9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:05.473906 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-663c93d6-3d7b-44ad-85a9-8ef6c2aadfb9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:05.605206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-663c93d6-3d7b-44ad-85a9-8ef6c2aadfb9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:05.613245 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-663c93d6-3d7b-44ad-85a9-8ef6c2aadfb9 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.153315 Sep 05 17:03:05.613814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 126/247] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:05 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:06.299620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f580207f-2448-42d1-bd10-20a1223e982b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:06.300236 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f580207f-2448-42d1-bd10-20a1223e982b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:06.307372 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f580207f-2448-42d1-bd10-20a1223e982b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:06.307896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f580207f-2448-42d1-bd10-20a1223e982b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:06.308377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f580207f-2448-42d1-bd10-20a1223e982b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:06.309104 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f580207f-2448-42d1-bd10-20a1223e982b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:06.309587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f580207f-2448-42d1-bd10-20a1223e982b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:06.310034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f580207f-2448-42d1-bd10-20a1223e982b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:06.447958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f580207f-2448-42d1-bd10-20a1223e982b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:06.458028 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f580207f-2448-42d1-bd10-20a1223e982b tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.162682 Sep 05 17:03:06.458710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 122/248] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:06 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:06.636574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8b71075d-6971-4ea8-953e-e07be9b7a10d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:06.637186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8b71075d-6971-4ea8-953e-e07be9b7a10d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:06.643263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b71075d-6971-4ea8-953e-e07be9b7a10d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:06.643743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b71075d-6971-4ea8-953e-e07be9b7a10d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:06.644182 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b71075d-6971-4ea8-953e-e07be9b7a10d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:06.644875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b71075d-6971-4ea8-953e-e07be9b7a10d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:06.645330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b71075d-6971-4ea8-953e-e07be9b7a10d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:06.645741 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b71075d-6971-4ea8-953e-e07be9b7a10d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:06.780553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8b71075d-6971-4ea8-953e-e07be9b7a10d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:06.792206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8b71075d-6971-4ea8-953e-e07be9b7a10d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.159416 Sep 05 17:03:06.792967 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 127/249] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:06 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:07.490177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c465f4c4-6333-4f68-988c-da2485d39686 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:07.490743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c465f4c4-6333-4f68-988c-da2485d39686 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:07.496985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c465f4c4-6333-4f68-988c-da2485d39686 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:07.497461 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c465f4c4-6333-4f68-988c-da2485d39686 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:07.497878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c465f4c4-6333-4f68-988c-da2485d39686 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:07.498548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c465f4c4-6333-4f68-988c-da2485d39686 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:07.498993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c465f4c4-6333-4f68-988c-da2485d39686 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:07.499407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c465f4c4-6333-4f68-988c-da2485d39686 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:07.634440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c465f4c4-6333-4f68-988c-da2485d39686 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:07.642105 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c465f4c4-6333-4f68-988c-da2485d39686 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.158346 Sep 05 17:03:07.642667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 123/250] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:07 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:07.822222 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-056c7c99-eaa8-47c0-ada0-40042fbbdf8c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:07.822900 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-056c7c99-eaa8-47c0-ada0-40042fbbdf8c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:07.830709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-056c7c99-eaa8-47c0-ada0-40042fbbdf8c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:07.831296 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-056c7c99-eaa8-47c0-ada0-40042fbbdf8c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:07.831828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-056c7c99-eaa8-47c0-ada0-40042fbbdf8c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:07.832716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-056c7c99-eaa8-47c0-ada0-40042fbbdf8c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:07.833303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-056c7c99-eaa8-47c0-ada0-40042fbbdf8c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:07.833806 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-056c7c99-eaa8-47c0-ada0-40042fbbdf8c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:07.983663 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-056c7c99-eaa8-47c0-ada0-40042fbbdf8c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:07.992295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-056c7c99-eaa8-47c0-ada0-40042fbbdf8c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.175811 Sep 05 17:03:07.993090 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 128/251] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:07 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:08.664616 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-64594f20-695b-4436-ac6c-afdf1ac5dbe6 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:08.665305 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-64594f20-695b-4436-ac6c-afdf1ac5dbe6 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:08.671801 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64594f20-695b-4436-ac6c-afdf1ac5dbe6 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:08.672290 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64594f20-695b-4436-ac6c-afdf1ac5dbe6 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:08.672919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64594f20-695b-4436-ac6c-afdf1ac5dbe6 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:08.673602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64594f20-695b-4436-ac6c-afdf1ac5dbe6 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:08.674045 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64594f20-695b-4436-ac6c-afdf1ac5dbe6 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:08.674457 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64594f20-695b-4436-ac6c-afdf1ac5dbe6 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:08.852922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-64594f20-695b-4436-ac6c-afdf1ac5dbe6 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:08.860615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-64594f20-695b-4436-ac6c-afdf1ac5dbe6 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1315 microversion: 2.1 time: 0.200413 Sep 05 17:03:08.861217 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 124/252] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:08 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:09.020811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e1477390-dcf6-4378-8d04-d6b87b7d0769 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:09.021397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e1477390-dcf6-4378-8d04-d6b87b7d0769 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:09.028018 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1477390-dcf6-4378-8d04-d6b87b7d0769 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:09.028533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1477390-dcf6-4378-8d04-d6b87b7d0769 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:09.028961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1477390-dcf6-4378-8d04-d6b87b7d0769 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:09.029652 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1477390-dcf6-4378-8d04-d6b87b7d0769 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:09.030100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1477390-dcf6-4378-8d04-d6b87b7d0769 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:09.030518 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1477390-dcf6-4378-8d04-d6b87b7d0769 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:09.171210 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e1477390-dcf6-4378-8d04-d6b87b7d0769 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:09.179355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e1477390-dcf6-4378-8d04-d6b87b7d0769 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.162563 Sep 05 17:03:09.179918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 129/253] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:09 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:09.883430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-746e74ce-f165-4c8b-b1b4-90019d3e2549 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:09.884038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-746e74ce-f165-4c8b-b1b4-90019d3e2549 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:09.890110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-746e74ce-f165-4c8b-b1b4-90019d3e2549 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:09.890597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-746e74ce-f165-4c8b-b1b4-90019d3e2549 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:09.891031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-746e74ce-f165-4c8b-b1b4-90019d3e2549 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:09.891723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-746e74ce-f165-4c8b-b1b4-90019d3e2549 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:09.892200 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-746e74ce-f165-4c8b-b1b4-90019d3e2549 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:09.892629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-746e74ce-f165-4c8b-b1b4-90019d3e2549 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:10.037261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-746e74ce-f165-4c8b-b1b4-90019d3e2549 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:10.045756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-746e74ce-f165-4c8b-b1b4-90019d3e2549 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1502 microversion: 2.1 time: 0.166229 Sep 05 17:03:10.046288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 125/254] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:09 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:10.209179 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-69f0ca91-fb8b-4dfa-a670-4ba7ef077c00 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:10.210203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-69f0ca91-fb8b-4dfa-a670-4ba7ef077c00 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:10.216096 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-69f0ca91-fb8b-4dfa-a670-4ba7ef077c00 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:10.216594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-69f0ca91-fb8b-4dfa-a670-4ba7ef077c00 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:10.217212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-69f0ca91-fb8b-4dfa-a670-4ba7ef077c00 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:10.217900 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-69f0ca91-fb8b-4dfa-a670-4ba7ef077c00 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:10.218342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-69f0ca91-fb8b-4dfa-a670-4ba7ef077c00 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:10.218752 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-69f0ca91-fb8b-4dfa-a670-4ba7ef077c00 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:10.595701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-69f0ca91-fb8b-4dfa-a670-4ba7ef077c00 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:10.605550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-69f0ca91-fb8b-4dfa-a670-4ba7ef077c00 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.400393 Sep 05 17:03:10.606099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 130/255] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:10 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:11.631228 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7857d93d-e507-4016-b55d-1aa8320040cd tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:11.632094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7857d93d-e507-4016-b55d-1aa8320040cd tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:11.638896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7857d93d-e507-4016-b55d-1aa8320040cd tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:11.639426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7857d93d-e507-4016-b55d-1aa8320040cd tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:11.639923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7857d93d-e507-4016-b55d-1aa8320040cd tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:11.640749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7857d93d-e507-4016-b55d-1aa8320040cd tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:11.644373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7857d93d-e507-4016-b55d-1aa8320040cd tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:11.644863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7857d93d-e507-4016-b55d-1aa8320040cd tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:11.788091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7857d93d-e507-4016-b55d-1aa8320040cd tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:11.795973 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7857d93d-e507-4016-b55d-1aa8320040cd tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.171053 Sep 05 17:03:11.796561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 126/256] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:11 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:12.689673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d449ae95-37db-4433-bf75-56fbf137be20 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c538e5ec-b846-40b4-8dce-83a7582da535"}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:03:12.692529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d449ae95-37db-4433-bf75-56fbf137be20 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:12.701460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d449ae95-37db-4433-bf75-56fbf137be20 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:12.701937 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d449ae95-37db-4433-bf75-56fbf137be20 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:12.702358 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d449ae95-37db-4433-bf75-56fbf137be20 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:12.703038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d449ae95-37db-4433-bf75-56fbf137be20 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:12.703476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d449ae95-37db-4433-bf75-56fbf137be20 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:12.703884 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d449ae95-37db-4433-bf75-56fbf137be20 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:12.819089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2e0c80b3-622c-4c60-b30d-51353066c4d5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:12.819800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2e0c80b3-622c-4c60-b30d-51353066c4d5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:12.826041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e0c80b3-622c-4c60-b30d-51353066c4d5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:12.826606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e0c80b3-622c-4c60-b30d-51353066c4d5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:12.827104 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e0c80b3-622c-4c60-b30d-51353066c4d5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:12.827856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e0c80b3-622c-4c60-b30d-51353066c4d5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:12.828404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e0c80b3-622c-4c60-b30d-51353066c4d5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:12.828910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e0c80b3-622c-4c60-b30d-51353066c4d5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:12.958016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2e0c80b3-622c-4c60-b30d-51353066c4d5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:12.970598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2e0c80b3-622c-4c60-b30d-51353066c4d5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.155107 Sep 05 17:03:12.971425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 127/257] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:12 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:13.561490 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d449ae95-37db-4433-bf75-56fbf137be20 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "POST /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.876546 Sep 05 17:03:13.562523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 131/258] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Sep 5 17:03:12 2022] POST /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c/os-volume_attachments => generated 194 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:03:13.995817 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-00f28b54-e924-465c-abfc-26f294d53037 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:13.996739 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-00f28b54-e924-465c-abfc-26f294d53037 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:14.003963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00f28b54-e924-465c-abfc-26f294d53037 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:14.004523 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00f28b54-e924-465c-abfc-26f294d53037 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:14.004994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00f28b54-e924-465c-abfc-26f294d53037 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:14.005740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00f28b54-e924-465c-abfc-26f294d53037 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:14.006231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00f28b54-e924-465c-abfc-26f294d53037 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:14.006689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00f28b54-e924-465c-abfc-26f294d53037 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:14.147663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-00f28b54-e924-465c-abfc-26f294d53037 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:14.156299 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-00f28b54-e924-465c-abfc-26f294d53037 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.165168 Sep 05 17:03:14.156873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 128/259] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:13 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:15.180138 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5b209a98-fc01-443c-b5a6-79b5931bf7c4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:15.180857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5b209a98-fc01-443c-b5a6-79b5931bf7c4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:15.188178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b209a98-fc01-443c-b5a6-79b5931bf7c4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:15.189364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b209a98-fc01-443c-b5a6-79b5931bf7c4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:15.190094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b209a98-fc01-443c-b5a6-79b5931bf7c4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:15.191815 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b209a98-fc01-443c-b5a6-79b5931bf7c4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:15.192619 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b209a98-fc01-443c-b5a6-79b5931bf7c4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:15.193160 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b209a98-fc01-443c-b5a6-79b5931bf7c4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:15.327256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5b209a98-fc01-443c-b5a6-79b5931bf7c4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:15.334893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5b209a98-fc01-443c-b5a6-79b5931bf7c4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.159696 Sep 05 17:03:15.335461 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 132/260] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:15 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:16.359969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-86c63e14-9e25-442b-b696-bb9b20998a95 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:16.361165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-86c63e14-9e25-442b-b696-bb9b20998a95 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:16.371635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86c63e14-9e25-442b-b696-bb9b20998a95 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:16.372129 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86c63e14-9e25-442b-b696-bb9b20998a95 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:16.372578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86c63e14-9e25-442b-b696-bb9b20998a95 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:16.373457 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86c63e14-9e25-442b-b696-bb9b20998a95 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:16.373907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86c63e14-9e25-442b-b696-bb9b20998a95 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:16.377190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86c63e14-9e25-442b-b696-bb9b20998a95 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:16.553493 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-86c63e14-9e25-442b-b696-bb9b20998a95 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:16.558438 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:03:16.564594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-86c63e14-9e25-442b-b696-bb9b20998a95 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.209686 Sep 05 17:03:16.565396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 129/261] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:16 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:17.588674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0f4b1201-54ec-4dd3-93dd-bfb154ca7d0d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:17.589305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0f4b1201-54ec-4dd3-93dd-bfb154ca7d0d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:17.596264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f4b1201-54ec-4dd3-93dd-bfb154ca7d0d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:17.596994 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f4b1201-54ec-4dd3-93dd-bfb154ca7d0d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:17.597423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f4b1201-54ec-4dd3-93dd-bfb154ca7d0d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:17.598127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f4b1201-54ec-4dd3-93dd-bfb154ca7d0d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:17.598567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f4b1201-54ec-4dd3-93dd-bfb154ca7d0d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:17.599095 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f4b1201-54ec-4dd3-93dd-bfb154ca7d0d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:17.733042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0f4b1201-54ec-4dd3-93dd-bfb154ca7d0d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:17.740870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0f4b1201-54ec-4dd3-93dd-bfb154ca7d0d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.156512 Sep 05 17:03:17.741415 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 133/262] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:17 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:18.763549 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-55e4dbfd-91de-40d7-bce1-b9740d5d99fc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:18.764166 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-55e4dbfd-91de-40d7-bce1-b9740d5d99fc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:18.771284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55e4dbfd-91de-40d7-bce1-b9740d5d99fc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:18.771888 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55e4dbfd-91de-40d7-bce1-b9740d5d99fc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:18.772408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55e4dbfd-91de-40d7-bce1-b9740d5d99fc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:18.773150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55e4dbfd-91de-40d7-bce1-b9740d5d99fc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:18.773724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55e4dbfd-91de-40d7-bce1-b9740d5d99fc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:18.774147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55e4dbfd-91de-40d7-bce1-b9740d5d99fc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:18.905081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-55e4dbfd-91de-40d7-bce1-b9740d5d99fc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:18.913022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-55e4dbfd-91de-40d7-bce1-b9740d5d99fc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.153639 Sep 05 17:03:18.913581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 130/263] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:18 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:19.938012 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0cee3c99-894e-4bd5-83ee-f3cd4a45270f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:19.938695 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0cee3c99-894e-4bd5-83ee-f3cd4a45270f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:19.945620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0cee3c99-894e-4bd5-83ee-f3cd4a45270f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:19.946204 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0cee3c99-894e-4bd5-83ee-f3cd4a45270f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:19.946758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0cee3c99-894e-4bd5-83ee-f3cd4a45270f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:19.947443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0cee3c99-894e-4bd5-83ee-f3cd4a45270f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:19.947888 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0cee3c99-894e-4bd5-83ee-f3cd4a45270f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:19.948367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0cee3c99-894e-4bd5-83ee-f3cd4a45270f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:20.083670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0cee3c99-894e-4bd5-83ee-f3cd4a45270f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:20.092046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0cee3c99-894e-4bd5-83ee-f3cd4a45270f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.158968 Sep 05 17:03:20.093153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 134/264] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:19 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:21.115496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dd1b9aaf-2f8d-4f88-8f60-a5c0ec977630 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:21.116075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dd1b9aaf-2f8d-4f88-8f60-a5c0ec977630 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:21.123057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd1b9aaf-2f8d-4f88-8f60-a5c0ec977630 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:21.123532 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd1b9aaf-2f8d-4f88-8f60-a5c0ec977630 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:21.123960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd1b9aaf-2f8d-4f88-8f60-a5c0ec977630 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:21.124663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd1b9aaf-2f8d-4f88-8f60-a5c0ec977630 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:21.125103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd1b9aaf-2f8d-4f88-8f60-a5c0ec977630 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:21.125513 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd1b9aaf-2f8d-4f88-8f60-a5c0ec977630 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:21.284018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dd1b9aaf-2f8d-4f88-8f60-a5c0ec977630 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:21.292044 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dd1b9aaf-2f8d-4f88-8f60-a5c0ec977630 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.180531 Sep 05 17:03:21.292701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 131/265] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:21 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:22.315735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6f9ba776-d19f-4f3a-90ca-e107cb2790a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:22.319008 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6f9ba776-d19f-4f3a-90ca-e107cb2790a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:22.326887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f9ba776-d19f-4f3a-90ca-e107cb2790a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:22.327356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f9ba776-d19f-4f3a-90ca-e107cb2790a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:22.327789 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f9ba776-d19f-4f3a-90ca-e107cb2790a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:22.328592 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f9ba776-d19f-4f3a-90ca-e107cb2790a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:22.329081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f9ba776-d19f-4f3a-90ca-e107cb2790a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:22.329439 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f9ba776-d19f-4f3a-90ca-e107cb2790a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:22.519607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6f9ba776-d19f-4f3a-90ca-e107cb2790a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:22.531942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6f9ba776-d19f-4f3a-90ca-e107cb2790a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.220012 Sep 05 17:03:22.544774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 135/266] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:22 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:23.555200 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fc94b291-e32a-4c08-897e-a332991fa83d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:23.556873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fc94b291-e32a-4c08-897e-a332991fa83d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:23.563182 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc94b291-e32a-4c08-897e-a332991fa83d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:23.563876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc94b291-e32a-4c08-897e-a332991fa83d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:23.564649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc94b291-e32a-4c08-897e-a332991fa83d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:23.565662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc94b291-e32a-4c08-897e-a332991fa83d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:23.566513 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc94b291-e32a-4c08-897e-a332991fa83d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:23.567074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc94b291-e32a-4c08-897e-a332991fa83d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:23.730477 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fc94b291-e32a-4c08-897e-a332991fa83d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:23.748407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fc94b291-e32a-4c08-897e-a332991fa83d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.196981 Sep 05 17:03:23.748986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 132/267] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:23 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:24.773559 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cc1d098b-c372-4b5a-b895-2bfe0f607247 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:24.774388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cc1d098b-c372-4b5a-b895-2bfe0f607247 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:24.781585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc1d098b-c372-4b5a-b895-2bfe0f607247 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:24.782662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc1d098b-c372-4b5a-b895-2bfe0f607247 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:24.783409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc1d098b-c372-4b5a-b895-2bfe0f607247 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:24.784308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc1d098b-c372-4b5a-b895-2bfe0f607247 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:24.784946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc1d098b-c372-4b5a-b895-2bfe0f607247 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:24.785448 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc1d098b-c372-4b5a-b895-2bfe0f607247 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:24.953133 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cc1d098b-c372-4b5a-b895-2bfe0f607247 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:24.967705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cc1d098b-c372-4b5a-b895-2bfe0f607247 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.198178 Sep 05 17:03:24.968573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 136/268] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:24 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:25.993509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c360d927-26ed-4a0f-8320-7f37821bdb43 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:25.994145 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c360d927-26ed-4a0f-8320-7f37821bdb43 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:26.000634 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c360d927-26ed-4a0f-8320-7f37821bdb43 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:26.001106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c360d927-26ed-4a0f-8320-7f37821bdb43 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:26.001542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c360d927-26ed-4a0f-8320-7f37821bdb43 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:26.002435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c360d927-26ed-4a0f-8320-7f37821bdb43 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:26.002936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c360d927-26ed-4a0f-8320-7f37821bdb43 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:26.003414 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c360d927-26ed-4a0f-8320-7f37821bdb43 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:26.146556 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c360d927-26ed-4a0f-8320-7f37821bdb43 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:26.158153 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c360d927-26ed-4a0f-8320-7f37821bdb43 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.168856 Sep 05 17:03:26.158732 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 133/269] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:25 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:27.182323 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-df142e8f-08be-47f5-86b1-82161063d46e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:27.182930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-df142e8f-08be-47f5-86b1-82161063d46e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:27.189756 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df142e8f-08be-47f5-86b1-82161063d46e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:27.190243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df142e8f-08be-47f5-86b1-82161063d46e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:27.190716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df142e8f-08be-47f5-86b1-82161063d46e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:27.191399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df142e8f-08be-47f5-86b1-82161063d46e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:27.192036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df142e8f-08be-47f5-86b1-82161063d46e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:27.192624 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df142e8f-08be-47f5-86b1-82161063d46e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:27.541643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-df142e8f-08be-47f5-86b1-82161063d46e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:27.550797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-df142e8f-08be-47f5-86b1-82161063d46e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.372398 Sep 05 17:03:27.551573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 137/270] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:27 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:28.575076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7e932eec-7e2d-4686-88aa-b1b35dbf57f0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:28.576551 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7e932eec-7e2d-4686-88aa-b1b35dbf57f0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:28.590531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e932eec-7e2d-4686-88aa-b1b35dbf57f0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:28.590531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e932eec-7e2d-4686-88aa-b1b35dbf57f0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:28.590531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e932eec-7e2d-4686-88aa-b1b35dbf57f0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:28.590531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e932eec-7e2d-4686-88aa-b1b35dbf57f0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:28.591238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e932eec-7e2d-4686-88aa-b1b35dbf57f0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:28.591238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e932eec-7e2d-4686-88aa-b1b35dbf57f0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:28.773695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7e932eec-7e2d-4686-88aa-b1b35dbf57f0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:28.782943 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7e932eec-7e2d-4686-88aa-b1b35dbf57f0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.212833 Sep 05 17:03:28.784710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 134/271] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:28 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:29.809194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-eedd596b-0565-4822-b7f7-29b39cd1facc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:29.811426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-eedd596b-0565-4822-b7f7-29b39cd1facc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:29.819272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eedd596b-0565-4822-b7f7-29b39cd1facc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:29.820507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eedd596b-0565-4822-b7f7-29b39cd1facc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:29.821928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eedd596b-0565-4822-b7f7-29b39cd1facc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:29.822899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eedd596b-0565-4822-b7f7-29b39cd1facc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:29.823685 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eedd596b-0565-4822-b7f7-29b39cd1facc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:29.824444 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eedd596b-0565-4822-b7f7-29b39cd1facc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:30.027127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-eedd596b-0565-4822-b7f7-29b39cd1facc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:30.036644 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-eedd596b-0565-4822-b7f7-29b39cd1facc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.232016 Sep 05 17:03:30.038108 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 138/272] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:29 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:31.063678 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f95563b3-64f8-4913-b13f-0d386485b585 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:31.064995 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f95563b3-64f8-4913-b13f-0d386485b585 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:31.073380 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=38 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:03:31.076207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95563b3-64f8-4913-b13f-0d386485b585 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:31.077033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95563b3-64f8-4913-b13f-0d386485b585 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:31.077862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95563b3-64f8-4913-b13f-0d386485b585 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:31.078715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95563b3-64f8-4913-b13f-0d386485b585 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:31.079314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95563b3-64f8-4913-b13f-0d386485b585 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:31.080306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95563b3-64f8-4913-b13f-0d386485b585 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:31.257227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f95563b3-64f8-4913-b13f-0d386485b585 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:31.269769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f95563b3-64f8-4913-b13f-0d386485b585 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.212236 Sep 05 17:03:31.270348 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 135/273] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:31 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:32.294573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-09f0e76c-c0d9-405c-ba77-e2fad1d41823 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:32.296438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-09f0e76c-c0d9-405c-ba77-e2fad1d41823 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:32.303556 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09f0e76c-c0d9-405c-ba77-e2fad1d41823 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:32.304807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09f0e76c-c0d9-405c-ba77-e2fad1d41823 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:32.305500 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09f0e76c-c0d9-405c-ba77-e2fad1d41823 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:32.306430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09f0e76c-c0d9-405c-ba77-e2fad1d41823 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:32.307058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09f0e76c-c0d9-405c-ba77-e2fad1d41823 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:32.307670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09f0e76c-c0d9-405c-ba77-e2fad1d41823 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:32.329835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:03:32.499200 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-09f0e76c-c0d9-405c-ba77-e2fad1d41823 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:32.512129 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-09f0e76c-c0d9-405c-ba77-e2fad1d41823 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.222119 Sep 05 17:03:32.518446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 139/274] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:32 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:32.654561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c988a48f-6225-470e-8534-390a0b1e4b07 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:32.655279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c988a48f-6225-470e-8534-390a0b1e4b07 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:32.661220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c988a48f-6225-470e-8534-390a0b1e4b07 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:32.661704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c988a48f-6225-470e-8534-390a0b1e4b07 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:32.662132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c988a48f-6225-470e-8534-390a0b1e4b07 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:32.662836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c988a48f-6225-470e-8534-390a0b1e4b07 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:32.663280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c988a48f-6225-470e-8534-390a0b1e4b07 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:32.663692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c988a48f-6225-470e-8534-390a0b1e4b07 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:32.688618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c988a48f-6225-470e-8534-390a0b1e4b07 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:03:32.792446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c988a48f-6225-470e-8534-390a0b1e4b07 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 204 len: 0 microversion: 2.1 time: 0.141113 Sep 05 17:03:32.793615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 136/275] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:03:32 2022] DELETE /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 05 17:03:32.804999 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-703f79ef-b8d6-4b07-97f7-8cdcb20de3cf tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:32.806294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-703f79ef-b8d6-4b07-97f7-8cdcb20de3cf tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:32.814575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-703f79ef-b8d6-4b07-97f7-8cdcb20de3cf tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:32.815214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-703f79ef-b8d6-4b07-97f7-8cdcb20de3cf tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:32.816086 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-703f79ef-b8d6-4b07-97f7-8cdcb20de3cf tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:32.817175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-703f79ef-b8d6-4b07-97f7-8cdcb20de3cf tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:32.817884 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-703f79ef-b8d6-4b07-97f7-8cdcb20de3cf tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:32.818344 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-703f79ef-b8d6-4b07-97f7-8cdcb20de3cf tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:32.956516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-703f79ef-b8d6-4b07-97f7-8cdcb20de3cf tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:32.964754 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-703f79ef-b8d6-4b07-97f7-8cdcb20de3cf tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1554 microversion: 2.1 time: 0.166220 Sep 05 17:03:32.965299 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 140/276] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:32 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:33.540486 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dc1ab074-80a5-4841-9831-e5692f8aa8f5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:33.541230 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dc1ab074-80a5-4841-9831-e5692f8aa8f5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:33.547548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc1ab074-80a5-4841-9831-e5692f8aa8f5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:33.548025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc1ab074-80a5-4841-9831-e5692f8aa8f5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:33.548494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc1ab074-80a5-4841-9831-e5692f8aa8f5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:33.549188 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc1ab074-80a5-4841-9831-e5692f8aa8f5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:33.549634 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc1ab074-80a5-4841-9831-e5692f8aa8f5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:33.550054 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc1ab074-80a5-4841-9831-e5692f8aa8f5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:33.712497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dc1ab074-80a5-4841-9831-e5692f8aa8f5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:33.722541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dc1ab074-80a5-4841-9831-e5692f8aa8f5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.185949 Sep 05 17:03:33.722541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 137/277] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:33 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:33.988945 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c3789ef5-ea0b-4eea-bf64-8b9f888b8e2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:33.990305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c3789ef5-ea0b-4eea-bf64-8b9f888b8e2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:34.004884 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3789ef5-ea0b-4eea-bf64-8b9f888b8e2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:34.005461 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3789ef5-ea0b-4eea-bf64-8b9f888b8e2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:34.005921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3789ef5-ea0b-4eea-bf64-8b9f888b8e2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:34.006953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3789ef5-ea0b-4eea-bf64-8b9f888b8e2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:34.007609 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3789ef5-ea0b-4eea-bf64-8b9f888b8e2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:34.007945 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3789ef5-ea0b-4eea-bf64-8b9f888b8e2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:34.196487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c3789ef5-ea0b-4eea-bf64-8b9f888b8e2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:34.210578 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c3789ef5-ea0b-4eea-bf64-8b9f888b8e2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1554 microversion: 2.1 time: 0.225450 Sep 05 17:03:34.211309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 141/278] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:33 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1554 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:34.751599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f6004608-42c0-42b0-ab01-5dca25e26369 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:34.753291 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f6004608-42c0-42b0-ab01-5dca25e26369 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:34.759851 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6004608-42c0-42b0-ab01-5dca25e26369 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:34.760727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6004608-42c0-42b0-ab01-5dca25e26369 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:34.762260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6004608-42c0-42b0-ab01-5dca25e26369 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:34.763796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6004608-42c0-42b0-ab01-5dca25e26369 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:34.764644 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6004608-42c0-42b0-ab01-5dca25e26369 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:34.765238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6004608-42c0-42b0-ab01-5dca25e26369 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:34.948617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f6004608-42c0-42b0-ab01-5dca25e26369 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:34.956869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f6004608-42c0-42b0-ab01-5dca25e26369 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.216666 Sep 05 17:03:34.957773 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 138/279] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:34 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:35.235484 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-281e930a-eed8-4f43-9925-269784aaa627 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:35.236135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-281e930a-eed8-4f43-9925-269784aaa627 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:35.239509 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=34 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:03:35.245810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-281e930a-eed8-4f43-9925-269784aaa627 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:35.246301 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-281e930a-eed8-4f43-9925-269784aaa627 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:35.246877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-281e930a-eed8-4f43-9925-269784aaa627 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:35.247574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-281e930a-eed8-4f43-9925-269784aaa627 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:35.248020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-281e930a-eed8-4f43-9925-269784aaa627 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:35.248759 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-281e930a-eed8-4f43-9925-269784aaa627 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:35.397346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-281e930a-eed8-4f43-9925-269784aaa627 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:35.407411 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-281e930a-eed8-4f43-9925-269784aaa627 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1554 microversion: 2.1 time: 0.175901 Sep 05 17:03:35.407989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 142/280] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:35 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:35.981779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d671e1d7-0eb2-4056-94f1-e7c64a442b85 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:35.982990 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d671e1d7-0eb2-4056-94f1-e7c64a442b85 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:35.991373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d671e1d7-0eb2-4056-94f1-e7c64a442b85 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:35.992167 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d671e1d7-0eb2-4056-94f1-e7c64a442b85 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:35.992811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d671e1d7-0eb2-4056-94f1-e7c64a442b85 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:35.993896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d671e1d7-0eb2-4056-94f1-e7c64a442b85 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:35.994757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d671e1d7-0eb2-4056-94f1-e7c64a442b85 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:35.995675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d671e1d7-0eb2-4056-94f1-e7c64a442b85 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:36.172775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d671e1d7-0eb2-4056-94f1-e7c64a442b85 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:36.182306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d671e1d7-0eb2-4056-94f1-e7c64a442b85 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.205688 Sep 05 17:03:36.183208 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 139/281] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:35 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:36.431171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f411bde4-dbb7-4934-a28b-85faa5932bf1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:36.432492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f411bde4-dbb7-4934-a28b-85faa5932bf1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:36.439124 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f411bde4-dbb7-4934-a28b-85faa5932bf1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:36.439790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f411bde4-dbb7-4934-a28b-85faa5932bf1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:36.440420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f411bde4-dbb7-4934-a28b-85faa5932bf1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:36.441558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f411bde4-dbb7-4934-a28b-85faa5932bf1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:36.442162 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f411bde4-dbb7-4934-a28b-85faa5932bf1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:36.442802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f411bde4-dbb7-4934-a28b-85faa5932bf1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:36.590010 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f411bde4-dbb7-4934-a28b-85faa5932bf1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:36.598661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f411bde4-dbb7-4934-a28b-85faa5932bf1 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1554 microversion: 2.1 time: 0.171600 Sep 05 17:03:36.599230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 143/282] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:36 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:37.207672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cba6ba27-1928-4bb5-98dd-4fd11df43d5f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:37.209112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cba6ba27-1928-4bb5-98dd-4fd11df43d5f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:37.216934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba6ba27-1928-4bb5-98dd-4fd11df43d5f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:37.217533 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba6ba27-1928-4bb5-98dd-4fd11df43d5f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:37.218057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba6ba27-1928-4bb5-98dd-4fd11df43d5f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:37.218862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba6ba27-1928-4bb5-98dd-4fd11df43d5f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:37.219401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba6ba27-1928-4bb5-98dd-4fd11df43d5f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:37.219914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba6ba27-1928-4bb5-98dd-4fd11df43d5f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:37.373503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cba6ba27-1928-4bb5-98dd-4fd11df43d5f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:37.382805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cba6ba27-1928-4bb5-98dd-4fd11df43d5f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.180157 Sep 05 17:03:37.383496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 140/283] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:37 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:37.622585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f196448d-8033-4d50-8bde-7631e707557e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:37.623252 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f196448d-8033-4d50-8bde-7631e707557e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:37.630840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f196448d-8033-4d50-8bde-7631e707557e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:37.631713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f196448d-8033-4d50-8bde-7631e707557e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:37.632261 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f196448d-8033-4d50-8bde-7631e707557e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:37.633292 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f196448d-8033-4d50-8bde-7631e707557e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:37.634081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f196448d-8033-4d50-8bde-7631e707557e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:37.634578 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f196448d-8033-4d50-8bde-7631e707557e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:37.777933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f196448d-8033-4d50-8bde-7631e707557e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:37.787410 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f196448d-8033-4d50-8bde-7631e707557e tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1554 microversion: 2.1 time: 0.168608 Sep 05 17:03:37.788387 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 144/284] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:37 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:38.407409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d317c997-a506-4afb-a171-b364c032ee7d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:38.408005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d317c997-a506-4afb-a171-b364c032ee7d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:38.414920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d317c997-a506-4afb-a171-b364c032ee7d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:38.415435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d317c997-a506-4afb-a171-b364c032ee7d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:38.415866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d317c997-a506-4afb-a171-b364c032ee7d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:38.416596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d317c997-a506-4afb-a171-b364c032ee7d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:38.417046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d317c997-a506-4afb-a171-b364c032ee7d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:38.417464 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d317c997-a506-4afb-a171-b364c032ee7d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:38.559061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d317c997-a506-4afb-a171-b364c032ee7d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:38.566875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d317c997-a506-4afb-a171-b364c032ee7d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.163412 Sep 05 17:03:38.567444 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 141/285] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:38 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:38.815772 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-650096ea-e142-4d7d-be23-88d32649137a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:38.816706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-650096ea-e142-4d7d-be23-88d32649137a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:38.827950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-650096ea-e142-4d7d-be23-88d32649137a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:38.828805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-650096ea-e142-4d7d-be23-88d32649137a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:38.829525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-650096ea-e142-4d7d-be23-88d32649137a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:38.830655 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-650096ea-e142-4d7d-be23-88d32649137a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:38.831409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-650096ea-e142-4d7d-be23-88d32649137a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:38.832101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-650096ea-e142-4d7d-be23-88d32649137a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:38.974520 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-650096ea-e142-4d7d-be23-88d32649137a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:38.989394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-650096ea-e142-4d7d-be23-88d32649137a tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1554 microversion: 2.1 time: 0.180336 Sep 05 17:03:38.989971 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 145/286] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:38 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:39.592755 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f95c2242-51af-442a-8bb0-9d3e45df9f38 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:39.593462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f95c2242-51af-442a-8bb0-9d3e45df9f38 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:39.601743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95c2242-51af-442a-8bb0-9d3e45df9f38 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:39.602739 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95c2242-51af-442a-8bb0-9d3e45df9f38 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:39.603374 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95c2242-51af-442a-8bb0-9d3e45df9f38 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:39.604067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95c2242-51af-442a-8bb0-9d3e45df9f38 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:39.604542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95c2242-51af-442a-8bb0-9d3e45df9f38 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:39.604959 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95c2242-51af-442a-8bb0-9d3e45df9f38 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:39.737840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f95c2242-51af-442a-8bb0-9d3e45df9f38 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:39.745800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f95c2242-51af-442a-8bb0-9d3e45df9f38 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.158821 Sep 05 17:03:39.746402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 142/287] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:39 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:40.015028 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4bb241a2-b236-4b44-a22a-e6f17433d5d9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:40.015948 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4bb241a2-b236-4b44-a22a-e6f17433d5d9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:40.024781 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4bb241a2-b236-4b44-a22a-e6f17433d5d9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:40.026100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4bb241a2-b236-4b44-a22a-e6f17433d5d9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:40.026323 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4bb241a2-b236-4b44-a22a-e6f17433d5d9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:40.027141 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4bb241a2-b236-4b44-a22a-e6f17433d5d9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:40.027820 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4bb241a2-b236-4b44-a22a-e6f17433d5d9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:40.028248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4bb241a2-b236-4b44-a22a-e6f17433d5d9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:40.166060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4bb241a2-b236-4b44-a22a-e6f17433d5d9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:40.174476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4bb241a2-b236-4b44-a22a-e6f17433d5d9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1554 microversion: 2.1 time: 0.164328 Sep 05 17:03:40.175085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 146/288] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:40 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:40.770109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-87c1aade-193c-4892-bca6-747cb9259773 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:40.771306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-87c1aade-193c-4892-bca6-747cb9259773 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:40.780115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87c1aade-193c-4892-bca6-747cb9259773 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:40.780115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87c1aade-193c-4892-bca6-747cb9259773 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:40.780115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87c1aade-193c-4892-bca6-747cb9259773 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:40.780778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87c1aade-193c-4892-bca6-747cb9259773 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:40.780882 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87c1aade-193c-4892-bca6-747cb9259773 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:40.781265 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87c1aade-193c-4892-bca6-747cb9259773 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:40.915343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-87c1aade-193c-4892-bca6-747cb9259773 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:40.923909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-87c1aade-193c-4892-bca6-747cb9259773 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.158078 Sep 05 17:03:40.924485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 143/289] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:40 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:41.198829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5d3b5a0d-e139-4766-9c07-382c6580f3c9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:41.200432 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5d3b5a0d-e139-4766-9c07-382c6580f3c9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:41.208205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d3b5a0d-e139-4766-9c07-382c6580f3c9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:41.209078 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d3b5a0d-e139-4766-9c07-382c6580f3c9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:41.209653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d3b5a0d-e139-4766-9c07-382c6580f3c9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:41.210662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d3b5a0d-e139-4766-9c07-382c6580f3c9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:41.211245 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d3b5a0d-e139-4766-9c07-382c6580f3c9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:41.211823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d3b5a0d-e139-4766-9c07-382c6580f3c9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:41.416863 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5d3b5a0d-e139-4766-9c07-382c6580f3c9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:41.427392 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5d3b5a0d-e139-4766-9c07-382c6580f3c9 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1554 microversion: 2.1 time: 0.233702 Sep 05 17:03:41.428519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 147/290] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:41 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1554 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:03:41.498487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-85cb6def-a399-488b-966a-f34e66a1dab1 req-d463e24b-5e4a-4a2a-a3dd-d305edf86e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f618fb-422b-4e8b-b55d-634720b8646c", "name": "network-vif-deleted", "tag": "fc6aadfe-bed1-4d6d-ae24-330d4a9efe98"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:03:41.508654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-85cb6def-a399-488b-966a-f34e66a1dab1 req-d463e24b-5e4a-4a2a-a3dd-d305edf86e1f service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:41.509639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-85cb6def-a399-488b-966a-f34e66a1dab1 req-d463e24b-5e4a-4a2a-a3dd-d305edf86e1f service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:41.510131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-85cb6def-a399-488b-966a-f34e66a1dab1 req-d463e24b-5e4a-4a2a-a3dd-d305edf86e1f service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:41.524404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-85cb6def-a399-488b-966a-f34e66a1dab1 req-d463e24b-5e4a-4a2a-a3dd-d305edf86e1f service nova] Creating event network-vif-deleted:fc6aadfe-bed1-4d6d-ae24-330d4a9efe98 for instance a7f618fb-422b-4e8b-b55d-634720b8646c on hv-cinder-85596 Sep 05 17:03:41.530994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-85cb6def-a399-488b-966a-f34e66a1dab1 req-d463e24b-5e4a-4a2a-a3dd-d305edf86e1f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036702 Sep 05 17:03:41.531594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 144/291] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:03:41.947236 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2700aeed-0e6b-4cbb-9fc2-62dc9bf99b78 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:41.947982 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2700aeed-0e6b-4cbb-9fc2-62dc9bf99b78 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:41.955047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2700aeed-0e6b-4cbb-9fc2-62dc9bf99b78 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:41.955827 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2700aeed-0e6b-4cbb-9fc2-62dc9bf99b78 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:41.956793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2700aeed-0e6b-4cbb-9fc2-62dc9bf99b78 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:41.957718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2700aeed-0e6b-4cbb-9fc2-62dc9bf99b78 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:41.958357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2700aeed-0e6b-4cbb-9fc2-62dc9bf99b78 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:41.958780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2700aeed-0e6b-4cbb-9fc2-62dc9bf99b78 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:42.126341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2700aeed-0e6b-4cbb-9fc2-62dc9bf99b78 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:42.140308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2700aeed-0e6b-4cbb-9fc2-62dc9bf99b78 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1522 microversion: 2.1 time: 0.197594 Sep 05 17:03:42.155927 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 148/292] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:41 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:42.456334 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dc437865-7c03-456a-9b0b-3f44e00d2f2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:42.458372 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dc437865-7c03-456a-9b0b-3f44e00d2f2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:42.467190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc437865-7c03-456a-9b0b-3f44e00d2f2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:42.467787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc437865-7c03-456a-9b0b-3f44e00d2f2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:42.469009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc437865-7c03-456a-9b0b-3f44e00d2f2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:42.470214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc437865-7c03-456a-9b0b-3f44e00d2f2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:42.470893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc437865-7c03-456a-9b0b-3f44e00d2f2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:42.471654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc437865-7c03-456a-9b0b-3f44e00d2f2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:42.494826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:03:42.547912 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dc437865-7c03-456a-9b0b-3f44e00d2f2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '117a819351b742deb901c081d0a4347b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba05bd3cd4401597809b1fd0cdb439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:42.558693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dc437865-7c03-456a-9b0b-3f44e00d2f2f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 200 len: 1346 microversion: 2.1 time: 0.106515 Sep 05 17:03:42.566261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 145/293] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:42 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 1346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:43.169845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4e429959-e0dc-40be-a56b-bb8dd3568571 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:43.171676 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4e429959-e0dc-40be-a56b-bb8dd3568571 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:43.180326 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e429959-e0dc-40be-a56b-bb8dd3568571 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:43.182225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e429959-e0dc-40be-a56b-bb8dd3568571 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:43.182895 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e429959-e0dc-40be-a56b-bb8dd3568571 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:43.183943 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e429959-e0dc-40be-a56b-bb8dd3568571 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:43.184636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e429959-e0dc-40be-a56b-bb8dd3568571 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:43.185211 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e429959-e0dc-40be-a56b-bb8dd3568571 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:43.376007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4e429959-e0dc-40be-a56b-bb8dd3568571 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:43.386805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4e429959-e0dc-40be-a56b-bb8dd3568571 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1502 microversion: 2.1 time: 0.226482 Sep 05 17:03:43.387716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 149/294] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:43 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:43.411818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9abf47af-5c3d-45f2-8572-b7c3ea8db677 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:43.413137 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9abf47af-5c3d-45f2-8572-b7c3ea8db677 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:43.437647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9abf47af-5c3d-45f2-8572-b7c3ea8db677 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:43.439264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9abf47af-5c3d-45f2-8572-b7c3ea8db677 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:43.441574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9abf47af-5c3d-45f2-8572-b7c3ea8db677 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:43.443516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9abf47af-5c3d-45f2-8572-b7c3ea8db677 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:43.447724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9abf47af-5c3d-45f2-8572-b7c3ea8db677 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:43.448243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9abf47af-5c3d-45f2-8572-b7c3ea8db677 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:43.585594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7451c192-dd40-4586-bbf4-3dd5e2a34373 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:43.586516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7451c192-dd40-4586-bbf4-3dd5e2a34373 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:43.597531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7451c192-dd40-4586-bbf4-3dd5e2a34373 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:43.598869 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7451c192-dd40-4586-bbf4-3dd5e2a34373 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:43.599930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7451c192-dd40-4586-bbf4-3dd5e2a34373 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:43.602912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7451c192-dd40-4586-bbf4-3dd5e2a34373 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:43.603426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7451c192-dd40-4586-bbf4-3dd5e2a34373 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:43.604119 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7451c192-dd40-4586-bbf4-3dd5e2a34373 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:43.627197 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-7451c192-dd40-4586-bbf4-3dd5e2a34373 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] HTTP exception thrown: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:43.640818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9abf47af-5c3d-45f2-8572-b7c3ea8db677 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:43.655265 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9abf47af-5c3d-45f2-8572-b7c3ea8db677 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1515 microversion: 2.1 time: 0.246071 Sep 05 17:03:43.658849 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 146/295] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:43 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1515 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7451c192-dd40-4586-bbf4-3dd5e2a34373 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Request method failure captured: Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c HTTP/1.1 Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFitwkFcRqAWx0-HUVJ9O8W8Fc1T2BnAvBsDm_igPrvUUw2hOVH3bnk9h42Gww9QsZFee6NwxHyLKeVkw-slM7FGvkfmrerDlmjp41OhK5Crx_h7tim6bXNgFFNas5EGmVep6fyfem2wnSy9a2WYoCr1xF0VUzZAw40QpR8QUFFdUtaw Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: 3fba05bd3cd4401597809b1fd0cdb439 Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-DeleteServersTestJSON-1075952444 Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:03:43.660617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:03:43.661853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3fba05bd3cd4401597809b1fd0cdb439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fba05bd3cd4401597809b1fd0cdb439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fba05bd3cd4401597809b1fd0cdb439"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3fba05bd3cd4401597809b1fd0cdb439"}]}] Sep 05 17:03:43.661853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-DeleteServersTestJSON-1075952444 Sep 05 17:03:43.661853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: 3fba05bd3cd4401597809b1fd0cdb439 Sep 05 17:03:43.661853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-DeleteServersTestJSON-1075952444 Sep 05 17:03:43.661853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-DeleteServersTestJSON-1075952444-project Sep 05 17:03:43.661853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:03:43.661853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:03:43.661853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: 117a819351b742deb901c081d0a4347b Sep 05 17:03:43.661853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-DeleteServersTestJSON-1075952444-project Sep 05 17:03:43.661853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:03:43.661853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:43.661853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': 'a7f618fb-422b-4e8b-b55d-634720b8646c'} Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:03:43.662565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:43.663705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:03:43.665687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7451c192-dd40-4586-bbf4-3dd5e2a34373 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Returning 404 to user: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:03:43.666888 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7451c192-dd40-4586-bbf4-3dd5e2a34373 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 404 len: 111 microversion: 2.1 time: 0.086215 Sep 05 17:03:43.667578 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 150/296] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:43 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:03:43.826296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2473d1c8-c95f-49ed-8206-e982da60eb95 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:43.828826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2473d1c8-c95f-49ed-8206-e982da60eb95 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:43.838225 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2473d1c8-c95f-49ed-8206-e982da60eb95 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:43.838713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2473d1c8-c95f-49ed-8206-e982da60eb95 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:43.839169 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2473d1c8-c95f-49ed-8206-e982da60eb95 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:43.843214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2473d1c8-c95f-49ed-8206-e982da60eb95 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:43.843711 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2473d1c8-c95f-49ed-8206-e982da60eb95 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:43.844142 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2473d1c8-c95f-49ed-8206-e982da60eb95 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:43.860537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-2473d1c8-c95f-49ed-8206-e982da60eb95 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] HTTP exception thrown: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2473d1c8-c95f-49ed-8206-e982da60eb95 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Request method failure captured: Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c/os-volume_attachments HTTP/1.1 Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFitwkFcRqAWx0-HUVJ9O8W8Fc1T2BnAvBsDm_igPrvUUw2hOVH3bnk9h42Gww9QsZFee6NwxHyLKeVkw-slM7FGvkfmrerDlmjp41OhK5Crx_h7tim6bXNgFFNas5EGmVep6fyfem2wnSy9a2WYoCr1xF0VUzZAw40QpR8QUFFdUtaw Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: 3fba05bd3cd4401597809b1fd0cdb439 Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-DeleteServersTestJSON-1075952444 Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:03:43.874318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:03:43.875677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3fba05bd3cd4401597809b1fd0cdb439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fba05bd3cd4401597809b1fd0cdb439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fba05bd3cd4401597809b1fd0cdb439"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3fba05bd3cd4401597809b1fd0cdb439"}]}] Sep 05 17:03:43.875677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-DeleteServersTestJSON-1075952444 Sep 05 17:03:43.875677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 3fba05bd3cd4401597809b1fd0cdb439 Sep 05 17:03:43.875677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-DeleteServersTestJSON-1075952444 Sep 05 17:03:43.875677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-DeleteServersTestJSON-1075952444-project Sep 05 17:03:43.875677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:03:43.875677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:03:43.875677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: 117a819351b742deb901c081d0a4347b Sep 05 17:03:43.875677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-DeleteServersTestJSON-1075952444-project Sep 05 17:03:43.875677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:03:43.875677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:43.875677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'server_id': 'a7f618fb-422b-4e8b-b55d-634720b8646c'} Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:03:43.876422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:43.877645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:03:43.879567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2473d1c8-c95f-49ed-8206-e982da60eb95 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Returning 404 to user: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:03:43.879567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2473d1c8-c95f-49ed-8206-e982da60eb95 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.054470 Sep 05 17:03:43.879567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 147/297] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:03:43 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c/os-volume_attachments => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:03:45.214254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-27d0c54a-7027-4311-856b-2b23728364a3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:45.215346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-27d0c54a-7027-4311-856b-2b23728364a3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:45.222681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-27d0c54a-7027-4311-856b-2b23728364a3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:45.223402 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-27d0c54a-7027-4311-856b-2b23728364a3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:45.223821 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-27d0c54a-7027-4311-856b-2b23728364a3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:45.224723 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-27d0c54a-7027-4311-856b-2b23728364a3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:45.225172 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-27d0c54a-7027-4311-856b-2b23728364a3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:45.225768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-27d0c54a-7027-4311-856b-2b23728364a3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:45.246818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-27d0c54a-7027-4311-856b-2b23728364a3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] HTTP exception thrown: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-27d0c54a-7027-4311-856b-2b23728364a3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Request method failure captured: Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: DELETE /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c HTTP/1.1 Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFitwkFcRqAWx0-HUVJ9O8W8Fc1T2BnAvBsDm_igPrvUUw2hOVH3bnk9h42Gww9QsZFee6NwxHyLKeVkw-slM7FGvkfmrerDlmjp41OhK5Crx_h7tim6bXNgFFNas5EGmVep6fyfem2wnSy9a2WYoCr1xF0VUzZAw40QpR8QUFFdUtaw Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: 3fba05bd3cd4401597809b1fd0cdb439 Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-DeleteServersTestJSON-1075952444 Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:03:45.248691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:03:45.249875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3fba05bd3cd4401597809b1fd0cdb439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fba05bd3cd4401597809b1fd0cdb439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fba05bd3cd4401597809b1fd0cdb439"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3fba05bd3cd4401597809b1fd0cdb439"}]}] Sep 05 17:03:45.249875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-DeleteServersTestJSON-1075952444 Sep 05 17:03:45.249875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: 3fba05bd3cd4401597809b1fd0cdb439 Sep 05 17:03:45.249875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-DeleteServersTestJSON-1075952444 Sep 05 17:03:45.249875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-DeleteServersTestJSON-1075952444-project Sep 05 17:03:45.249875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:03:45.249875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:03:45.249875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: 117a819351b742deb901c081d0a4347b Sep 05 17:03:45.249875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-DeleteServersTestJSON-1075952444-project Sep 05 17:03:45.249875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:03:45.249875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:45.249875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': 'a7f618fb-422b-4e8b-b55d-634720b8646c'} Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:03:45.250536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:45.251587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:03:45.253657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-27d0c54a-7027-4311-856b-2b23728364a3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Returning 404 to user: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:03:45.254512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-27d0c54a-7027-4311-856b-2b23728364a3 tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 404 len: 111 microversion: 2.1 time: 0.044920 Sep 05 17:03:45.255087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 151/298] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:03:45 2022] DELETE /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:03:45.266548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7f1ba51f-9982-46d4-9ea6-771707c7280f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:45.267750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7f1ba51f-9982-46d4-9ea6-771707c7280f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] [instance: a7f618fb-422b-4e8b-b55d-634720b8646c] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:45.282133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f1ba51f-9982-46d4-9ea6-771707c7280f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:45.282649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f1ba51f-9982-46d4-9ea6-771707c7280f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:45.284201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f1ba51f-9982-46d4-9ea6-771707c7280f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:45.285465 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f1ba51f-9982-46d4-9ea6-771707c7280f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:45.288112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f1ba51f-9982-46d4-9ea6-771707c7280f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:45.288759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f1ba51f-9982-46d4-9ea6-771707c7280f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:45.313442 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-7f1ba51f-9982-46d4-9ea6-771707c7280f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] HTTP exception thrown: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:45.315096 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-46f6e296-16cc-4d24-9388-24a9419f97df tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7f1ba51f-9982-46d4-9ea6-771707c7280f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Request method failure captured: Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c HTTP/1.1 Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFitwkFcRqAWx0-HUVJ9O8W8Fc1T2BnAvBsDm_igPrvUUw2hOVH3bnk9h42Gww9QsZFee6NwxHyLKeVkw-slM7FGvkfmrerDlmjp41OhK5Crx_h7tim6bXNgFFNas5EGmVep6fyfem2wnSy9a2WYoCr1xF0VUzZAw40QpR8QUFFdUtaw Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: 3fba05bd3cd4401597809b1fd0cdb439 Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-DeleteServersTestJSON-1075952444 Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:03:45.317004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:03:45.324138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3fba05bd3cd4401597809b1fd0cdb439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fba05bd3cd4401597809b1fd0cdb439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fba05bd3cd4401597809b1fd0cdb439"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3fba05bd3cd4401597809b1fd0cdb439"}]}] Sep 05 17:03:45.324138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-DeleteServersTestJSON-1075952444 Sep 05 17:03:45.324138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 3fba05bd3cd4401597809b1fd0cdb439 Sep 05 17:03:45.324138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-DeleteServersTestJSON-1075952444 Sep 05 17:03:45.324138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-DeleteServersTestJSON-1075952444-project Sep 05 17:03:45.324138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:03:45.324138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:03:45.324138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: 117a819351b742deb901c081d0a4347b Sep 05 17:03:45.324138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-DeleteServersTestJSON-1075952444-project Sep 05 17:03:45.324138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:03:45.324138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:45.324138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': 'a7f618fb-422b-4e8b-b55d-634720b8646c'} Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:03:45.326110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. Sep 05 17:03:45.328594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:03:45.331762 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-46f6e296-16cc-4d24-9388-24a9419f97df tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:45.331942 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7f1ba51f-9982-46d4-9ea6-771707c7280f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] Returning 404 to user: Instance a7f618fb-422b-4e8b-b55d-634720b8646c could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:03:45.331942 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7f1ba51f-9982-46d4-9ea6-771707c7280f tempest-DeleteServersTestJSON-1075952444 tempest-DeleteServersTestJSON-1075952444-project] 10.222.0.23 "GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c" status: 404 len: 111 microversion: 2.1 time: 0.058877 Sep 05 17:03:45.331942 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 148/299] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:45 2022] GET /compute/v2.1/servers/a7f618fb-422b-4e8b-b55d-634720b8646c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:03:45.332398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46f6e296-16cc-4d24-9388-24a9419f97df tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:45.332398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46f6e296-16cc-4d24-9388-24a9419f97df tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:45.332398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46f6e296-16cc-4d24-9388-24a9419f97df tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:45.332398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46f6e296-16cc-4d24-9388-24a9419f97df tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:45.334914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46f6e296-16cc-4d24-9388-24a9419f97df tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:45.334914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46f6e296-16cc-4d24-9388-24a9419f97df tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:45.361085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.objects.instance [None req-46f6e296-16cc-4d24-9388-24a9419f97df tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lazy-loading 'flavor' on Instance uuid 2fb25ed7-1069-41a4-b3d3-25231e7322e7 {{(pid=120733) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:03:45.536577 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-46f6e296-16cc-4d24-9388-24a9419f97df tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "POST /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7/action" status: 200 len: 32 microversion: 2.1 time: 0.223555 Sep 05 17:03:45.556364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 152/300] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Sep 5 17:03:45 2022] POST /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7/action => generated 32 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 17:03:45.558261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-52824848-5408-4942-9e01-168b5cfba793 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:45.559040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-52824848-5408-4942-9e01-168b5cfba793 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:45.579095 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52824848-5408-4942-9e01-168b5cfba793 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:45.579799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52824848-5408-4942-9e01-168b5cfba793 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:45.585140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52824848-5408-4942-9e01-168b5cfba793 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:45.586163 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52824848-5408-4942-9e01-168b5cfba793 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:45.586865 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52824848-5408-4942-9e01-168b5cfba793 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:45.587868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52824848-5408-4942-9e01-168b5cfba793 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:45.845801 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-52824848-5408-4942-9e01-168b5cfba793 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:45.855274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-52824848-5408-4942-9e01-168b5cfba793 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1521 microversion: 2.1 time: 0.310638 Sep 05 17:03:45.856563 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 149/301] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:45 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:03:46.882474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-338e6cf1-935a-48e7-8fa0-51014ab6ba25 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:46.884336 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-338e6cf1-935a-48e7-8fa0-51014ab6ba25 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:46.895140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-338e6cf1-935a-48e7-8fa0-51014ab6ba25 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:46.895962 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-338e6cf1-935a-48e7-8fa0-51014ab6ba25 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:46.896686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-338e6cf1-935a-48e7-8fa0-51014ab6ba25 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:46.897702 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-338e6cf1-935a-48e7-8fa0-51014ab6ba25 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:46.898372 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-338e6cf1-935a-48e7-8fa0-51014ab6ba25 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:46.899104 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-338e6cf1-935a-48e7-8fa0-51014ab6ba25 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:47.190259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-338e6cf1-935a-48e7-8fa0-51014ab6ba25 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:47.204971 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-338e6cf1-935a-48e7-8fa0-51014ab6ba25 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1521 microversion: 2.1 time: 0.328853 Sep 05 17:03:47.205866 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 153/302] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:46 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:48.231935 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-70cd32a1-5125-4d01-9bff-23470d292b50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:48.232557 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-70cd32a1-5125-4d01-9bff-23470d292b50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:48.255075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70cd32a1-5125-4d01-9bff-23470d292b50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:48.255594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70cd32a1-5125-4d01-9bff-23470d292b50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:48.256667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70cd32a1-5125-4d01-9bff-23470d292b50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:48.262673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70cd32a1-5125-4d01-9bff-23470d292b50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:48.264689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70cd32a1-5125-4d01-9bff-23470d292b50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:48.265355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70cd32a1-5125-4d01-9bff-23470d292b50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:48.655965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-70cd32a1-5125-4d01-9bff-23470d292b50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:48.670462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-70cd32a1-5125-4d01-9bff-23470d292b50 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1521 microversion: 2.1 time: 0.442797 Sep 05 17:03:48.671801 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 150/303] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:48 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:49.696674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-90b8d33f-549b-488d-9d33-06d5443e0d54 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:49.696674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-90b8d33f-549b-488d-9d33-06d5443e0d54 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:49.718758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90b8d33f-549b-488d-9d33-06d5443e0d54 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:49.719229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90b8d33f-549b-488d-9d33-06d5443e0d54 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:49.723738 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90b8d33f-549b-488d-9d33-06d5443e0d54 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:49.727963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90b8d33f-549b-488d-9d33-06d5443e0d54 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:49.728824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90b8d33f-549b-488d-9d33-06d5443e0d54 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:49.729427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90b8d33f-549b-488d-9d33-06d5443e0d54 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:50.070066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-90b8d33f-549b-488d-9d33-06d5443e0d54 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:50.083858 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-90b8d33f-549b-488d-9d33-06d5443e0d54 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1521 microversion: 2.1 time: 0.392675 Sep 05 17:03:50.093392 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 154/304] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:49 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:50.608628 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-447066251", "imageRef": "c1a4f3d3-4d68-489a-a57b-bae7854beb29", "flavorRef": "452", "networks": [{"uuid": "e11c3f3f-a1e3-40cc-b5a2-e53e07acc40b"}]}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:03:50.699271 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] validate_networks() for [('e11c3f3f-a1e3-40cc-b5a2-e53e07acc40b', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:03:51.107459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c36b7667-fe27-434e-86af-0cd6ddd77c57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:51.108243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c36b7667-fe27-434e-86af-0cd6ddd77c57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:51.119487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c36b7667-fe27-434e-86af-0cd6ddd77c57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:51.122359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c36b7667-fe27-434e-86af-0cd6ddd77c57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:51.124016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c36b7667-fe27-434e-86af-0cd6ddd77c57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:51.128700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c36b7667-fe27-434e-86af-0cd6ddd77c57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:51.129869 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c36b7667-fe27-434e-86af-0cd6ddd77c57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:51.130626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c36b7667-fe27-434e-86af-0cd6ddd77c57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:51.174109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:03:51.843711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c36b7667-fe27-434e-86af-0cd6ddd77c57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:51.865319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c36b7667-fe27-434e-86af-0cd6ddd77c57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1521 microversion: 2.1 time: 0.761687 Sep 05 17:03:51.866426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 155/305] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:51 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1521 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:52.084470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:03:52.085048 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:03:52.086139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:03:52.086561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:03:52.087080 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:03:52.101133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:52.102112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:52.102988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:52.103618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:52.104081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:52.104538 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:52.142345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Getting quotas for project 375cd031a57847ed99991340bf65d3d3. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:03:52.155108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Getting quotas for user dc83779cc4e54be794873d62e3ac9061 and project 375cd031a57847ed99991340bf65d3d3. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:03:52.205965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:03:52.211357 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a4f3d3-4d68-489a-a57b-bae7854beb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:03:52.277021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a6210e39-ee82-4f11-988c-cc90307de8b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.672978 Sep 05 17:03:52.284375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 151/306] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:03:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 17:03:52.289357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0076775a-aabb-43f7-a2fd-3c50c7be9b93 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:52.290183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0076775a-aabb-43f7-a2fd-3c50c7be9b93 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:52.360313 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0076775a-aabb-43f7-a2fd-3c50c7be9b93 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:52.388735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0076775a-aabb-43f7-a2fd-3c50c7be9b93 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1218 microversion: 2.1 time: 0.103256 Sep 05 17:03:52.390193 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 156/307] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:52 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:52.895483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2b8bcc97-de3b-4418-bea0-3d20b641252e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:52.896280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2b8bcc97-de3b-4418-bea0-3d20b641252e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:52.908251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b8bcc97-de3b-4418-bea0-3d20b641252e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:52.908919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b8bcc97-de3b-4418-bea0-3d20b641252e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:52.909510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b8bcc97-de3b-4418-bea0-3d20b641252e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:52.910467 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b8bcc97-de3b-4418-bea0-3d20b641252e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:52.910914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b8bcc97-de3b-4418-bea0-3d20b641252e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:52.911332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b8bcc97-de3b-4418-bea0-3d20b641252e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:53.268853 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2b8bcc97-de3b-4418-bea0-3d20b641252e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:53.283063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2b8bcc97-de3b-4418-bea0-3d20b641252e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1521 microversion: 2.1 time: 0.394768 Sep 05 17:03:53.300980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 152/308] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:52 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:53.414529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f37e403f-8e59-46e7-b2f2-834b89709117 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:53.415355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f37e403f-8e59-46e7-b2f2-834b89709117 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:53.426689 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f37e403f-8e59-46e7-b2f2-834b89709117 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:53.427170 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f37e403f-8e59-46e7-b2f2-834b89709117 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:53.428498 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f37e403f-8e59-46e7-b2f2-834b89709117 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:53.432839 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f37e403f-8e59-46e7-b2f2-834b89709117 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:53.434389 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f37e403f-8e59-46e7-b2f2-834b89709117 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:53.436694 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f37e403f-8e59-46e7-b2f2-834b89709117 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:53.632095 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f37e403f-8e59-46e7-b2f2-834b89709117 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:53.641118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f37e403f-8e59-46e7-b2f2-834b89709117 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1222 microversion: 2.1 time: 0.232059 Sep 05 17:03:53.641729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 157/309] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:53 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1222 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:54.327926 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-27d1e6ff-22c9-4051-9818-603394cee96d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:54.328837 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-27d1e6ff-22c9-4051-9818-603394cee96d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:54.336460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27d1e6ff-22c9-4051-9818-603394cee96d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:54.337288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27d1e6ff-22c9-4051-9818-603394cee96d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:54.338027 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27d1e6ff-22c9-4051-9818-603394cee96d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:54.339638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27d1e6ff-22c9-4051-9818-603394cee96d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:54.340309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27d1e6ff-22c9-4051-9818-603394cee96d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:54.341017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27d1e6ff-22c9-4051-9818-603394cee96d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:54.543279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-27d1e6ff-22c9-4051-9818-603394cee96d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:54.552598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-27d1e6ff-22c9-4051-9818-603394cee96d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1521 microversion: 2.1 time: 0.229318 Sep 05 17:03:54.554280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 153/310] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:54 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:54.668654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d548afbb-5de8-42ef-97b3-7fd1d901adde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:54.670066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d548afbb-5de8-42ef-97b3-7fd1d901adde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:54.695671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d548afbb-5de8-42ef-97b3-7fd1d901adde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:54.696483 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d548afbb-5de8-42ef-97b3-7fd1d901adde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:54.697439 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d548afbb-5de8-42ef-97b3-7fd1d901adde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:54.697861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d548afbb-5de8-42ef-97b3-7fd1d901adde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:54.698311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d548afbb-5de8-42ef-97b3-7fd1d901adde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:54.698951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d548afbb-5de8-42ef-97b3-7fd1d901adde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:54.829333 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d548afbb-5de8-42ef-97b3-7fd1d901adde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:54.838119 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d548afbb-5de8-42ef-97b3-7fd1d901adde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1270 microversion: 2.1 time: 0.175016 Sep 05 17:03:54.852640 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 158/311] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:54 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1270 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:55.577094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1d182503-8711-4cb6-b711-c7cbac062b42 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:55.577722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1d182503-8711-4cb6-b711-c7cbac062b42 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:55.594103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d182503-8711-4cb6-b711-c7cbac062b42 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:55.594664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d182503-8711-4cb6-b711-c7cbac062b42 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:55.595294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d182503-8711-4cb6-b711-c7cbac062b42 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:55.596453 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d182503-8711-4cb6-b711-c7cbac062b42 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:55.597068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d182503-8711-4cb6-b711-c7cbac062b42 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:55.597649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d182503-8711-4cb6-b711-c7cbac062b42 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:55.863573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c49eff7c-c629-45ef-aef4-ce0b5241ec51 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:55.865521 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c49eff7c-c629-45ef-aef4-ce0b5241ec51 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:55.880403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c49eff7c-c629-45ef-aef4-ce0b5241ec51 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:55.881215 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c49eff7c-c629-45ef-aef4-ce0b5241ec51 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:55.881809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c49eff7c-c629-45ef-aef4-ce0b5241ec51 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:55.882700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c49eff7c-c629-45ef-aef4-ce0b5241ec51 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:55.884065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c49eff7c-c629-45ef-aef4-ce0b5241ec51 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:55.884713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c49eff7c-c629-45ef-aef4-ce0b5241ec51 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:55.950515 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1d182503-8711-4cb6-b711-c7cbac062b42 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:55.964141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1d182503-8711-4cb6-b711-c7cbac062b42 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1521 microversion: 2.1 time: 0.389633 Sep 05 17:03:55.965278 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 154/312] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:55 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:56.033755 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c49eff7c-c629-45ef-aef4-ce0b5241ec51 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:56.044793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c49eff7c-c629-45ef-aef4-ce0b5241ec51 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1276 microversion: 2.1 time: 0.185957 Sep 05 17:03:56.060624 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 159/313] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:55 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1276 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:56.988769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-022a449f-f657-4fdf-860a-80c1291aec57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:56.989454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-022a449f-f657-4fdf-860a-80c1291aec57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:56.995614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-022a449f-f657-4fdf-860a-80c1291aec57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:56.996099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-022a449f-f657-4fdf-860a-80c1291aec57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:56.996565 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-022a449f-f657-4fdf-860a-80c1291aec57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:56.997296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-022a449f-f657-4fdf-860a-80c1291aec57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:56.998037 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-022a449f-f657-4fdf-860a-80c1291aec57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:56.999025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-022a449f-f657-4fdf-860a-80c1291aec57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:57.069331 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-01a21105-06b4-4828-9916-633b4da2d0ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:57.069928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-01a21105-06b4-4828-9916-633b4da2d0ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:57.078360 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-01a21105-06b4-4828-9916-633b4da2d0ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:57.078937 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-01a21105-06b4-4828-9916-633b4da2d0ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:57.079797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-01a21105-06b4-4828-9916-633b4da2d0ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:57.080760 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-01a21105-06b4-4828-9916-633b4da2d0ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:57.081212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-01a21105-06b4-4828-9916-633b4da2d0ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:57.081641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-01a21105-06b4-4828-9916-633b4da2d0ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:57.240298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-022a449f-f657-4fdf-860a-80c1291aec57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:57.252591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-022a449f-f657-4fdf-860a-80c1291aec57 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1501 microversion: 2.1 time: 0.267867 Sep 05 17:03:57.253558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 155/314] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:56 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1501 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:57.277994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1758370f-c503-431d-a542-f87dd70b4a6f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5aff518-9ba5-4801-8cea-d255fd6d4cf0"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:03:57.280813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1758370f-c503-431d-a542-f87dd70b4a6f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:57.288032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1758370f-c503-431d-a542-f87dd70b4a6f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:57.291450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1758370f-c503-431d-a542-f87dd70b4a6f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:57.292234 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1758370f-c503-431d-a542-f87dd70b4a6f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:57.293450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1758370f-c503-431d-a542-f87dd70b4a6f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:57.294128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1758370f-c503-431d-a542-f87dd70b4a6f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:57.294767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1758370f-c503-431d-a542-f87dd70b4a6f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:57.317828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-01a21105-06b4-4828-9916-633b4da2d0ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:57.326303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-01a21105-06b4-4828-9916-633b4da2d0ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1276 microversion: 2.1 time: 0.260826 Sep 05 17:03:57.326811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-1758370f-c503-431d-a542-f87dd70b4a6f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] HTTP exception thrown: Cannot 'attach_volume' instance 2fb25ed7-1069-41a4-b3d3-25231e7322e7 while it is in vm_state rescued Sep 05 17:03:57.327573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 160/315] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:57 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1758370f-c503-431d-a542-f87dd70b4a6f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Request method failure captured: Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: POST /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7/os-volume_attachments HTTP/1.1 Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 74 Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFitxdGDptMqKaSDcVcmkRm1t48CriV9c0ccA6Z1f3PBhZ4X3VOBQrmrnSwoQJNXHENpQxOK9N_VWBLXzvYEwxkL7F6ZeCtCe8BAOiO0gzsNLKUjsJwSlh16H3BtCRgZARE5xoQqGlZxRzVVM6Hcrsb1HnEo3UGWPn2hD9AA0yp03J-k Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: cdbd9f06f3484da6a6fd14977b82f384 Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1395654055 Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:03:57.328939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:03:57.330198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cdbd9f06f3484da6a6fd14977b82f384"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cdbd9f06f3484da6a6fd14977b82f384"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cdbd9f06f3484da6a6fd14977b82f384"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cdbd9f06f3484da6a6fd14977b82f384"}]}] Sep 05 17:03:57.330198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1395654055 Sep 05 17:03:57.330198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: cdbd9f06f3484da6a6fd14977b82f384 Sep 05 17:03:57.330198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1395654055 Sep 05 17:03:57.330198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-ServerRescueNegativeTestJSON-1395654055-project Sep 05 17:03:57.330198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:03:57.330198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:03:57.330198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: 06e60909a8b04008af659620527e3236 Sep 05 17:03:57.330198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1395654055-project Sep 05 17:03:57.330198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Sep 05 17:03:57.330198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {"volumeAttachment": {"volumeId": "d5aff518-9ba5-4801-8cea-d255fd6d4cf0"}} Sep 05 17:03:57.330198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Cannot 'attach_volume' instance 2fb25ed7-1069-41a4-b3d3-25231e7322e7 while it is in vm_state rescued Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'server_id': '2fb25ed7-1069-41a4-b3d3-25231e7322e7', 'body': {'volumeAttachment': {'volumeId': 'd5aff518-9ba5-4801-8cea-d255fd6d4cf0'}}} Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2fb25ed7-1069-41a4-b3d3-25231e7322e7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:03:57.331038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2fb25ed7-1069-41a4-b3d3-25231e7322e7 while it is in vm_state rescued Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:03:57.332363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:03:57.333653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:03:57.333653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:03:57.333653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2fb25ed7-1069-41a4-b3d3-25231e7322e7 while it is in vm_state rescued Sep 05 17:03:57.333653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:03:57.334814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1758370f-c503-431d-a542-f87dd70b4a6f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Returning 409 to user: Cannot 'attach_volume' instance 2fb25ed7-1069-41a4-b3d3-25231e7322e7 while it is in vm_state rescued {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:03:57.335865 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1758370f-c503-431d-a542-f87dd70b4a6f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "POST /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063195 Sep 05 17:03:57.336895 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 156/316] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Sep 5 17:03:57 2022] POST /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7/os-volume_attachments => generated 152 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 05 17:03:57.353593 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a413e67e-4275-41d7-ba7e-d250212270ac tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:03:57.354194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a413e67e-4275-41d7-ba7e-d250212270ac tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:57.360823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a413e67e-4275-41d7-ba7e-d250212270ac tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:57.361631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a413e67e-4275-41d7-ba7e-d250212270ac tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:57.362289 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a413e67e-4275-41d7-ba7e-d250212270ac tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:57.363190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a413e67e-4275-41d7-ba7e-d250212270ac tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:57.363835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a413e67e-4275-41d7-ba7e-d250212270ac tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:57.364477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a413e67e-4275-41d7-ba7e-d250212270ac tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:57.453958 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a413e67e-4275-41d7-ba7e-d250212270ac tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "POST /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7/action" status: 202 len: 0 microversion: 2.1 time: 0.104352 Sep 05 17:03:57.458955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 161/317] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Sep 5 17:03:57 2022] POST /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:03:57.463653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7273e19e-2e11-49e3-bf1d-e7f23bd2585d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:57.464338 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7273e19e-2e11-49e3-bf1d-e7f23bd2585d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:57.479070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7273e19e-2e11-49e3-bf1d-e7f23bd2585d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:57.479588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7273e19e-2e11-49e3-bf1d-e7f23bd2585d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:57.481108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7273e19e-2e11-49e3-bf1d-e7f23bd2585d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:57.482003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7273e19e-2e11-49e3-bf1d-e7f23bd2585d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:57.482461 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7273e19e-2e11-49e3-bf1d-e7f23bd2585d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:57.483047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7273e19e-2e11-49e3-bf1d-e7f23bd2585d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:57.907564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7273e19e-2e11-49e3-bf1d-e7f23bd2585d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:57.925578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7273e19e-2e11-49e3-bf1d-e7f23bd2585d tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1509 microversion: 2.1 time: 0.465738 Sep 05 17:03:57.926806 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 157/318] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:57 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1509 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:03:58.351248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-968c5292-a6ec-4169-bf24-5ede7e6fa78d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:58.352329 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-968c5292-a6ec-4169-bf24-5ede7e6fa78d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:58.360624 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-968c5292-a6ec-4169-bf24-5ede7e6fa78d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:58.361110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-968c5292-a6ec-4169-bf24-5ede7e6fa78d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:58.361533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-968c5292-a6ec-4169-bf24-5ede7e6fa78d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:58.362202 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-968c5292-a6ec-4169-bf24-5ede7e6fa78d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:58.362648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-968c5292-a6ec-4169-bf24-5ede7e6fa78d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:58.363180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-968c5292-a6ec-4169-bf24-5ede7e6fa78d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:58.433228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-968c5292-a6ec-4169-bf24-5ede7e6fa78d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:58.442536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-968c5292-a6ec-4169-bf24-5ede7e6fa78d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1276 microversion: 2.1 time: 0.096212 Sep 05 17:03:58.443717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 162/319] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:58 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1276 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:58.951462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e827fa2e-9c75-467a-bde3-54b41c898572 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:58.952808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e827fa2e-9c75-467a-bde3-54b41c898572 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:58.961631 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e827fa2e-9c75-467a-bde3-54b41c898572 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:58.966352 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e827fa2e-9c75-467a-bde3-54b41c898572 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:58.967061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e827fa2e-9c75-467a-bde3-54b41c898572 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:58.978683 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e827fa2e-9c75-467a-bde3-54b41c898572 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:58.979780 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e827fa2e-9c75-467a-bde3-54b41c898572 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:58.980490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e827fa2e-9c75-467a-bde3-54b41c898572 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:59.127116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e827fa2e-9c75-467a-bde3-54b41c898572 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:59.136298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e827fa2e-9c75-467a-bde3-54b41c898572 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1509 microversion: 2.1 time: 0.189755 Sep 05 17:03:59.137276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 158/320] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:58 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:59.466440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3cd473dd-c460-4822-b744-bd2ebc5cb942 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:03:59.467643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3cd473dd-c460-4822-b744-bd2ebc5cb942 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:03:59.474466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cd473dd-c460-4822-b744-bd2ebc5cb942 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:59.475210 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cd473dd-c460-4822-b744-bd2ebc5cb942 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:59.475706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cd473dd-c460-4822-b744-bd2ebc5cb942 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:59.476671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cd473dd-c460-4822-b744-bd2ebc5cb942 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:03:59.477749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cd473dd-c460-4822-b744-bd2ebc5cb942 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:03:59.478252 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cd473dd-c460-4822-b744-bd2ebc5cb942 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:03:59.546359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3cd473dd-c460-4822-b744-bd2ebc5cb942 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:03:59.554882 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3cd473dd-c460-4822-b744-bd2ebc5cb942 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1276 microversion: 2.1 time: 0.092350 Sep 05 17:03:59.555457 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 163/321] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:03:59 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:03:59.777332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5354afb6-0e72-477e-84f2-0660bea5131b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Action: 'create', calling method: .version_select at 0x7f1d3af28040>, body: {"keypair": {"name": "tempest-keypair-668573268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqGAxbE5WoIdF7/GpyITZX1jPt/AmRPz+AmjDcJD0I78EF9yXjQeUZNEMryMgPgRfOUgYFnxZViNzGGLoULksPfecFEEpSxd8GdrfWhn6vdaJeYxovIuwW6FkGKHK0tNg=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:03:59.794217 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-5354afb6-0e72-477e-84f2-0660bea5131b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Getting quotas for project c6ed4f1f1246408099252ebea491832c. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:03:59.798342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-5354afb6-0e72-477e-84f2-0660bea5131b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Getting quotas for user 2b81fb00b1b545308d01f74a55b7e77b and project c6ed4f1f1246408099252ebea491832c. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:03:59.842082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5354afb6-0e72-477e-84f2-0660bea5131b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.209689 Sep 05 17:03:59.843667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 159/322] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Sep 5 17:03:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:04:00.160973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c30329b4-89f1-4eb8-a38e-62f34501206f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:00.161717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c30329b4-89f1-4eb8-a38e-62f34501206f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:00.168471 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c30329b4-89f1-4eb8-a38e-62f34501206f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:00.169269 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c30329b4-89f1-4eb8-a38e-62f34501206f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:00.169887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c30329b4-89f1-4eb8-a38e-62f34501206f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:00.170746 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c30329b4-89f1-4eb8-a38e-62f34501206f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:00.171347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c30329b4-89f1-4eb8-a38e-62f34501206f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:00.171918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c30329b4-89f1-4eb8-a38e-62f34501206f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:00.449022 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c30329b4-89f1-4eb8-a38e-62f34501206f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:00.462317 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c30329b4-89f1-4eb8-a38e-62f34501206f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1509 microversion: 2.1 time: 0.303351 Sep 05 17:04:00.481251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 164/323] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:00 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1509 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:04:00.578717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b3fdc530-657c-4e8a-85fd-8038868d4941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:00.579365 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b3fdc530-657c-4e8a-85fd-8038868d4941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:00.610488 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3fdc530-657c-4e8a-85fd-8038868d4941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:00.611076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3fdc530-657c-4e8a-85fd-8038868d4941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:00.612619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3fdc530-657c-4e8a-85fd-8038868d4941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:00.613631 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3fdc530-657c-4e8a-85fd-8038868d4941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:00.614303 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3fdc530-657c-4e8a-85fd-8038868d4941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:00.616088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3fdc530-657c-4e8a-85fd-8038868d4941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:01.035946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b3fdc530-657c-4e8a-85fd-8038868d4941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:01.045858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b3fdc530-657c-4e8a-85fd-8038868d4941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1318 microversion: 2.1 time: 0.471571 Sep 05 17:04:01.046441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 160/324] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:00 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:01.489156 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ecf1b67e-fc08-4d74-aba4-f24266510a16 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:01.489754 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ecf1b67e-fc08-4d74-aba4-f24266510a16 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:01.496777 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ecf1b67e-fc08-4d74-aba4-f24266510a16 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:01.497259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ecf1b67e-fc08-4d74-aba4-f24266510a16 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:01.497683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ecf1b67e-fc08-4d74-aba4-f24266510a16 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:01.498355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ecf1b67e-fc08-4d74-aba4-f24266510a16 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:01.498798 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ecf1b67e-fc08-4d74-aba4-f24266510a16 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:01.499212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ecf1b67e-fc08-4d74-aba4-f24266510a16 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:01.645633 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ecf1b67e-fc08-4d74-aba4-f24266510a16 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:01.654279 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ecf1b67e-fc08-4d74-aba4-f24266510a16 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1509 microversion: 2.1 time: 0.169124 Sep 05 17:04:01.654860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 165/325] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:01 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:02.076812 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fcaad9cd-d04d-4f6f-a326-37f5d80cdc71 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:02.078030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fcaad9cd-d04d-4f6f-a326-37f5d80cdc71 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:02.080444 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:02.086303 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcaad9cd-d04d-4f6f-a326-37f5d80cdc71 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:02.087210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcaad9cd-d04d-4f6f-a326-37f5d80cdc71 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:02.100848 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcaad9cd-d04d-4f6f-a326-37f5d80cdc71 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:02.107295 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcaad9cd-d04d-4f6f-a326-37f5d80cdc71 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:02.109136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcaad9cd-d04d-4f6f-a326-37f5d80cdc71 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:02.109801 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcaad9cd-d04d-4f6f-a326-37f5d80cdc71 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:02.132720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:02.319938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-dce0df4b-70a8-4fbf-81e6-8c995d2f70e4 req-01e79b1b-ed2c-4c87-8f69-8de97260e8bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92", "tag": "387901fa-8d53-44e1-82d9-a131fb4468c2"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:02.341188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-dce0df4b-70a8-4fbf-81e6-8c995d2f70e4 req-01e79b1b-ed2c-4c87-8f69-8de97260e8bd service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:02.341810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-dce0df4b-70a8-4fbf-81e6-8c995d2f70e4 req-01e79b1b-ed2c-4c87-8f69-8de97260e8bd service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:02.342248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-dce0df4b-70a8-4fbf-81e6-8c995d2f70e4 req-01e79b1b-ed2c-4c87-8f69-8de97260e8bd service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:02.385102 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=2 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:02.393581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-dce0df4b-70a8-4fbf-81e6-8c995d2f70e4 req-01e79b1b-ed2c-4c87-8f69-8de97260e8bd service nova] Creating event network-changed:387901fa-8d53-44e1-82d9-a131fb4468c2 for instance e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 on hv-cinder-85596 Sep 05 17:04:02.412502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-dce0df4b-70a8-4fbf-81e6-8c995d2f70e4 req-01e79b1b-ed2c-4c87-8f69-8de97260e8bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096095 Sep 05 17:04:02.414406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 166/326] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:04:02.454550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fcaad9cd-d04d-4f6f-a326-37f5d80cdc71 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:02.482941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fcaad9cd-d04d-4f6f-a326-37f5d80cdc71 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1318 microversion: 2.1 time: 0.416359 Sep 05 17:04:02.513331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 161/327] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:02 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:02.680956 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-bc2de531-05ce-4867-813a-27773e6fb9e8 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:02.682467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-bc2de531-05ce-4867-813a-27773e6fb9e8 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:02.704851 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bc2de531-05ce-4867-813a-27773e6fb9e8 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:02.708960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bc2de531-05ce-4867-813a-27773e6fb9e8 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:02.709673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bc2de531-05ce-4867-813a-27773e6fb9e8 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:02.710924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bc2de531-05ce-4867-813a-27773e6fb9e8 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:02.714316 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bc2de531-05ce-4867-813a-27773e6fb9e8 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:02.717568 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bc2de531-05ce-4867-813a-27773e6fb9e8 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:03.092678 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1514566311", "imageRef": "c1a4f3d3-4d68-489a-a57b-bae7854beb29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d0f5cb4-668d-4cba-a489-7255c177e6e4"}], "security_groups": [{"name": "tempest-securitygroup--435639428"}], "key_name": "tempest-keypair-668573268", "user_data": "}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:03.128583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bc2de531-05ce-4867-813a-27773e6fb9e8 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:03.139849 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-bc2de531-05ce-4867-813a-27773e6fb9e8 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1509 microversion: 2.1 time: 0.464824 Sep 05 17:04:03.157969 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 167/328] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:02 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1509 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:03.287408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] validate_networks() for [('8d0f5cb4-668d-4cba-a489-7255c177e6e4', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:04:03.514225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-05c497d8-6dfb-40a2-b240-1e9886444a3b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:03.515314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-05c497d8-6dfb-40a2-b240-1e9886444a3b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:03.524396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05c497d8-6dfb-40a2-b240-1e9886444a3b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:03.525878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05c497d8-6dfb-40a2-b240-1e9886444a3b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:03.526495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05c497d8-6dfb-40a2-b240-1e9886444a3b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:03.527362 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05c497d8-6dfb-40a2-b240-1e9886444a3b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:03.528105 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05c497d8-6dfb-40a2-b240-1e9886444a3b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:03.528781 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05c497d8-6dfb-40a2-b240-1e9886444a3b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:03.828203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-05c497d8-6dfb-40a2-b240-1e9886444a3b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:03.838830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-05c497d8-6dfb-40a2-b240-1e9886444a3b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1318 microversion: 2.1 time: 0.330281 Sep 05 17:04:03.839657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 168/329] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:03 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:03.900695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:04:03.901165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:04:03.901948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:04:03.902620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:04:03.903336 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:04:03.918122 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:03.918599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:03.919029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:03.920079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:03.920729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:03.921634 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:03.942831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Getting quotas for project c6ed4f1f1246408099252ebea491832c. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:04:03.947508 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Getting quotas for user 2b81fb00b1b545308d01f74a55b7e77b and project c6ed4f1f1246408099252ebea491832c. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:04:03.959147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:04:03.961454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a4f3d3-4d68-489a-a57b-bae7854beb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:04:04.026201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8a686578-e0f3-4329-ae68-59f9ed26c8be tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.938932 Sep 05 17:04:04.033666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 162/330] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:04:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 17:04:04.050664 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f4b1fb73-5806-43fd-856c-cf263d8f4360 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:04.054504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f4b1fb73-5806-43fd-856c-cf263d8f4360 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:04.172143 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6591f827-bec1-4792-b10e-e7ad9284170c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:04.172764 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6591f827-bec1-4792-b10e-e7ad9284170c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:04.204535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6591f827-bec1-4792-b10e-e7ad9284170c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:04.205039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6591f827-bec1-4792-b10e-e7ad9284170c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:04.208277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6591f827-bec1-4792-b10e-e7ad9284170c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:04.211001 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6591f827-bec1-4792-b10e-e7ad9284170c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:04.212430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6591f827-bec1-4792-b10e-e7ad9284170c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:04.216121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6591f827-bec1-4792-b10e-e7ad9284170c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:04.284366 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f4b1fb73-5806-43fd-856c-cf263d8f4360 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:04.295054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f4b1fb73-5806-43fd-856c-cf263d8f4360 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1241 microversion: 2.1 time: 0.259072 Sep 05 17:04:04.295651 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 169/331] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:04 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1241 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:04.449748 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6591f827-bec1-4792-b10e-e7ad9284170c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:04.458735 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6591f827-bec1-4792-b10e-e7ad9284170c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1509 microversion: 2.1 time: 0.291400 Sep 05 17:04:04.461991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 163/332] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:04 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1509 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:04.866124 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e3f90f8b-9ef3-4a88-b780-7a18f140b459 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:04.866832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e3f90f8b-9ef3-4a88-b780-7a18f140b459 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:04.902551 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f90f8b-9ef3-4a88-b780-7a18f140b459 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:04.904776 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f90f8b-9ef3-4a88-b780-7a18f140b459 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:04.905243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f90f8b-9ef3-4a88-b780-7a18f140b459 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:04.908398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f90f8b-9ef3-4a88-b780-7a18f140b459 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:04.909079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f90f8b-9ef3-4a88-b780-7a18f140b459 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:04.909524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f90f8b-9ef3-4a88-b780-7a18f140b459 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:05.184758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e3f90f8b-9ef3-4a88-b780-7a18f140b459 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:05.193532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e3f90f8b-9ef3-4a88-b780-7a18f140b459 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1318 microversion: 2.1 time: 0.334806 Sep 05 17:04:05.194584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 170/333] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:04 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:05.318637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f9f2dc48-8831-41dc-8dac-2f9aab87e8ee tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:05.319941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f9f2dc48-8831-41dc-8dac-2f9aab87e8ee tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:05.329676 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f2dc48-8831-41dc-8dac-2f9aab87e8ee tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:05.330179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f2dc48-8831-41dc-8dac-2f9aab87e8ee tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:05.330605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f2dc48-8831-41dc-8dac-2f9aab87e8ee tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:05.333318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f2dc48-8831-41dc-8dac-2f9aab87e8ee tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:05.334636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f2dc48-8831-41dc-8dac-2f9aab87e8ee tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:05.336378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f2dc48-8831-41dc-8dac-2f9aab87e8ee tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:05.437496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f9f2dc48-8831-41dc-8dac-2f9aab87e8ee tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:05.448882 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f9f2dc48-8831-41dc-8dac-2f9aab87e8ee tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1293 microversion: 2.1 time: 0.134223 Sep 05 17:04:05.450559 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 164/334] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:05 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1293 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:05.485591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-24a5d785-428b-4a79-8249-fdce30143f1a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:05.486297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-24a5d785-428b-4a79-8249-fdce30143f1a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:05.488373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=62 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:05.499515 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-24a5d785-428b-4a79-8249-fdce30143f1a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:05.500747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-24a5d785-428b-4a79-8249-fdce30143f1a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:05.501817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-24a5d785-428b-4a79-8249-fdce30143f1a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:05.503957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-24a5d785-428b-4a79-8249-fdce30143f1a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:05.504450 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-24a5d785-428b-4a79-8249-fdce30143f1a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:05.504884 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-24a5d785-428b-4a79-8249-fdce30143f1a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:05.759968 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-24a5d785-428b-4a79-8249-fdce30143f1a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:05.772877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-24a5d785-428b-4a79-8249-fdce30143f1a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1515 microversion: 2.1 time: 0.290988 Sep 05 17:04:05.785007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 171/335] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:05 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1515 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:06.219433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-55646081-fa78-4233-8faa-a24ad1a05e3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:06.219685 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-55646081-fa78-4233-8faa-a24ad1a05e3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:06.227725 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55646081-fa78-4233-8faa-a24ad1a05e3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:06.228431 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55646081-fa78-4233-8faa-a24ad1a05e3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:06.228878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55646081-fa78-4233-8faa-a24ad1a05e3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:06.229734 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55646081-fa78-4233-8faa-a24ad1a05e3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:06.230327 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55646081-fa78-4233-8faa-a24ad1a05e3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:06.231149 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55646081-fa78-4233-8faa-a24ad1a05e3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:06.440450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-55646081-fa78-4233-8faa-a24ad1a05e3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:06.452560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-55646081-fa78-4233-8faa-a24ad1a05e3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1318 microversion: 2.1 time: 0.238273 Sep 05 17:04:06.454160 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 165/336] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:06 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:06.473118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5a9e3b21-b855-455f-8000-2f3100318555 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:06.476133 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5a9e3b21-b855-455f-8000-2f3100318555 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:06.483642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a9e3b21-b855-455f-8000-2f3100318555 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:06.484270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a9e3b21-b855-455f-8000-2f3100318555 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:06.484936 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a9e3b21-b855-455f-8000-2f3100318555 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:06.485730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a9e3b21-b855-455f-8000-2f3100318555 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:06.486252 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a9e3b21-b855-455f-8000-2f3100318555 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:06.486821 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a9e3b21-b855-455f-8000-2f3100318555 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:06.578248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5a9e3b21-b855-455f-8000-2f3100318555 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:06.592183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5a9e3b21-b855-455f-8000-2f3100318555 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1293 microversion: 2.1 time: 0.122823 Sep 05 17:04:06.592878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 172/337] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:06 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1293 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:07.278189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ac3e6cc2-e4d7-4a99-83ea-371fcb769634 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Action: 'create', calling method: .version_select at 0x7f1d3adfa3a0>, body: {"keypair": {"name": "tempest-keypair-1546866633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3NBHhuriYUNq3A4LeToXgXdONwRcZB9oiDLjDd9IHOLnM62wasj0xVgjdJEyqen52dslg+wd0g7BRxxponwRVw426hRo3y3DnjqlI1gHJu3pOs3/5E97nJPwiaBgvo4w=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:07.294107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-ac3e6cc2-e4d7-4a99-83ea-371fcb769634 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Getting quotas for project cdbd9f06f3484da6a6fd14977b82f384. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:04:07.297902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-ac3e6cc2-e4d7-4a99-83ea-371fcb769634 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Getting quotas for user 06e60909a8b04008af659620527e3236 and project cdbd9f06f3484da6a6fd14977b82f384. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:04:07.321544 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ac3e6cc2-e4d7-4a99-83ea-371fcb769634 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046987 Sep 05 17:04:07.321994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 166/338] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Sep 5 17:04:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:04:07.483331 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-09886006-7910-4b78-94c7-fc4d99e17b3c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:07.492163 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-09886006-7910-4b78-94c7-fc4d99e17b3c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:07.500898 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09886006-7910-4b78-94c7-fc4d99e17b3c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:07.501377 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09886006-7910-4b78-94c7-fc4d99e17b3c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:07.502074 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09886006-7910-4b78-94c7-fc4d99e17b3c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:07.503009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09886006-7910-4b78-94c7-fc4d99e17b3c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:07.503645 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09886006-7910-4b78-94c7-fc4d99e17b3c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:07.504208 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09886006-7910-4b78-94c7-fc4d99e17b3c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:07.628750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-93cf533b-77c7-4e1d-8252-6a75763e9d11 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:07.629240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-93cf533b-77c7-4e1d-8252-6a75763e9d11 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:07.638027 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93cf533b-77c7-4e1d-8252-6a75763e9d11 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:07.639867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93cf533b-77c7-4e1d-8252-6a75763e9d11 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:07.640979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93cf533b-77c7-4e1d-8252-6a75763e9d11 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:07.644666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93cf533b-77c7-4e1d-8252-6a75763e9d11 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:07.645322 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93cf533b-77c7-4e1d-8252-6a75763e9d11 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:07.645951 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93cf533b-77c7-4e1d-8252-6a75763e9d11 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:07.651252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:07.665126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-09886006-7910-4b78-94c7-fc4d99e17b3c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:07.669045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:07.676693 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-09886006-7910-4b78-94c7-fc4d99e17b3c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1318 microversion: 2.1 time: 0.202121 Sep 05 17:04:07.678541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 173/339] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:07 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:07.730669 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-93cf533b-77c7-4e1d-8252-6a75763e9d11 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:07.739570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-93cf533b-77c7-4e1d-8252-6a75763e9d11 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1293 microversion: 2.1 time: 0.125599 Sep 05 17:04:07.741099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 167/340] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:07 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:08.702869 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4b1ede5e-0f51-4c6e-80e0-a5a3208aaa33 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:08.704552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4b1ede5e-0f51-4c6e-80e0-a5a3208aaa33 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:08.717431 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4b1ede5e-0f51-4c6e-80e0-a5a3208aaa33 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:08.721233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4b1ede5e-0f51-4c6e-80e0-a5a3208aaa33 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:08.722255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4b1ede5e-0f51-4c6e-80e0-a5a3208aaa33 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:08.723521 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4b1ede5e-0f51-4c6e-80e0-a5a3208aaa33 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:08.724378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4b1ede5e-0f51-4c6e-80e0-a5a3208aaa33 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:08.725190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4b1ede5e-0f51-4c6e-80e0-a5a3208aaa33 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:08.767115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-04b7da0c-4fcf-4325-9159-cef72fdcc608 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:08.768411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-04b7da0c-4fcf-4325-9159-cef72fdcc608 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:08.784245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04b7da0c-4fcf-4325-9159-cef72fdcc608 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:08.790386 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04b7da0c-4fcf-4325-9159-cef72fdcc608 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:08.792558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04b7da0c-4fcf-4325-9159-cef72fdcc608 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:08.797688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04b7da0c-4fcf-4325-9159-cef72fdcc608 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:08.800318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04b7da0c-4fcf-4325-9159-cef72fdcc608 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:08.802804 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04b7da0c-4fcf-4325-9159-cef72fdcc608 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:09.249625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-04b7da0c-4fcf-4325-9159-cef72fdcc608 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:09.257999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-04b7da0c-4fcf-4325-9159-cef72fdcc608 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1311 microversion: 2.1 time: 0.498477 Sep 05 17:04:09.275359 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 168/341] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:08 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1311 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:09.281459 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-52385351", "imageRef": "c1a4f3d3-4d68-489a-a57b-bae7854beb29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7cd5467-6640-4175-bb4b-ee1f5e095448"}], "security_groups": [{"name": "tempest-securitygroup--2104115599"}], "key_name": "tempest-keypair-1546866633", "user_data": "}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:09.348006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4b1ede5e-0f51-4c6e-80e0-a5a3208aaa33 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:09.357860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4b1ede5e-0f51-4c6e-80e0-a5a3208aaa33 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1318 microversion: 2.1 time: 0.662039 Sep 05 17:04:09.368530 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 174/342] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:08 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1318 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:09.465178 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] validate_networks() for [('c7cd5467-6640-4175-bb4b-ee1f5e095448', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:04:10.189482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:04:10.190209 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:04:10.190543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:04:10.191131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:04:10.191602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:04:10.205496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:10.205980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:10.206408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:10.207125 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:10.207575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:10.209155 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:10.234912 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Getting quotas for project cdbd9f06f3484da6a6fd14977b82f384. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:04:10.239053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Getting quotas for user 06e60909a8b04008af659620527e3236 and project cdbd9f06f3484da6a6fd14977b82f384. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:04:10.260346 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:04:10.262549 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a4f3d3-4d68-489a-a57b-bae7854beb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:04:10.292100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-86748c39-74aa-4777-96d8-a5a716977e75 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:10.293728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-86748c39-74aa-4777-96d8-a5a716977e75 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:10.305587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-86748c39-74aa-4777-96d8-a5a716977e75 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:10.309143 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-86748c39-74aa-4777-96d8-a5a716977e75 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:10.309797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-86748c39-74aa-4777-96d8-a5a716977e75 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:10.313077 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-86748c39-74aa-4777-96d8-a5a716977e75 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:10.313631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-86748c39-74aa-4777-96d8-a5a716977e75 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:10.314118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-86748c39-74aa-4777-96d8-a5a716977e75 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:10.341131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-78780a5f-7fdb-46cb-a3ec-c4b8d06cd92b tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.064233 Sep 05 17:04:10.345493 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 169/343] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:04:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 17:04:10.364499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4d8f2b46-edce-47a4-bd44-d68f0176c12a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:10.365369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4d8f2b46-edce-47a4-bd44-d68f0176c12a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:10.515125 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4d8f2b46-edce-47a4-bd44-d68f0176c12a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:10.525042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4d8f2b46-edce-47a4-bd44-d68f0176c12a tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1244 microversion: 2.1 time: 0.167470 Sep 05 17:04:10.525630 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 170/344] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:10 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1244 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:10.530855 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-409f87ac-033a-4bcf-bf10-27c72315eecc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:10.531717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-409f87ac-033a-4bcf-bf10-27c72315eecc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:10.547112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-409f87ac-033a-4bcf-bf10-27c72315eecc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:10.547596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-409f87ac-033a-4bcf-bf10-27c72315eecc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:10.548210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-409f87ac-033a-4bcf-bf10-27c72315eecc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:10.549889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-409f87ac-033a-4bcf-bf10-27c72315eecc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:10.550503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-409f87ac-033a-4bcf-bf10-27c72315eecc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:10.552120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-409f87ac-033a-4bcf-bf10-27c72315eecc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:10.679093 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-86748c39-74aa-4777-96d8-a5a716977e75 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:10.691346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-86748c39-74aa-4777-96d8-a5a716977e75 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1366 microversion: 2.1 time: 0.409577 Sep 05 17:04:10.692607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 175/345] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:10 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:04:10.814341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-409f87ac-033a-4bcf-bf10-27c72315eecc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:10.822608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-409f87ac-033a-4bcf-bf10-27c72315eecc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1318 microversion: 2.1 time: 0.295344 Sep 05 17:04:10.823312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 171/346] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:10 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:11.226423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-4dbebfca-d8f3-440f-8adf-51b61d37fd13 req-1b4fa349-aed9-4018-acaf-d19e156e5ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e647f8e8-c663-4226-a839-4e44249e4955", "tag": "d7765d2b-82cd-4366-8f14-f3bcb7d033a7"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:11.241360 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-4dbebfca-d8f3-440f-8adf-51b61d37fd13 req-1b4fa349-aed9-4018-acaf-d19e156e5ae8 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:11.241942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-4dbebfca-d8f3-440f-8adf-51b61d37fd13 req-1b4fa349-aed9-4018-acaf-d19e156e5ae8 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:11.242616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-4dbebfca-d8f3-440f-8adf-51b61d37fd13 req-1b4fa349-aed9-4018-acaf-d19e156e5ae8 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:11.257974 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-4dbebfca-d8f3-440f-8adf-51b61d37fd13 req-1b4fa349-aed9-4018-acaf-d19e156e5ae8 service nova] Creating event network-changed:d7765d2b-82cd-4366-8f14-f3bcb7d033a7 for instance e647f8e8-c663-4226-a839-4e44249e4955 on hv-cinder-85596 Sep 05 17:04:11.263467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-4dbebfca-d8f3-440f-8adf-51b61d37fd13 req-1b4fa349-aed9-4018-acaf-d19e156e5ae8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045216 Sep 05 17:04:11.264400 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 176/347] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:04:11.547237 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8833b378-a948-45f2-ac06-0d174f25f197 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:11.547941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8833b378-a948-45f2-ac06-0d174f25f197 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:11.563749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8833b378-a948-45f2-ac06-0d174f25f197 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:11.564483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8833b378-a948-45f2-ac06-0d174f25f197 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:11.565612 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8833b378-a948-45f2-ac06-0d174f25f197 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:11.566393 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8833b378-a948-45f2-ac06-0d174f25f197 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:11.566997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8833b378-a948-45f2-ac06-0d174f25f197 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:11.567407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8833b378-a948-45f2-ac06-0d174f25f197 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:11.667348 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8833b378-a948-45f2-ac06-0d174f25f197 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:11.677358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8833b378-a948-45f2-ac06-0d174f25f197 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1296 microversion: 2.1 time: 0.134151 Sep 05 17:04:11.678244 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 172/348] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:11 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1296 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:11.717462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-64cd390c-189a-4da5-8aee-cee7f995beb2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:11.718147 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-64cd390c-189a-4da5-8aee-cee7f995beb2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:11.725632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64cd390c-189a-4da5-8aee-cee7f995beb2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:11.726118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64cd390c-189a-4da5-8aee-cee7f995beb2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:11.726540 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64cd390c-189a-4da5-8aee-cee7f995beb2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:11.727874 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64cd390c-189a-4da5-8aee-cee7f995beb2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:11.728421 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64cd390c-189a-4da5-8aee-cee7f995beb2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:11.728842 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64cd390c-189a-4da5-8aee-cee7f995beb2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:11.852322 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a69b961d-a0d7-45c4-ab27-e8184dcc0105 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:11.854064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a69b961d-a0d7-45c4-ab27-e8184dcc0105 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:11.864966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a69b961d-a0d7-45c4-ab27-e8184dcc0105 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:11.865457 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a69b961d-a0d7-45c4-ab27-e8184dcc0105 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:11.866362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a69b961d-a0d7-45c4-ab27-e8184dcc0105 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:11.867083 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a69b961d-a0d7-45c4-ab27-e8184dcc0105 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:11.869406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a69b961d-a0d7-45c4-ab27-e8184dcc0105 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:11.869847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a69b961d-a0d7-45c4-ab27-e8184dcc0105 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:11.937908 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-64cd390c-189a-4da5-8aee-cee7f995beb2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:11.947145 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-64cd390c-189a-4da5-8aee-cee7f995beb2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1366 microversion: 2.1 time: 0.234878 Sep 05 17:04:11.970667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 177/349] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:11 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:12.000926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-db343367-e837-43fb-8e83-badfa27646b1 req-aa754998-32ef-400b-b7e3-eadaf09d2cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92", "name": "network-vif-plugged", "status": "completed", "tag": "387901fa-8d53-44e1-82d9-a131fb4468c2"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:12.031830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-db343367-e837-43fb-8e83-badfa27646b1 req-aa754998-32ef-400b-b7e3-eadaf09d2cf3 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:12.032346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-db343367-e837-43fb-8e83-badfa27646b1 req-aa754998-32ef-400b-b7e3-eadaf09d2cf3 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:12.032967 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-db343367-e837-43fb-8e83-badfa27646b1 req-aa754998-32ef-400b-b7e3-eadaf09d2cf3 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:12.055251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-db343367-e837-43fb-8e83-badfa27646b1 req-aa754998-32ef-400b-b7e3-eadaf09d2cf3 service nova] Creating event network-vif-plugged:387901fa-8d53-44e1-82d9-a131fb4468c2 for instance e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 on hv-cinder-85596 Sep 05 17:04:12.061508 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-db343367-e837-43fb-8e83-badfa27646b1 req-aa754998-32ef-400b-b7e3-eadaf09d2cf3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069084 Sep 05 17:04:12.062402 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 178/350] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:04:12.096344 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a69b961d-a0d7-45c4-ab27-e8184dcc0105 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:12.106446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a69b961d-a0d7-45c4-ab27-e8184dcc0105 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1318 microversion: 2.1 time: 0.261498 Sep 05 17:04:12.107282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 173/351] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:11 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:04:12.703953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-96f5fefa-dd42-4d5f-96ca-abe65b1f06e1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:12.704683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-96f5fefa-dd42-4d5f-96ca-abe65b1f06e1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:12.711240 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96f5fefa-dd42-4d5f-96ca-abe65b1f06e1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:12.711864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96f5fefa-dd42-4d5f-96ca-abe65b1f06e1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:12.712901 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96f5fefa-dd42-4d5f-96ca-abe65b1f06e1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:12.713602 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96f5fefa-dd42-4d5f-96ca-abe65b1f06e1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:12.714046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96f5fefa-dd42-4d5f-96ca-abe65b1f06e1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:12.714460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96f5fefa-dd42-4d5f-96ca-abe65b1f06e1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:12.787059 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-96f5fefa-dd42-4d5f-96ca-abe65b1f06e1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:12.795850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-96f5fefa-dd42-4d5f-96ca-abe65b1f06e1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1302 microversion: 2.1 time: 0.096471 Sep 05 17:04:12.796533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 179/352] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:12 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1302 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:12.978830 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b7586e85-fec3-47fc-aa53-2f3ef017444a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:12.980056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b7586e85-fec3-47fc-aa53-2f3ef017444a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:12.986801 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7586e85-fec3-47fc-aa53-2f3ef017444a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:12.987376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7586e85-fec3-47fc-aa53-2f3ef017444a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:12.987847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7586e85-fec3-47fc-aa53-2f3ef017444a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:12.988769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7586e85-fec3-47fc-aa53-2f3ef017444a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:12.989194 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7586e85-fec3-47fc-aa53-2f3ef017444a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:12.989622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7586e85-fec3-47fc-aa53-2f3ef017444a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:13.135622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-dbf5140a-7772-4a2f-862e-278d09a5d4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:13.136559 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-dbf5140a-7772-4a2f-862e-278d09a5d4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:13.143218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbf5140a-7772-4a2f-862e-278d09a5d4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:13.143737 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbf5140a-7772-4a2f-862e-278d09a5d4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:13.144249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbf5140a-7772-4a2f-862e-278d09a5d4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:13.144992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbf5140a-7772-4a2f-862e-278d09a5d4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:13.145480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbf5140a-7772-4a2f-862e-278d09a5d4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:13.145916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbf5140a-7772-4a2f-862e-278d09a5d4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:13.207862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b7586e85-fec3-47fc-aa53-2f3ef017444a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:13.217301 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b7586e85-fec3-47fc-aa53-2f3ef017444a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1366 microversion: 2.1 time: 0.243222 Sep 05 17:04:13.218392 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 174/353] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:12 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:04:13.314701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-dbf5140a-7772-4a2f-862e-278d09a5d4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:13.322535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-dbf5140a-7772-4a2f-862e-278d09a5d4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1318 microversion: 2.1 time: 0.194891 Sep 05 17:04:13.323187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 180/354] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:13 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:04:13.818908 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-803fdf4a-0459-4653-9347-1f8696ad0b62 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:13.819604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-803fdf4a-0459-4653-9347-1f8696ad0b62 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:13.826466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-803fdf4a-0459-4653-9347-1f8696ad0b62 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:13.827023 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-803fdf4a-0459-4653-9347-1f8696ad0b62 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:13.827546 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-803fdf4a-0459-4653-9347-1f8696ad0b62 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:13.828363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-803fdf4a-0459-4653-9347-1f8696ad0b62 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:13.828817 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-803fdf4a-0459-4653-9347-1f8696ad0b62 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:13.829233 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-803fdf4a-0459-4653-9347-1f8696ad0b62 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:13.895203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-803fdf4a-0459-4653-9347-1f8696ad0b62 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:13.903290 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-803fdf4a-0459-4653-9347-1f8696ad0b62 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1302 microversion: 2.1 time: 0.088264 Sep 05 17:04:13.903863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 175/355] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:13 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1302 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:14.249882 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-37a37fd3-ca7d-4589-99fa-282d171268bc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:14.250599 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-37a37fd3-ca7d-4589-99fa-282d171268bc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:14.257059 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37a37fd3-ca7d-4589-99fa-282d171268bc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:14.257558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37a37fd3-ca7d-4589-99fa-282d171268bc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:14.257970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37a37fd3-ca7d-4589-99fa-282d171268bc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:14.258724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37a37fd3-ca7d-4589-99fa-282d171268bc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:14.259165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37a37fd3-ca7d-4589-99fa-282d171268bc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:14.259835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37a37fd3-ca7d-4589-99fa-282d171268bc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:14.290619 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=2 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:14.345566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-78a11af0-95b6-4c26-bd45-06edba2cc930 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:14.346244 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-78a11af0-95b6-4c26-bd45-06edba2cc930 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:14.357022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78a11af0-95b6-4c26-bd45-06edba2cc930 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:14.364203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78a11af0-95b6-4c26-bd45-06edba2cc930 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:14.364854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78a11af0-95b6-4c26-bd45-06edba2cc930 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:14.365885 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78a11af0-95b6-4c26-bd45-06edba2cc930 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:14.366704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78a11af0-95b6-4c26-bd45-06edba2cc930 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:14.367322 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78a11af0-95b6-4c26-bd45-06edba2cc930 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:14.655400 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-37a37fd3-ca7d-4589-99fa-282d171268bc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:14.666323 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-37a37fd3-ca7d-4589-99fa-282d171268bc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1366 microversion: 2.1 time: 0.425091 Sep 05 17:04:14.666933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 181/356] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:14 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:14.723666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-78a11af0-95b6-4c26-bd45-06edba2cc930 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:14.732876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-78a11af0-95b6-4c26-bd45-06edba2cc930 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1318 microversion: 2.1 time: 0.391295 Sep 05 17:04:14.733765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 176/357] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:14 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:14.932083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-64ccf559-6a16-4be3-b577-8f11dd27ac28 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:14.948347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-64ccf559-6a16-4be3-b577-8f11dd27ac28 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:14.954943 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64ccf559-6a16-4be3-b577-8f11dd27ac28 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:14.955426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64ccf559-6a16-4be3-b577-8f11dd27ac28 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:14.955907 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64ccf559-6a16-4be3-b577-8f11dd27ac28 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:14.956616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64ccf559-6a16-4be3-b577-8f11dd27ac28 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:14.957065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64ccf559-6a16-4be3-b577-8f11dd27ac28 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:14.957481 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64ccf559-6a16-4be3-b577-8f11dd27ac28 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:15.303718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-64ccf559-6a16-4be3-b577-8f11dd27ac28 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:15.312969 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-64ccf559-6a16-4be3-b577-8f11dd27ac28 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1302 microversion: 2.1 time: 0.386794 Sep 05 17:04:15.328914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 182/358] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:14 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1302 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:15.691227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1a549bff-1f12-4a5c-8edc-79b714659190 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:15.691819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1a549bff-1f12-4a5c-8edc-79b714659190 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:15.704666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a549bff-1f12-4a5c-8edc-79b714659190 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:15.705186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a549bff-1f12-4a5c-8edc-79b714659190 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:15.705606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a549bff-1f12-4a5c-8edc-79b714659190 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:15.706325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a549bff-1f12-4a5c-8edc-79b714659190 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:15.706761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a549bff-1f12-4a5c-8edc-79b714659190 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:15.707189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a549bff-1f12-4a5c-8edc-79b714659190 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:15.766881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-153c7f64-e38b-4a9f-aa18-fee770f16ca3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:15.768084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-153c7f64-e38b-4a9f-aa18-fee770f16ca3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:15.779091 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-153c7f64-e38b-4a9f-aa18-fee770f16ca3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:15.780817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-153c7f64-e38b-4a9f-aa18-fee770f16ca3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:15.783089 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-153c7f64-e38b-4a9f-aa18-fee770f16ca3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:15.784019 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-153c7f64-e38b-4a9f-aa18-fee770f16ca3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:15.787615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-153c7f64-e38b-4a9f-aa18-fee770f16ca3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:15.788333 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-153c7f64-e38b-4a9f-aa18-fee770f16ca3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:15.932053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1a549bff-1f12-4a5c-8edc-79b714659190 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:15.955976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1a549bff-1f12-4a5c-8edc-79b714659190 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1366 microversion: 2.1 time: 0.268661 Sep 05 17:04:15.968272 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 177/359] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:15 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:16.058034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-153c7f64-e38b-4a9f-aa18-fee770f16ca3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:16.066487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-153c7f64-e38b-4a9f-aa18-fee770f16ca3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1318 microversion: 2.1 time: 0.304621 Sep 05 17:04:16.070541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 183/360] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:15 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:16.340263 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-99cc4f2b-e5d6-472a-b639-53a45b5c1589 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:16.340263 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-99cc4f2b-e5d6-472a-b639-53a45b5c1589 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:16.351550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99cc4f2b-e5d6-472a-b639-53a45b5c1589 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:16.352695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99cc4f2b-e5d6-472a-b639-53a45b5c1589 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:16.353336 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99cc4f2b-e5d6-472a-b639-53a45b5c1589 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:16.354252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99cc4f2b-e5d6-472a-b639-53a45b5c1589 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:16.354854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99cc4f2b-e5d6-472a-b639-53a45b5c1589 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:16.355497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99cc4f2b-e5d6-472a-b639-53a45b5c1589 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:16.743872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-99cc4f2b-e5d6-472a-b639-53a45b5c1589 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:16.753030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-99cc4f2b-e5d6-472a-b639-53a45b5c1589 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1370 microversion: 2.1 time: 0.418794 Sep 05 17:04:16.753870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 178/361] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:16 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1370 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:16.984614 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8ee9e86e-7ef6-41e9-ae1f-5b61b1abebe2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:16.986008 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8ee9e86e-7ef6-41e9-ae1f-5b61b1abebe2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:16.998970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ee9e86e-7ef6-41e9-ae1f-5b61b1abebe2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:16.999459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ee9e86e-7ef6-41e9-ae1f-5b61b1abebe2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:16.999888 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ee9e86e-7ef6-41e9-ae1f-5b61b1abebe2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:17.006393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ee9e86e-7ef6-41e9-ae1f-5b61b1abebe2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:17.007221 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ee9e86e-7ef6-41e9-ae1f-5b61b1abebe2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:17.007880 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ee9e86e-7ef6-41e9-ae1f-5b61b1abebe2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:17.095947 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c35b2bcb-da23-46cb-a704-38480bd7e94f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:17.096666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c35b2bcb-da23-46cb-a704-38480bd7e94f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:17.104607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c35b2bcb-da23-46cb-a704-38480bd7e94f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:17.107766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c35b2bcb-da23-46cb-a704-38480bd7e94f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:17.108553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c35b2bcb-da23-46cb-a704-38480bd7e94f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:17.109657 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c35b2bcb-da23-46cb-a704-38480bd7e94f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:17.110255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c35b2bcb-da23-46cb-a704-38480bd7e94f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:17.111395 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c35b2bcb-da23-46cb-a704-38480bd7e94f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:17.234617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8ee9e86e-7ef6-41e9-ae1f-5b61b1abebe2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:17.244659 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8ee9e86e-7ef6-41e9-ae1f-5b61b1abebe2 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1366 microversion: 2.1 time: 0.264193 Sep 05 17:04:17.245810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 184/362] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:16 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:17.314400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c35b2bcb-da23-46cb-a704-38480bd7e94f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:17.323462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c35b2bcb-da23-46cb-a704-38480bd7e94f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1505 microversion: 2.1 time: 0.233913 Sep 05 17:04:17.324037 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 179/363] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:17 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:04:17.781241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a7283793-9fde-4adc-9218-4dfce1a27feb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:17.781845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a7283793-9fde-4adc-9218-4dfce1a27feb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:17.795829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7283793-9fde-4adc-9218-4dfce1a27feb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:17.796578 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7283793-9fde-4adc-9218-4dfce1a27feb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:17.797342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7283793-9fde-4adc-9218-4dfce1a27feb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:17.799234 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7283793-9fde-4adc-9218-4dfce1a27feb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:17.799909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7283793-9fde-4adc-9218-4dfce1a27feb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:17.800638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7283793-9fde-4adc-9218-4dfce1a27feb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:18.163797 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-73a52e7f-f5ca-42a0-9755-ef7e88effc0c req-d3d3a18e-1bca-4acd-bb2c-1ccdacb71f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e647f8e8-c663-4226-a839-4e44249e4955", "name": "network-vif-plugged", "status": "completed", "tag": "d7765d2b-82cd-4366-8f14-f3bcb7d033a7"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:18.178015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-73a52e7f-f5ca-42a0-9755-ef7e88effc0c req-d3d3a18e-1bca-4acd-bb2c-1ccdacb71f3b service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:18.178590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-73a52e7f-f5ca-42a0-9755-ef7e88effc0c req-d3d3a18e-1bca-4acd-bb2c-1ccdacb71f3b service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:18.178590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-73a52e7f-f5ca-42a0-9755-ef7e88effc0c req-d3d3a18e-1bca-4acd-bb2c-1ccdacb71f3b service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:18.215998 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-73a52e7f-f5ca-42a0-9755-ef7e88effc0c req-d3d3a18e-1bca-4acd-bb2c-1ccdacb71f3b service nova] Creating event network-vif-plugged:d7765d2b-82cd-4366-8f14-f3bcb7d033a7 for instance e647f8e8-c663-4226-a839-4e44249e4955 on hv-cinder-85596 Sep 05 17:04:18.236587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-73a52e7f-f5ca-42a0-9755-ef7e88effc0c req-d3d3a18e-1bca-4acd-bb2c-1ccdacb71f3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071777 Sep 05 17:04:18.239596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 180/364] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:04:18.255074 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a7283793-9fde-4adc-9218-4dfce1a27feb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:18.270111 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a6f393db-51ad-4d12-9be1-f418cd3cfd45 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:18.270872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a6f393db-51ad-4d12-9be1-f418cd3cfd45 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:18.280768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a7283793-9fde-4adc-9218-4dfce1a27feb tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1370 microversion: 2.1 time: 0.507782 Sep 05 17:04:18.287803 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 185/365] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:17 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1370 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:18.290132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6f393db-51ad-4d12-9be1-f418cd3cfd45 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:18.290845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6f393db-51ad-4d12-9be1-f418cd3cfd45 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:18.292691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6f393db-51ad-4d12-9be1-f418cd3cfd45 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:18.293758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6f393db-51ad-4d12-9be1-f418cd3cfd45 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:18.294482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6f393db-51ad-4d12-9be1-f418cd3cfd45 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:18.296048 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6f393db-51ad-4d12-9be1-f418cd3cfd45 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:18.557068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a6f393db-51ad-4d12-9be1-f418cd3cfd45 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:18.566758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a6f393db-51ad-4d12-9be1-f418cd3cfd45 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1366 microversion: 2.1 time: 0.301611 Sep 05 17:04:18.568191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 181/366] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:18 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:18.778007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-1751089f-5e62-4e11-a0af-a4c3b27aa164 req-2b824509-5e6e-4cd8-9d46-4a7ee213718f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "997db40d-a563-4bec-ae08-02d2d7e0eb5d", "tag": "8d4acf9a-8a3d-41cc-b0dc-29dc4170b535"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:18.789749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-1751089f-5e62-4e11-a0af-a4c3b27aa164 req-2b824509-5e6e-4cd8-9d46-4a7ee213718f service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:18.790221 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-1751089f-5e62-4e11-a0af-a4c3b27aa164 req-2b824509-5e6e-4cd8-9d46-4a7ee213718f service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:18.790937 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-1751089f-5e62-4e11-a0af-a4c3b27aa164 req-2b824509-5e6e-4cd8-9d46-4a7ee213718f service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:18.803699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-1751089f-5e62-4e11-a0af-a4c3b27aa164 req-2b824509-5e6e-4cd8-9d46-4a7ee213718f service nova] Creating event network-changed:8d4acf9a-8a3d-41cc-b0dc-29dc4170b535 for instance 997db40d-a563-4bec-ae08-02d2d7e0eb5d on hv-cinder-85596 Sep 05 17:04:18.809566 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-1751089f-5e62-4e11-a0af-a4c3b27aa164 req-2b824509-5e6e-4cd8-9d46-4a7ee213718f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042716 Sep 05 17:04:18.810153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 186/367] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:04:19.313636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c399c88d-56f0-4431-9b1f-00dd7cacf45f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:19.314278 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c399c88d-56f0-4431-9b1f-00dd7cacf45f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:19.320587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c399c88d-56f0-4431-9b1f-00dd7cacf45f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:19.321103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c399c88d-56f0-4431-9b1f-00dd7cacf45f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:19.321528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c399c88d-56f0-4431-9b1f-00dd7cacf45f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:19.322250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c399c88d-56f0-4431-9b1f-00dd7cacf45f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:19.322696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c399c88d-56f0-4431-9b1f-00dd7cacf45f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:19.323102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c399c88d-56f0-4431-9b1f-00dd7cacf45f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:19.591885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2a62042f-db92-42db-a92d-dfe12ad6b9c0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:19.593193 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2a62042f-db92-42db-a92d-dfe12ad6b9c0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:19.603153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a62042f-db92-42db-a92d-dfe12ad6b9c0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:19.603846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a62042f-db92-42db-a92d-dfe12ad6b9c0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:19.604524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a62042f-db92-42db-a92d-dfe12ad6b9c0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:19.605388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a62042f-db92-42db-a92d-dfe12ad6b9c0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:19.605993 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a62042f-db92-42db-a92d-dfe12ad6b9c0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:19.606564 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a62042f-db92-42db-a92d-dfe12ad6b9c0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:19.623820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c399c88d-56f0-4431-9b1f-00dd7cacf45f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:19.633802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c399c88d-56f0-4431-9b1f-00dd7cacf45f tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1370 microversion: 2.1 time: 0.323938 Sep 05 17:04:19.635476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 182/368] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:19 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1370 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:19.926909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2a62042f-db92-42db-a92d-dfe12ad6b9c0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:19.939594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2a62042f-db92-42db-a92d-dfe12ad6b9c0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1366 microversion: 2.1 time: 0.352318 Sep 05 17:04:19.947953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 187/369] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:19 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:04:20.656743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-02600fe6-e50f-4ad3-b9bf-0fb1a48857d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:20.658213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-02600fe6-e50f-4ad3-b9bf-0fb1a48857d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:20.664599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=4 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:20.666383 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=28 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:20.668228 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02600fe6-e50f-4ad3-b9bf-0fb1a48857d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:20.668982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02600fe6-e50f-4ad3-b9bf-0fb1a48857d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:20.677373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02600fe6-e50f-4ad3-b9bf-0fb1a48857d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:20.679038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02600fe6-e50f-4ad3-b9bf-0fb1a48857d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:20.682649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02600fe6-e50f-4ad3-b9bf-0fb1a48857d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:20.685028 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02600fe6-e50f-4ad3-b9bf-0fb1a48857d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:20.974171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-daffa00e-9efd-4f5d-912d-84932103ff77 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:20.974790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-daffa00e-9efd-4f5d-912d-84932103ff77 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:20.984517 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-daffa00e-9efd-4f5d-912d-84932103ff77 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:20.989740 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-daffa00e-9efd-4f5d-912d-84932103ff77 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:20.990380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-daffa00e-9efd-4f5d-912d-84932103ff77 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:20.995522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-daffa00e-9efd-4f5d-912d-84932103ff77 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:20.996231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-daffa00e-9efd-4f5d-912d-84932103ff77 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:21.001687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-daffa00e-9efd-4f5d-912d-84932103ff77 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:21.074268 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-02600fe6-e50f-4ad3-b9bf-0fb1a48857d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:21.089046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-02600fe6-e50f-4ad3-b9bf-0fb1a48857d7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1370 microversion: 2.1 time: 0.433754 Sep 05 17:04:21.104435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 183/370] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:20 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1370 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:21.404907 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-daffa00e-9efd-4f5d-912d-84932103ff77 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:21.421909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-daffa00e-9efd-4f5d-912d-84932103ff77 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1556 microversion: 2.1 time: 0.451617 Sep 05 17:04:21.423237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 188/371] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:20 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1556 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:21.448374 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-64be136c-f837-4c07-aa4c-baa011f1f02c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:21.448972 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-64be136c-f837-4c07-aa4c-baa011f1f02c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:21.458600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64be136c-f837-4c07-aa4c-baa011f1f02c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:21.459465 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64be136c-f837-4c07-aa4c-baa011f1f02c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:21.460136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64be136c-f837-4c07-aa4c-baa011f1f02c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:21.461128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64be136c-f837-4c07-aa4c-baa011f1f02c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:21.462495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64be136c-f837-4c07-aa4c-baa011f1f02c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:21.463147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64be136c-f837-4c07-aa4c-baa011f1f02c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:21.625398 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-64be136c-f837-4c07-aa4c-baa011f1f02c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.177476 Sep 05 17:04:21.626358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 184/372] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Sep 5 17:04:21 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:04:22.118738 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cfb4db46-f1eb-4e13-9113-1ac2bffe0583 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:22.119989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cfb4db46-f1eb-4e13-9113-1ac2bffe0583 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:22.131801 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfb4db46-f1eb-4e13-9113-1ac2bffe0583 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:22.132622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfb4db46-f1eb-4e13-9113-1ac2bffe0583 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:22.134194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfb4db46-f1eb-4e13-9113-1ac2bffe0583 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:22.136435 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfb4db46-f1eb-4e13-9113-1ac2bffe0583 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:22.137758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfb4db46-f1eb-4e13-9113-1ac2bffe0583 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:22.140203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfb4db46-f1eb-4e13-9113-1ac2bffe0583 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:22.424635 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cfb4db46-f1eb-4e13-9113-1ac2bffe0583 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:22.435157 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cfb4db46-f1eb-4e13-9113-1ac2bffe0583 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1370 microversion: 2.1 time: 0.320250 Sep 05 17:04:22.438440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 189/373] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:22 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1370 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:23.462420 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e08269dd-b60e-4eae-b0ed-5b63a5e29a55 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:23.464079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e08269dd-b60e-4eae-b0ed-5b63a5e29a55 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:23.480716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e08269dd-b60e-4eae-b0ed-5b63a5e29a55 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:23.481978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e08269dd-b60e-4eae-b0ed-5b63a5e29a55 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:23.483286 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e08269dd-b60e-4eae-b0ed-5b63a5e29a55 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:23.485933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e08269dd-b60e-4eae-b0ed-5b63a5e29a55 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:23.488314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e08269dd-b60e-4eae-b0ed-5b63a5e29a55 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:23.490118 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e08269dd-b60e-4eae-b0ed-5b63a5e29a55 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:23.759986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e08269dd-b60e-4eae-b0ed-5b63a5e29a55 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:23.776300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e08269dd-b60e-4eae-b0ed-5b63a5e29a55 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1370 microversion: 2.1 time: 0.319741 Sep 05 17:04:23.777075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 185/374] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:23 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1370 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:23.862429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-19e63828-ba4c-41a7-8bd9-73dfefd71ca0 req-f2c71c7a-17df-4abf-bf9a-80205f1a2dda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e647f8e8-c663-4226-a839-4e44249e4955", "tag": "d7765d2b-82cd-4366-8f14-f3bcb7d033a7"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:23.878994 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-19e63828-ba4c-41a7-8bd9-73dfefd71ca0 req-f2c71c7a-17df-4abf-bf9a-80205f1a2dda service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:23.879730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-19e63828-ba4c-41a7-8bd9-73dfefd71ca0 req-f2c71c7a-17df-4abf-bf9a-80205f1a2dda service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:23.880974 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-19e63828-ba4c-41a7-8bd9-73dfefd71ca0 req-f2c71c7a-17df-4abf-bf9a-80205f1a2dda service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:23.896846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-19e63828-ba4c-41a7-8bd9-73dfefd71ca0 req-f2c71c7a-17df-4abf-bf9a-80205f1a2dda service nova] Creating event network-changed:d7765d2b-82cd-4366-8f14-f3bcb7d033a7 for instance e647f8e8-c663-4226-a839-4e44249e4955 on hv-cinder-85596 Sep 05 17:04:23.907907 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-19e63828-ba4c-41a7-8bd9-73dfefd71ca0 req-f2c71c7a-17df-4abf-bf9a-80205f1a2dda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057690 Sep 05 17:04:23.913757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 190/375] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:04:24.798112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4d1ca757-b309-4fb0-8973-746651cb9aa3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:24.799312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4d1ca757-b309-4fb0-8973-746651cb9aa3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:24.805594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d1ca757-b309-4fb0-8973-746651cb9aa3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:24.806303 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d1ca757-b309-4fb0-8973-746651cb9aa3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:24.806942 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d1ca757-b309-4fb0-8973-746651cb9aa3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:24.807637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d1ca757-b309-4fb0-8973-746651cb9aa3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:24.808254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d1ca757-b309-4fb0-8973-746651cb9aa3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:24.808819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d1ca757-b309-4fb0-8973-746651cb9aa3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:24.828395 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:25.037176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4d1ca757-b309-4fb0-8973-746651cb9aa3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:25.055062 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4d1ca757-b309-4fb0-8973-746651cb9aa3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1370 microversion: 2.1 time: 0.260637 Sep 05 17:04:25.060115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 186/376] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:24 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:26.089465 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4c0b387f-c921-4c81-af83-c16e6d565430 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:26.090187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4c0b387f-c921-4c81-af83-c16e6d565430 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:26.106092 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c0b387f-c921-4c81-af83-c16e6d565430 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:26.106863 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c0b387f-c921-4c81-af83-c16e6d565430 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:26.107730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c0b387f-c921-4c81-af83-c16e6d565430 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:26.110015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c0b387f-c921-4c81-af83-c16e6d565430 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:26.111589 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c0b387f-c921-4c81-af83-c16e6d565430 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:26.112424 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c0b387f-c921-4c81-af83-c16e6d565430 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:26.516846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4c0b387f-c921-4c81-af83-c16e6d565430 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:26.531116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4c0b387f-c921-4c81-af83-c16e6d565430 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1370 microversion: 2.1 time: 0.449103 Sep 05 17:04:26.549527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 191/377] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:26 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1370 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:26.677274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1879349808", "imageRef": "c1a4f3d3-4d68-489a-a57b-bae7854beb29", "flavorRef": "452", "networks": [{"uuid": "e3da392a-3377-4b52-b0d0-762b7121c67e"}]}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:26.751981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] validate_networks() for [('e3da392a-3377-4b52-b0d0-762b7121c67e', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:04:27.329681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:04:27.330111 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:04:27.330584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:04:27.330993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:04:27.331403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:04:27.350243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:27.351048 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:27.351481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:27.353405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:27.353871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:27.354331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:27.388272 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:27.395521 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Getting quotas for project 2d6228f311304b7b8e6354d865e16e9c. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:04:27.402139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Getting quotas for user 816427b5539240ad9aa22150a922bdc0 and project 2d6228f311304b7b8e6354d865e16e9c. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:04:27.415112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:04:27.417459 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a4f3d3-4d68-489a-a57b-bae7854beb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:04:27.470059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f767ee8d-d923-4355-9f74-02297bd86e81 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796678 Sep 05 17:04:27.480912 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 187/378] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 17:04:27.495458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d5507148-be39-4231-b4fe-6e6f24ff33a5 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:27.496925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d5507148-be39-4231-b4fe-6e6f24ff33a5 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:27.566363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-40368af3-4286-488f-8f66-5e06928ae74c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:27.567258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-40368af3-4286-488f-8f66-5e06928ae74c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:27.574907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40368af3-4286-488f-8f66-5e06928ae74c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:27.575641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40368af3-4286-488f-8f66-5e06928ae74c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:27.576301 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40368af3-4286-488f-8f66-5e06928ae74c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:27.577220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40368af3-4286-488f-8f66-5e06928ae74c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:27.577832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40368af3-4286-488f-8f66-5e06928ae74c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:27.578610 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40368af3-4286-488f-8f66-5e06928ae74c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:27.584535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d5507148-be39-4231-b4fe-6e6f24ff33a5 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:27.593216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d5507148-be39-4231-b4fe-6e6f24ff33a5 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1214 microversion: 2.1 time: 0.103482 Sep 05 17:04:27.609289 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 192/379] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:27 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:27.737557 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-40368af3-4286-488f-8f66-5e06928ae74c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:27.749019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-40368af3-4286-488f-8f66-5e06928ae74c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1370 microversion: 2.1 time: 0.186658 Sep 05 17:04:27.749633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 188/380] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:27 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:04:28.619735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-361c6d4b-2ede-44ce-8144-79f437a43b77 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:28.620985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-361c6d4b-2ede-44ce-8144-79f437a43b77 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:28.629553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-361c6d4b-2ede-44ce-8144-79f437a43b77 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:28.630729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-361c6d4b-2ede-44ce-8144-79f437a43b77 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:28.631458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-361c6d4b-2ede-44ce-8144-79f437a43b77 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:28.632469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-361c6d4b-2ede-44ce-8144-79f437a43b77 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:28.634304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-361c6d4b-2ede-44ce-8144-79f437a43b77 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:28.634957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-361c6d4b-2ede-44ce-8144-79f437a43b77 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:28.729221 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-361c6d4b-2ede-44ce-8144-79f437a43b77 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:28.740324 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-361c6d4b-2ede-44ce-8144-79f437a43b77 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1210 microversion: 2.1 time: 0.125643 Sep 05 17:04:28.741731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 193/381] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:28 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1210 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:28.777335 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-eb15799b-1b26-48b3-9f2e-41a899b47dea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:28.777901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-eb15799b-1b26-48b3-9f2e-41a899b47dea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:28.790148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb15799b-1b26-48b3-9f2e-41a899b47dea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:28.790677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb15799b-1b26-48b3-9f2e-41a899b47dea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:28.791147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb15799b-1b26-48b3-9f2e-41a899b47dea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:28.791896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb15799b-1b26-48b3-9f2e-41a899b47dea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:28.792607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb15799b-1b26-48b3-9f2e-41a899b47dea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:28.792788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb15799b-1b26-48b3-9f2e-41a899b47dea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:29.012187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eb15799b-1b26-48b3-9f2e-41a899b47dea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:29.023654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-eb15799b-1b26-48b3-9f2e-41a899b47dea tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1370 microversion: 2.1 time: 0.251513 Sep 05 17:04:29.032057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 189/382] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:28 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1370 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:29.763355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-87f71c80-78da-468e-a589-7106e2c134d0 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:29.764208 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-87f71c80-78da-468e-a589-7106e2c134d0 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:29.772342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87f71c80-78da-468e-a589-7106e2c134d0 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:29.773201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87f71c80-78da-468e-a589-7106e2c134d0 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:29.774124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87f71c80-78da-468e-a589-7106e2c134d0 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:29.775249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87f71c80-78da-468e-a589-7106e2c134d0 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:29.776081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87f71c80-78da-468e-a589-7106e2c134d0 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:29.776869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87f71c80-78da-468e-a589-7106e2c134d0 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:29.867679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-87f71c80-78da-468e-a589-7106e2c134d0 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:29.890132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-87f71c80-78da-468e-a589-7106e2c134d0 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1284 microversion: 2.1 time: 0.129761 Sep 05 17:04:29.893417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 190/383] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:29 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:04:29.911342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-3e27323e-e0b2-4ee2-8bb6-68189efadb91 req-24da3377-4e22-4802-976d-55814ad8f73b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "997db40d-a563-4bec-ae08-02d2d7e0eb5d", "name": "network-vif-plugged", "status": "completed", "tag": "8d4acf9a-8a3d-41cc-b0dc-29dc4170b535"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:29.947815 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-3e27323e-e0b2-4ee2-8bb6-68189efadb91 req-24da3377-4e22-4802-976d-55814ad8f73b service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:29.948338 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-3e27323e-e0b2-4ee2-8bb6-68189efadb91 req-24da3377-4e22-4802-976d-55814ad8f73b service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:29.952957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-3e27323e-e0b2-4ee2-8bb6-68189efadb91 req-24da3377-4e22-4802-976d-55814ad8f73b service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:29.955645 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7d87e82e-66f2-4a57-98ab-a9002451ad60 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Action: 'create', calling method: .version_select at 0x7f1d3ac17ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1456766241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuy4z4ntXi/+GVq5HOXSSjh4icmMh9EIuJFT8lW9VrnkIztuHyzGHI1HZttG+HTJ03FEWX7vBVIZx9HNfcQLpHaZ71wekGBn3D9HTpdtuOj1sHa2RGh19htL8H948rjpw=="}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:29.990197 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-3e27323e-e0b2-4ee2-8bb6-68189efadb91 req-24da3377-4e22-4802-976d-55814ad8f73b service nova] Creating event network-vif-plugged:8d4acf9a-8a3d-41cc-b0dc-29dc4170b535 for instance 997db40d-a563-4bec-ae08-02d2d7e0eb5d on hv-cinder-85596 Sep 05 17:04:29.995163 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-7d87e82e-66f2-4a57-98ab-a9002451ad60 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Getting quotas for project e6c32d7007a1428a8bde1b73e5883db6. Resources: {'key_pairs'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:04:29.999879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-7d87e82e-66f2-4a57-98ab-a9002451ad60 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Getting quotas for user 9b3a59d52ce8432c964f8c94a6e96a4d and project e6c32d7007a1428a8bde1b73e5883db6. Resources: {'key_pairs'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:04:30.013602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-3e27323e-e0b2-4ee2-8bb6-68189efadb91 req-24da3377-4e22-4802-976d-55814ad8f73b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117786 Sep 05 17:04:30.014796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 191/384] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:04:30.050621 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6652c314-611f-4b56-a7c9-f0139e2b961c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:30.053725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7d87e82e-66f2-4a57-98ab-a9002451ad60 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.427362 Sep 05 17:04:30.054460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6652c314-611f-4b56-a7c9-f0139e2b961c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:30.055249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 194/385] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Sep 5 17:04:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:04:30.067197 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6652c314-611f-4b56-a7c9-f0139e2b961c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:30.067790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6652c314-611f-4b56-a7c9-f0139e2b961c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:30.068482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6652c314-611f-4b56-a7c9-f0139e2b961c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:30.069280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6652c314-611f-4b56-a7c9-f0139e2b961c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:30.069878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6652c314-611f-4b56-a7c9-f0139e2b961c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:30.070481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6652c314-611f-4b56-a7c9-f0139e2b961c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:30.355834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6652c314-611f-4b56-a7c9-f0139e2b961c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:30.384691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6652c314-611f-4b56-a7c9-f0139e2b961c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1370 microversion: 2.1 time: 0.321004 Sep 05 17:04:30.389543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 192/386] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:30 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1370 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:30.921009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f377ce00-a7df-438f-987c-61f076fd3162 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:30.921617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f377ce00-a7df-438f-987c-61f076fd3162 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:30.928314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f377ce00-a7df-438f-987c-61f076fd3162 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:30.928822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f377ce00-a7df-438f-987c-61f076fd3162 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:30.929212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f377ce00-a7df-438f-987c-61f076fd3162 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:30.930318 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f377ce00-a7df-438f-987c-61f076fd3162 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:30.930771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f377ce00-a7df-438f-987c-61f076fd3162 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:30.931185 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f377ce00-a7df-438f-987c-61f076fd3162 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:30.937269 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:31.120176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f377ce00-a7df-438f-987c-61f076fd3162 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:31.128214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f377ce00-a7df-438f-987c-61f076fd3162 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1314 microversion: 2.1 time: 0.212740 Sep 05 17:04:31.128778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 195/387] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:30 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:31.410083 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-05271eac-e62d-401d-a569-1eacc7f6f93c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:31.411343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-05271eac-e62d-401d-a569-1eacc7f6f93c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:31.419206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05271eac-e62d-401d-a569-1eacc7f6f93c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:31.420089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05271eac-e62d-401d-a569-1eacc7f6f93c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:31.420685 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05271eac-e62d-401d-a569-1eacc7f6f93c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:31.421550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05271eac-e62d-401d-a569-1eacc7f6f93c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:31.422205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05271eac-e62d-401d-a569-1eacc7f6f93c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:31.422828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05271eac-e62d-401d-a569-1eacc7f6f93c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:31.613729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-05271eac-e62d-401d-a569-1eacc7f6f93c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:31.621782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-05271eac-e62d-401d-a569-1eacc7f6f93c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1370 microversion: 2.1 time: 0.215884 Sep 05 17:04:31.622421 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 193/388] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:31 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1370 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:32.010549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-eda373b5-55d5-4356-8cca-47779181368d req-5c71cefe-8665-4a33-b655-c482fe6fe294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f66181b8-484f-4eb6-ae15-22e3e4d5a9e1", "tag": "9d2293e5-6c53-4814-8bf0-a0ba1534378d"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:32.021446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-eda373b5-55d5-4356-8cca-47779181368d req-5c71cefe-8665-4a33-b655-c482fe6fe294 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:32.022102 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-eda373b5-55d5-4356-8cca-47779181368d req-5c71cefe-8665-4a33-b655-c482fe6fe294 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:32.022738 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-eda373b5-55d5-4356-8cca-47779181368d req-5c71cefe-8665-4a33-b655-c482fe6fe294 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:32.042126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-eda373b5-55d5-4356-8cca-47779181368d req-5c71cefe-8665-4a33-b655-c482fe6fe294 service nova] Creating event network-changed:9d2293e5-6c53-4814-8bf0-a0ba1534378d for instance f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 on hv-cinder-85596 Sep 05 17:04:32.049348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-eda373b5-55d5-4356-8cca-47779181368d req-5c71cefe-8665-4a33-b655-c482fe6fe294 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041974 Sep 05 17:04:32.056605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 196/389] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:04:32.151301 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-23872530-2e0d-42cc-a453-0a85b7a58800 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:32.152092 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-23872530-2e0d-42cc-a453-0a85b7a58800 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:32.159963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23872530-2e0d-42cc-a453-0a85b7a58800 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:32.160657 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23872530-2e0d-42cc-a453-0a85b7a58800 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:32.161238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23872530-2e0d-42cc-a453-0a85b7a58800 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:32.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23872530-2e0d-42cc-a453-0a85b7a58800 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:32.162709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23872530-2e0d-42cc-a453-0a85b7a58800 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:32.163276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23872530-2e0d-42cc-a453-0a85b7a58800 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:32.312636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-23872530-2e0d-42cc-a453-0a85b7a58800 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:32.324727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-23872530-2e0d-42cc-a453-0a85b7a58800 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1314 microversion: 2.1 time: 0.177464 Sep 05 17:04:32.325409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 194/390] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:32 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:32.646440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4547675d-e7f2-4d86-b0cd-cdfc72f6b439 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:32.647218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4547675d-e7f2-4d86-b0cd-cdfc72f6b439 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:32.660277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4547675d-e7f2-4d86-b0cd-cdfc72f6b439 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:32.661065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4547675d-e7f2-4d86-b0cd-cdfc72f6b439 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:32.661699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4547675d-e7f2-4d86-b0cd-cdfc72f6b439 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:32.662638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4547675d-e7f2-4d86-b0cd-cdfc72f6b439 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:32.663606 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4547675d-e7f2-4d86-b0cd-cdfc72f6b439 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:32.664222 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4547675d-e7f2-4d86-b0cd-cdfc72f6b439 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:32.828447 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4547675d-e7f2-4d86-b0cd-cdfc72f6b439 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:32.836969 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4547675d-e7f2-4d86-b0cd-cdfc72f6b439 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1370 microversion: 2.1 time: 0.195576 Sep 05 17:04:32.837560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 197/391] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:32 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:33.348529 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a738d269-7fce-4d94-9543-2ad8e0d5e1d9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:33.349106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a738d269-7fce-4d94-9543-2ad8e0d5e1d9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:33.355999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a738d269-7fce-4d94-9543-2ad8e0d5e1d9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:33.356520 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a738d269-7fce-4d94-9543-2ad8e0d5e1d9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:33.356970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a738d269-7fce-4d94-9543-2ad8e0d5e1d9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:33.357654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a738d269-7fce-4d94-9543-2ad8e0d5e1d9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:33.358106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a738d269-7fce-4d94-9543-2ad8e0d5e1d9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:33.358522 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a738d269-7fce-4d94-9543-2ad8e0d5e1d9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:33.505669 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a738d269-7fce-4d94-9543-2ad8e0d5e1d9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:33.514309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a738d269-7fce-4d94-9543-2ad8e0d5e1d9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1314 microversion: 2.1 time: 0.169716 Sep 05 17:04:33.514904 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 195/392] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:33 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:33.861783 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2c0c1d34-1311-4b70-aea0-19865b9fe971 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:33.863088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2c0c1d34-1311-4b70-aea0-19865b9fe971 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:33.870447 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c0c1d34-1311-4b70-aea0-19865b9fe971 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:33.871160 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c0c1d34-1311-4b70-aea0-19865b9fe971 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:33.871808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c0c1d34-1311-4b70-aea0-19865b9fe971 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:33.872787 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c0c1d34-1311-4b70-aea0-19865b9fe971 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:33.873439 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c0c1d34-1311-4b70-aea0-19865b9fe971 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:33.874055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c0c1d34-1311-4b70-aea0-19865b9fe971 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:34.060268 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2c0c1d34-1311-4b70-aea0-19865b9fe971 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:34.073730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2c0c1d34-1311-4b70-aea0-19865b9fe971 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1564 microversion: 2.1 time: 0.215447 Sep 05 17:04:34.075486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 198/393] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:33 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1564 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:34.096736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d430b935-134d-4a22-a6fb-e0cd8d83ef9c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:34.097618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d430b935-134d-4a22-a6fb-e0cd8d83ef9c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:34.105902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d430b935-134d-4a22-a6fb-e0cd8d83ef9c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:34.106426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d430b935-134d-4a22-a6fb-e0cd8d83ef9c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:34.106853 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d430b935-134d-4a22-a6fb-e0cd8d83ef9c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:34.107565 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d430b935-134d-4a22-a6fb-e0cd8d83ef9c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:34.108137 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d430b935-134d-4a22-a6fb-e0cd8d83ef9c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:34.108589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d430b935-134d-4a22-a6fb-e0cd8d83ef9c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:34.196350 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d430b935-134d-4a22-a6fb-e0cd8d83ef9c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103451 Sep 05 17:04:34.197136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 196/394] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Sep 5 17:04:34 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:04:34.537564 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f613d16a-593e-436b-852e-f5c6fa3ba3ce tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:34.542357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f613d16a-593e-436b-852e-f5c6fa3ba3ce tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:34.548709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f613d16a-593e-436b-852e-f5c6fa3ba3ce tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:34.549400 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f613d16a-593e-436b-852e-f5c6fa3ba3ce tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:34.549984 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f613d16a-593e-436b-852e-f5c6fa3ba3ce tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:34.551528 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f613d16a-593e-436b-852e-f5c6fa3ba3ce tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:34.552338 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f613d16a-593e-436b-852e-f5c6fa3ba3ce tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:34.552997 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f613d16a-593e-436b-852e-f5c6fa3ba3ce tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:34.707679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f613d16a-593e-436b-852e-f5c6fa3ba3ce tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:34.718889 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f613d16a-593e-436b-852e-f5c6fa3ba3ce tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1314 microversion: 2.1 time: 0.185152 Sep 05 17:04:34.719663 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 199/395] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:34 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:35.691580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-7c2ae1ff-7b0d-42cf-a283-84c2f013e403 req-b4fd6a36-818a-4546-a553-9e84ea8106f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "997db40d-a563-4bec-ae08-02d2d7e0eb5d", "tag": "8d4acf9a-8a3d-41cc-b0dc-29dc4170b535"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:35.701269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-7c2ae1ff-7b0d-42cf-a283-84c2f013e403 req-b4fd6a36-818a-4546-a553-9e84ea8106f8 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:35.701736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-7c2ae1ff-7b0d-42cf-a283-84c2f013e403 req-b4fd6a36-818a-4546-a553-9e84ea8106f8 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:35.702150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-7c2ae1ff-7b0d-42cf-a283-84c2f013e403 req-b4fd6a36-818a-4546-a553-9e84ea8106f8 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:35.713594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-7c2ae1ff-7b0d-42cf-a283-84c2f013e403 req-b4fd6a36-818a-4546-a553-9e84ea8106f8 service nova] Creating event network-changed:8d4acf9a-8a3d-41cc-b0dc-29dc4170b535 for instance 997db40d-a563-4bec-ae08-02d2d7e0eb5d on hv-cinder-85596 Sep 05 17:04:35.719045 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-7c2ae1ff-7b0d-42cf-a283-84c2f013e403 req-b4fd6a36-818a-4546-a553-9e84ea8106f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032148 Sep 05 17:04:35.719806 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 197/396] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:04:35.743943 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4324b8e4-dc03-42e5-9a05-d481277a775f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:35.745059 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4324b8e4-dc03-42e5-9a05-d481277a775f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:35.747626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:35.753088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4324b8e4-dc03-42e5-9a05-d481277a775f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:35.753566 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4324b8e4-dc03-42e5-9a05-d481277a775f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:35.753990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4324b8e4-dc03-42e5-9a05-d481277a775f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:35.754867 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4324b8e4-dc03-42e5-9a05-d481277a775f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:35.755319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4324b8e4-dc03-42e5-9a05-d481277a775f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:35.755736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4324b8e4-dc03-42e5-9a05-d481277a775f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:35.895780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4324b8e4-dc03-42e5-9a05-d481277a775f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:35.904041 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4324b8e4-dc03-42e5-9a05-d481277a775f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1314 microversion: 2.1 time: 0.164937 Sep 05 17:04:35.904692 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 200/397] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:35 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:36.927567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-18460e81-1486-47a5-92e3-1c8d78e1e9e7 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:36.928306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-18460e81-1486-47a5-92e3-1c8d78e1e9e7 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:36.935008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18460e81-1486-47a5-92e3-1c8d78e1e9e7 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:36.935488 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18460e81-1486-47a5-92e3-1c8d78e1e9e7 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:36.935923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18460e81-1486-47a5-92e3-1c8d78e1e9e7 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:36.936635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18460e81-1486-47a5-92e3-1c8d78e1e9e7 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:36.937076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18460e81-1486-47a5-92e3-1c8d78e1e9e7 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:36.937524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18460e81-1486-47a5-92e3-1c8d78e1e9e7 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:37.078056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-18460e81-1486-47a5-92e3-1c8d78e1e9e7 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:37.090532 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-18460e81-1486-47a5-92e3-1c8d78e1e9e7 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1314 microversion: 2.1 time: 0.167219 Sep 05 17:04:37.091124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 198/398] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:36 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:38.114028 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-27b9c8ba-69d4-4f72-87d0-f6e8224118bb tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:38.115140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-27b9c8ba-69d4-4f72-87d0-f6e8224118bb tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:38.121959 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-27b9c8ba-69d4-4f72-87d0-f6e8224118bb tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:38.122443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-27b9c8ba-69d4-4f72-87d0-f6e8224118bb tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:38.122875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-27b9c8ba-69d4-4f72-87d0-f6e8224118bb tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:38.123562 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-27b9c8ba-69d4-4f72-87d0-f6e8224118bb tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:38.124018 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-27b9c8ba-69d4-4f72-87d0-f6e8224118bb tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:38.124467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-27b9c8ba-69d4-4f72-87d0-f6e8224118bb tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:38.274595 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-27b9c8ba-69d4-4f72-87d0-f6e8224118bb tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:38.282811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-27b9c8ba-69d4-4f72-87d0-f6e8224118bb tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1314 microversion: 2.1 time: 0.172866 Sep 05 17:04:38.283492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 201/399] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:38 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:39.307869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6d01a520-cdbc-4172-a74e-c748e728ca3e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:39.308519 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6d01a520-cdbc-4172-a74e-c748e728ca3e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:39.310574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:39.311226 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=6 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:39.317784 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d01a520-cdbc-4172-a74e-c748e728ca3e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:39.318261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d01a520-cdbc-4172-a74e-c748e728ca3e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:39.318687 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d01a520-cdbc-4172-a74e-c748e728ca3e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:39.319361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d01a520-cdbc-4172-a74e-c748e728ca3e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:39.319802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d01a520-cdbc-4172-a74e-c748e728ca3e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:39.320232 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d01a520-cdbc-4172-a74e-c748e728ca3e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:39.456454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6d01a520-cdbc-4172-a74e-c748e728ca3e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:39.464907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6d01a520-cdbc-4172-a74e-c748e728ca3e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1314 microversion: 2.1 time: 0.162530 Sep 05 17:04:39.465490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 199/400] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:39 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:40.489395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-777c4763-2bb2-4e2a-be34-3ac918eb0e85 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:40.490003 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-777c4763-2bb2-4e2a-be34-3ac918eb0e85 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:40.492486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=6 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:40.497979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-777c4763-2bb2-4e2a-be34-3ac918eb0e85 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:40.498674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-777c4763-2bb2-4e2a-be34-3ac918eb0e85 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:40.499297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-777c4763-2bb2-4e2a-be34-3ac918eb0e85 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:40.500006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-777c4763-2bb2-4e2a-be34-3ac918eb0e85 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:40.500493 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-777c4763-2bb2-4e2a-be34-3ac918eb0e85 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:40.501110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-777c4763-2bb2-4e2a-be34-3ac918eb0e85 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:40.679622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-777c4763-2bb2-4e2a-be34-3ac918eb0e85 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:40.687924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-777c4763-2bb2-4e2a-be34-3ac918eb0e85 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1314 microversion: 2.1 time: 0.203361 Sep 05 17:04:40.688862 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 202/401] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:40 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:41.711512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7eea77be-efd0-4463-b85d-327c6d1d53af tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:41.712360 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7eea77be-efd0-4463-b85d-327c6d1d53af tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:41.718722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7eea77be-efd0-4463-b85d-327c6d1d53af tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:41.719202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7eea77be-efd0-4463-b85d-327c6d1d53af tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:41.719650 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7eea77be-efd0-4463-b85d-327c6d1d53af tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:41.720366 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7eea77be-efd0-4463-b85d-327c6d1d53af tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:41.720811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7eea77be-efd0-4463-b85d-327c6d1d53af tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:41.721221 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7eea77be-efd0-4463-b85d-327c6d1d53af tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:41.854176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7eea77be-efd0-4463-b85d-327c6d1d53af tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:41.861972 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7eea77be-efd0-4463-b85d-327c6d1d53af tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1314 microversion: 2.1 time: 0.154320 Sep 05 17:04:41.862539 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 200/402] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:41 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:42.886544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c13ef38e-79a0-4f59-a018-042e8a740d3d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:42.891028 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c13ef38e-79a0-4f59-a018-042e8a740d3d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:42.901313 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c13ef38e-79a0-4f59-a018-042e8a740d3d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:42.901795 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c13ef38e-79a0-4f59-a018-042e8a740d3d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:42.902195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c13ef38e-79a0-4f59-a018-042e8a740d3d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:42.903066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c13ef38e-79a0-4f59-a018-042e8a740d3d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:42.903508 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c13ef38e-79a0-4f59-a018-042e8a740d3d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:42.903898 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c13ef38e-79a0-4f59-a018-042e8a740d3d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:43.058304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c13ef38e-79a0-4f59-a018-042e8a740d3d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:43.066457 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c13ef38e-79a0-4f59-a018-042e8a740d3d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1314 microversion: 2.1 time: 0.185175 Sep 05 17:04:43.067023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 203/403] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:42 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:43.727653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9ebd79cb-dc79-4ba8-b049-244116a052db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:43.728303 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9ebd79cb-dc79-4ba8-b049-244116a052db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:43.734390 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ebd79cb-dc79-4ba8-b049-244116a052db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:43.734901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ebd79cb-dc79-4ba8-b049-244116a052db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:43.735327 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ebd79cb-dc79-4ba8-b049-244116a052db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:43.736026 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ebd79cb-dc79-4ba8-b049-244116a052db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:43.736483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ebd79cb-dc79-4ba8-b049-244116a052db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:43.736900 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ebd79cb-dc79-4ba8-b049-244116a052db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:43.760876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9ebd79cb-dc79-4ba8-b049-244116a052db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/ips" status: 200 len: 151 microversion: 2.20 time: 0.037583 Sep 05 17:04:43.761456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 201/404] 10.222.0.23 () {60 vars in 1289 bytes} [Mon Sep 5 17:04:43 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:04:44.039395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-6d55e33f-772f-412e-ab1f-a7bafef8c447 req-11b27238-7e5f-44de-9bc5-6c7995122673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66181b8-484f-4eb6-ae15-22e3e4d5a9e1", "name": "network-vif-plugged", "status": "completed", "tag": "9d2293e5-6c53-4814-8bf0-a0ba1534378d"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:44.064863 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-6d55e33f-772f-412e-ab1f-a7bafef8c447 req-11b27238-7e5f-44de-9bc5-6c7995122673 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:44.065459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-6d55e33f-772f-412e-ab1f-a7bafef8c447 req-11b27238-7e5f-44de-9bc5-6c7995122673 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:44.066169 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-6d55e33f-772f-412e-ab1f-a7bafef8c447 req-11b27238-7e5f-44de-9bc5-6c7995122673 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:44.090667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-204a073f-47ac-4b77-9fdf-3915079a5f5e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:44.091518 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-204a073f-47ac-4b77-9fdf-3915079a5f5e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:44.095762 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-6d55e33f-772f-412e-ab1f-a7bafef8c447 req-11b27238-7e5f-44de-9bc5-6c7995122673 service nova] Creating event network-vif-plugged:9d2293e5-6c53-4814-8bf0-a0ba1534378d for instance f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 on hv-cinder-85596 Sep 05 17:04:44.104355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-204a073f-47ac-4b77-9fdf-3915079a5f5e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:44.105961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-204a073f-47ac-4b77-9fdf-3915079a5f5e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:44.106521 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-6d55e33f-772f-412e-ab1f-a7bafef8c447 req-11b27238-7e5f-44de-9bc5-6c7995122673 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088854 Sep 05 17:04:44.107064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-204a073f-47ac-4b77-9fdf-3915079a5f5e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:44.107426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 204/405] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:04:44.109618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-204a073f-47ac-4b77-9fdf-3915079a5f5e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:44.111553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-204a073f-47ac-4b77-9fdf-3915079a5f5e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:44.112083 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-204a073f-47ac-4b77-9fdf-3915079a5f5e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:44.460450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-204a073f-47ac-4b77-9fdf-3915079a5f5e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:44.468976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-204a073f-47ac-4b77-9fdf-3915079a5f5e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1314 microversion: 2.1 time: 0.382973 Sep 05 17:04:44.469525 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 202/406] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:44 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:04:45.502149 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2ee778d0-64ba-4c79-b1d9-b7ec1e05185c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:45.502918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2ee778d0-64ba-4c79-b1d9-b7ec1e05185c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:45.510685 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ee778d0-64ba-4c79-b1d9-b7ec1e05185c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:45.511180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ee778d0-64ba-4c79-b1d9-b7ec1e05185c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:45.511651 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ee778d0-64ba-4c79-b1d9-b7ec1e05185c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:45.512500 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ee778d0-64ba-4c79-b1d9-b7ec1e05185c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:45.512961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ee778d0-64ba-4c79-b1d9-b7ec1e05185c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:45.513390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ee778d0-64ba-4c79-b1d9-b7ec1e05185c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:45.665436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2ee778d0-64ba-4c79-b1d9-b7ec1e05185c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:45.676104 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2ee778d0-64ba-4c79-b1d9-b7ec1e05185c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1314 microversion: 2.1 time: 0.178838 Sep 05 17:04:45.676724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 205/407] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:45 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:46.706094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-df6ff495-fcec-4d6a-9899-53612647cfdd tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:46.706713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-df6ff495-fcec-4d6a-9899-53612647cfdd tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:46.712906 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df6ff495-fcec-4d6a-9899-53612647cfdd tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:46.713388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df6ff495-fcec-4d6a-9899-53612647cfdd tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:46.713821 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df6ff495-fcec-4d6a-9899-53612647cfdd tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:46.714509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df6ff495-fcec-4d6a-9899-53612647cfdd tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:46.714958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df6ff495-fcec-4d6a-9899-53612647cfdd tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:46.715379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df6ff495-fcec-4d6a-9899-53612647cfdd tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:46.865470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-df6ff495-fcec-4d6a-9899-53612647cfdd tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:46.874888 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-df6ff495-fcec-4d6a-9899-53612647cfdd tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1314 microversion: 2.1 time: 0.172395 Sep 05 17:04:46.875480 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 203/408] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:46 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:47.156030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c006a10a-4db0-49e6-b2f7-f09da4a057a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:47.156696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c006a10a-4db0-49e6-b2f7-f09da4a057a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:47.163438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c006a10a-4db0-49e6-b2f7-f09da4a057a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:47.163917 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c006a10a-4db0-49e6-b2f7-f09da4a057a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:47.164379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c006a10a-4db0-49e6-b2f7-f09da4a057a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:47.165066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c006a10a-4db0-49e6-b2f7-f09da4a057a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:47.165516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c006a10a-4db0-49e6-b2f7-f09da4a057a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:47.165930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c006a10a-4db0-49e6-b2f7-f09da4a057a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:47.191243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.objects.instance [None req-c006a10a-4db0-49e6-b2f7-f09da4a057a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lazy-loading 'flavor' on Instance uuid 97cc15c7-947d-4daf-80e8-8edc37c01e68 {{(pid=120733) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:04:47.432106 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c006a10a-4db0-49e6-b2f7-f09da4a057a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "POST /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/action" status: 202 len: 0 microversion: 2.20 time: 0.279994 Sep 05 17:04:47.432918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 206/409] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Sep 5 17:04:47 2022] POST /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:04:47.445180 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cbb32fc4-9433-4d08-8893-e7b82afd466b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:47.445785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cbb32fc4-9433-4d08-8893-e7b82afd466b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:47.456191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cbb32fc4-9433-4d08-8893-e7b82afd466b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:47.457130 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cbb32fc4-9433-4d08-8893-e7b82afd466b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:47.457681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cbb32fc4-9433-4d08-8893-e7b82afd466b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:47.459146 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cbb32fc4-9433-4d08-8893-e7b82afd466b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:47.459626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cbb32fc4-9433-4d08-8893-e7b82afd466b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:47.460461 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cbb32fc4-9433-4d08-8893-e7b82afd466b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:47.602333 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cbb32fc4-9433-4d08-8893-e7b82afd466b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:47.614499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cbb32fc4-9433-4d08-8893-e7b82afd466b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:47.616642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cbb32fc4-9433-4d08-8893-e7b82afd466b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:47.618216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cbb32fc4-9433-4d08-8893-e7b82afd466b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1722 microversion: 2.20 time: 0.177370 Sep 05 17:04:47.618963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 204/410] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:04:47 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:04:47.899305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0b0347d8-e550-4534-ba1e-111965a8a377 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:47.899970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0b0347d8-e550-4534-ba1e-111965a8a377 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:47.908726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b0347d8-e550-4534-ba1e-111965a8a377 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:47.909317 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b0347d8-e550-4534-ba1e-111965a8a377 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:47.909750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b0347d8-e550-4534-ba1e-111965a8a377 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:47.910437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b0347d8-e550-4534-ba1e-111965a8a377 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:47.910885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b0347d8-e550-4534-ba1e-111965a8a377 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:47.911301 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b0347d8-e550-4534-ba1e-111965a8a377 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:48.063468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0b0347d8-e550-4534-ba1e-111965a8a377 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:48.068797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0b0347d8-e550-4534-ba1e-111965a8a377 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1498 microversion: 2.1 time: 0.173746 Sep 05 17:04:48.069503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 207/411] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:47 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1498 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:48.646692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-df5c2f35-d85c-463e-a47e-ead8b8ca2689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:48.647274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-df5c2f35-d85c-463e-a47e-ead8b8ca2689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:48.653984 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df5c2f35-d85c-463e-a47e-ead8b8ca2689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:48.654479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df5c2f35-d85c-463e-a47e-ead8b8ca2689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:48.654910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df5c2f35-d85c-463e-a47e-ead8b8ca2689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:48.655639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df5c2f35-d85c-463e-a47e-ead8b8ca2689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:48.656094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df5c2f35-d85c-463e-a47e-ead8b8ca2689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:48.656631 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df5c2f35-d85c-463e-a47e-ead8b8ca2689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:48.812218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-dba1129a-6af1-4d6e-8933-1ec7ef50bd37 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:48.812949 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-dba1129a-6af1-4d6e-8933-1ec7ef50bd37 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:48.823402 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dba1129a-6af1-4d6e-8933-1ec7ef50bd37 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:48.823985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dba1129a-6af1-4d6e-8933-1ec7ef50bd37 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:48.824468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dba1129a-6af1-4d6e-8933-1ec7ef50bd37 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:48.825369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dba1129a-6af1-4d6e-8933-1ec7ef50bd37 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:48.825987 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dba1129a-6af1-4d6e-8933-1ec7ef50bd37 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:48.826550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dba1129a-6af1-4d6e-8933-1ec7ef50bd37 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:48.840597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-df5c2f35-d85c-463e-a47e-ead8b8ca2689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:48.844729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:48.852542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-df5c2f35-d85c-463e-a47e-ead8b8ca2689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:48.854005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-df5c2f35-d85c-463e-a47e-ead8b8ca2689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:48.855309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-df5c2f35-d85c-463e-a47e-ead8b8ca2689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1722 microversion: 2.20 time: 0.213211 Sep 05 17:04:48.855868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 205/412] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:04:48 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:04:48.866940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-dba1129a-6af1-4d6e-8933-1ec7ef50bd37 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Going to try to terminate instance {{(pid=120733) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:04:48.965451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-dba1129a-6af1-4d6e-8933-1ec7ef50bd37 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 204 len: 0 microversion: 2.1 time: 0.158309 Sep 05 17:04:48.966261 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 208/413] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:04:48 2022] DELETE /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:04:48.974789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2872e57e-f913-42a6-9443-f11c090bb77d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:48.975383 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2872e57e-f913-42a6-9443-f11c090bb77d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:48.985266 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2872e57e-f913-42a6-9443-f11c090bb77d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:48.985827 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2872e57e-f913-42a6-9443-f11c090bb77d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:48.986503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2872e57e-f913-42a6-9443-f11c090bb77d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:48.987211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2872e57e-f913-42a6-9443-f11c090bb77d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:48.987658 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2872e57e-f913-42a6-9443-f11c090bb77d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:48.988127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2872e57e-f913-42a6-9443-f11c090bb77d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:49.142824 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2872e57e-f913-42a6-9443-f11c090bb77d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:49.146387 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2872e57e-f913-42a6-9443-f11c090bb77d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1504 microversion: 2.1 time: 0.175368 Sep 05 17:04:49.147083 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 206/414] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:48 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:49.884903 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-02c0fa0d-f19b-481b-9b60-7984c34838d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:49.885815 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-02c0fa0d-f19b-481b-9b60-7984c34838d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:49.894802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02c0fa0d-f19b-481b-9b60-7984c34838d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:49.895306 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02c0fa0d-f19b-481b-9b60-7984c34838d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:49.895733 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02c0fa0d-f19b-481b-9b60-7984c34838d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:49.896460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02c0fa0d-f19b-481b-9b60-7984c34838d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:49.896905 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02c0fa0d-f19b-481b-9b60-7984c34838d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:49.897317 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02c0fa0d-f19b-481b-9b60-7984c34838d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:49.918545 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:50.047348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-02c0fa0d-f19b-481b-9b60-7984c34838d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:50.055991 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-02c0fa0d-f19b-481b-9b60-7984c34838d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:50.057453 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-02c0fa0d-f19b-481b-9b60-7984c34838d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:50.058600 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-02c0fa0d-f19b-481b-9b60-7984c34838d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1722 microversion: 2.20 time: 0.180086 Sep 05 17:04:50.059153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 209/415] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:04:49 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:04:50.169818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-46763b92-8ea9-4fbd-96d2-7c06863118d1 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:50.170444 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-46763b92-8ea9-4fbd-96d2-7c06863118d1 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:50.176812 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46763b92-8ea9-4fbd-96d2-7c06863118d1 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:50.177297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46763b92-8ea9-4fbd-96d2-7c06863118d1 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:50.177721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46763b92-8ea9-4fbd-96d2-7c06863118d1 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:50.178410 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46763b92-8ea9-4fbd-96d2-7c06863118d1 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:50.178855 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46763b92-8ea9-4fbd-96d2-7c06863118d1 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:50.179273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46763b92-8ea9-4fbd-96d2-7c06863118d1 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:50.316308 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-46763b92-8ea9-4fbd-96d2-7c06863118d1 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:50.324270 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-46763b92-8ea9-4fbd-96d2-7c06863118d1 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1504 microversion: 2.1 time: 0.158396 Sep 05 17:04:50.324815 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 207/416] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:50 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:51.096118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-aa363fc2-5572-4c3c-86b5-4c56909b704f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:51.097117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-aa363fc2-5572-4c3c-86b5-4c56909b704f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:51.104774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aa363fc2-5572-4c3c-86b5-4c56909b704f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:51.105274 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aa363fc2-5572-4c3c-86b5-4c56909b704f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:51.105733 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aa363fc2-5572-4c3c-86b5-4c56909b704f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:51.106444 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aa363fc2-5572-4c3c-86b5-4c56909b704f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:51.106896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aa363fc2-5572-4c3c-86b5-4c56909b704f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:51.107315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aa363fc2-5572-4c3c-86b5-4c56909b704f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:51.250203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-aa363fc2-5572-4c3c-86b5-4c56909b704f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:51.258889 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-aa363fc2-5572-4c3c-86b5-4c56909b704f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:51.260418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-aa363fc2-5572-4c3c-86b5-4c56909b704f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:51.261657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-aa363fc2-5572-4c3c-86b5-4c56909b704f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1722 microversion: 2.20 time: 0.173195 Sep 05 17:04:51.262253 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 210/417] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:04:51 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:04:51.358577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-89bda1a9-58bd-4fad-bf59-b2cf3254ee88 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:51.359517 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-89bda1a9-58bd-4fad-bf59-b2cf3254ee88 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:51.369597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89bda1a9-58bd-4fad-bf59-b2cf3254ee88 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:51.370401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89bda1a9-58bd-4fad-bf59-b2cf3254ee88 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:51.371148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89bda1a9-58bd-4fad-bf59-b2cf3254ee88 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:51.372342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89bda1a9-58bd-4fad-bf59-b2cf3254ee88 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:51.373108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89bda1a9-58bd-4fad-bf59-b2cf3254ee88 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:51.373767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89bda1a9-58bd-4fad-bf59-b2cf3254ee88 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:51.513652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-89bda1a9-58bd-4fad-bf59-b2cf3254ee88 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:51.522010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-89bda1a9-58bd-4fad-bf59-b2cf3254ee88 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1504 microversion: 2.1 time: 0.170455 Sep 05 17:04:51.522544 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 208/418] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:51 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:51.914556 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-df5004fc-ba13-4cef-98f5-449104929816 req-54f5557a-a3db-41cd-af01-5e8896a794b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66181b8-484f-4eb6-ae15-22e3e4d5a9e1", "name": "network-vif-deleted", "tag": "9d2293e5-6c53-4814-8bf0-a0ba1534378d"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:51.925334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-df5004fc-ba13-4cef-98f5-449104929816 req-54f5557a-a3db-41cd-af01-5e8896a794b0 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:51.925811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-df5004fc-ba13-4cef-98f5-449104929816 req-54f5557a-a3db-41cd-af01-5e8896a794b0 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:51.926216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-df5004fc-ba13-4cef-98f5-449104929816 req-54f5557a-a3db-41cd-af01-5e8896a794b0 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:51.937637 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-df5004fc-ba13-4cef-98f5-449104929816 req-54f5557a-a3db-41cd-af01-5e8896a794b0 service nova] Creating event network-vif-deleted:9d2293e5-6c53-4814-8bf0-a0ba1534378d for instance f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 on hv-cinder-85596 Sep 05 17:04:51.943014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-df5004fc-ba13-4cef-98f5-449104929816 req-54f5557a-a3db-41cd-af01-5e8896a794b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032404 Sep 05 17:04:51.943740 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 211/419] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:04:52.287326 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cf5a1579-04d1-4337-9c27-79e5f5cffee7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:52.287975 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cf5a1579-04d1-4337-9c27-79e5f5cffee7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:52.295337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf5a1579-04d1-4337-9c27-79e5f5cffee7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:52.295785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf5a1579-04d1-4337-9c27-79e5f5cffee7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:52.296355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf5a1579-04d1-4337-9c27-79e5f5cffee7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:52.297162 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf5a1579-04d1-4337-9c27-79e5f5cffee7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:52.297820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf5a1579-04d1-4337-9c27-79e5f5cffee7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:52.298242 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf5a1579-04d1-4337-9c27-79e5f5cffee7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:52.452501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cf5a1579-04d1-4337-9c27-79e5f5cffee7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:52.461368 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cf5a1579-04d1-4337-9c27-79e5f5cffee7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:52.462816 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cf5a1579-04d1-4337-9c27-79e5f5cffee7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:52.463998 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cf5a1579-04d1-4337-9c27-79e5f5cffee7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1722 microversion: 2.20 time: 0.180867 Sep 05 17:04:52.464794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 209/420] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:04:52 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:04:52.547670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-70bf7756-77a6-4cb4-abce-ec3fa8e1a872 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:52.548396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-70bf7756-77a6-4cb4-abce-ec3fa8e1a872 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:52.554891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-70bf7756-77a6-4cb4-abce-ec3fa8e1a872 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:52.555414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-70bf7756-77a6-4cb4-abce-ec3fa8e1a872 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:52.555787 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-70bf7756-77a6-4cb4-abce-ec3fa8e1a872 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:52.556507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-70bf7756-77a6-4cb4-abce-ec3fa8e1a872 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:52.556958 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-70bf7756-77a6-4cb4-abce-ec3fa8e1a872 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:52.557378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-70bf7756-77a6-4cb4-abce-ec3fa8e1a872 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:52.589312 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-70bf7756-77a6-4cb4-abce-ec3fa8e1a872 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:52.589784 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-70bf7756-77a6-4cb4-abce-ec3fa8e1a872 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:52.590201 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-70bf7756-77a6-4cb4-abce-ec3fa8e1a872 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:52.590638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.objects.instance [None req-70bf7756-77a6-4cb4-abce-ec3fa8e1a872 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lazy-loading 'fault' on Instance uuid f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 {{(pid=120733) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:04:52.641683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-70bf7756-77a6-4cb4-abce-ec3fa8e1a872 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:52.649435 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-70bf7756-77a6-4cb4-abce-ec3fa8e1a872 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 200 len: 1304 microversion: 2.1 time: 0.106537 Sep 05 17:04:52.649998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 212/421] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:52 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:53.491089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-39696e7b-dbd8-4ccb-9a25-8225509891bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:53.491748 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-39696e7b-dbd8-4ccb-9a25-8225509891bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:53.497987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-39696e7b-dbd8-4ccb-9a25-8225509891bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:53.498472 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-39696e7b-dbd8-4ccb-9a25-8225509891bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:53.498912 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-39696e7b-dbd8-4ccb-9a25-8225509891bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:53.499621 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-39696e7b-dbd8-4ccb-9a25-8225509891bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:53.500097 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-39696e7b-dbd8-4ccb-9a25-8225509891bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:53.500561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-39696e7b-dbd8-4ccb-9a25-8225509891bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:53.638379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-39696e7b-dbd8-4ccb-9a25-8225509891bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:53.650581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-39696e7b-dbd8-4ccb-9a25-8225509891bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:53.652767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-39696e7b-dbd8-4ccb-9a25-8225509891bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:53.654515 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-39696e7b-dbd8-4ccb-9a25-8225509891bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1722 microversion: 2.20 time: 0.167059 Sep 05 17:04:53.655288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 210/422] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:04:53 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:04:53.674778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f3a6f51f-874e-4726-af9a-183fc3aff530 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:53.688132 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f3a6f51f-874e-4726-af9a-183fc3aff530 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: f66181b8-484f-4eb6-ae15-22e3e4d5a9e1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:53.688132 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3a6f51f-874e-4726-af9a-183fc3aff530 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:53.688132 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3a6f51f-874e-4726-af9a-183fc3aff530 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:53.688132 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3a6f51f-874e-4726-af9a-183fc3aff530 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:53.688573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3a6f51f-874e-4726-af9a-183fc3aff530 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:53.688573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3a6f51f-874e-4726-af9a-183fc3aff530 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:53.688573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3a6f51f-874e-4726-af9a-183fc3aff530 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:53.702119 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-f3a6f51f-874e-4726-af9a-183fc3aff530 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] HTTP exception thrown: Instance f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 could not be found. Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f3a6f51f-874e-4726-af9a-183fc3aff530 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Request method failure captured: Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 HTTP/1.1 Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFiwXjiLThksGANDaJ9eKS9f6T6G9-S7rVY-WDbb-KFWt8YxQiW3JobP0H8-4Qyfe6mqb3kGcvLWY2EuNnER0UPEHlmbAfYWbnXOt2KKIoUpGdnPCmBr4YCWypVdSjy2s2v8wazHfXd_UDaP5_H_PfrsOeeQbxLov-2mBPZw5XPOMeQs Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: 2d6228f311304b7b8e6354d865e16e9c Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-VolumesActionsTest-347892532 Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:04:53.703845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:04:53.705407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2d6228f311304b7b8e6354d865e16e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d6228f311304b7b8e6354d865e16e9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d6228f311304b7b8e6354d865e16e9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2d6228f311304b7b8e6354d865e16e9c"}]}] Sep 05 17:04:53.705407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-VolumesActionsTest-347892532 Sep 05 17:04:53.705407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: 2d6228f311304b7b8e6354d865e16e9c Sep 05 17:04:53.705407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-VolumesActionsTest-347892532 Sep 05 17:04:53.705407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-VolumesActionsTest-347892532-project Sep 05 17:04:53.705407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:04:53.705407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:04:53.705407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: 816427b5539240ad9aa22150a922bdc0 Sep 05 17:04:53.705407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-VolumesActionsTest-347892532-project Sep 05 17:04:53.705407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:04:53.705407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 could not be found. Sep 05 17:04:53.705407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': 'f66181b8-484f-4eb6-ae15-22e3e4d5a9e1'} Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 could not be found. Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:04:53.706352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 could not be found. Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 could not be found. Sep 05 17:04:53.707792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:04:53.709060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f3a6f51f-874e-4726-af9a-183fc3aff530 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Returning 404 to user: Instance f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:04:53.709060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f3a6f51f-874e-4726-af9a-183fc3aff530 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1" status: 404 len: 111 microversion: 2.1 time: 0.035265 Sep 05 17:04:53.709060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 213/423] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:53 2022] GET /compute/v2.1/servers/f66181b8-484f-4eb6-ae15-22e3e4d5a9e1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:04:53.805853 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1009185767", "imageRef": "c1a4f3d3-4d68-489a-a57b-bae7854beb29", "flavorRef": "452", "networks": [{"uuid": "e3da392a-3377-4b52-b0d0-762b7121c67e"}]}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:53.868646 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] validate_networks() for [('e3da392a-3377-4b52-b0d0-762b7121c67e', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:04:54.227413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:04:54.227823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:04:54.228320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:04:54.228714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:04:54.229116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:04:54.238073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:54.238543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:54.238964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:54.239666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:54.240103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:54.240545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:54.257344 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Getting quotas for project 2d6228f311304b7b8e6354d865e16e9c. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:04:54.261237 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Getting quotas for user 816427b5539240ad9aa22150a922bdc0 and project 2d6228f311304b7b8e6354d865e16e9c. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:04:54.271818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:04:54.274099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a4f3d3-4d68-489a-a57b-bae7854beb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:04:54.323895 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a541f131-f800-4510-870c-76f408a17121 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521805 Sep 05 17:04:54.324743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 211/424] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:04:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 17:04:54.335721 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c7109575-f219-43c5-8629-4a3b8c63c47f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:54.336340 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c7109575-f219-43c5-8629-4a3b8c63c47f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:54.399446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c7109575-f219-43c5-8629-4a3b8c63c47f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:54.410150 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c7109575-f219-43c5-8629-4a3b8c63c47f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1214 microversion: 2.1 time: 0.077309 Sep 05 17:04:54.425510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 214/425] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:54 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:54.684769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-01be6d1c-1fa0-4cc4-a205-220ac6322a27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:54.685366 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-01be6d1c-1fa0-4cc4-a205-220ac6322a27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:54.692189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01be6d1c-1fa0-4cc4-a205-220ac6322a27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:54.692620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01be6d1c-1fa0-4cc4-a205-220ac6322a27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:54.693101 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01be6d1c-1fa0-4cc4-a205-220ac6322a27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:54.693796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01be6d1c-1fa0-4cc4-a205-220ac6322a27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:54.694243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01be6d1c-1fa0-4cc4-a205-220ac6322a27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:54.694661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01be6d1c-1fa0-4cc4-a205-220ac6322a27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:54.836171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-01be6d1c-1fa0-4cc4-a205-220ac6322a27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:54.846553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-01be6d1c-1fa0-4cc4-a205-220ac6322a27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:54.848061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-01be6d1c-1fa0-4cc4-a205-220ac6322a27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:54.849251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-01be6d1c-1fa0-4cc4-a205-220ac6322a27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1722 microversion: 2.20 time: 0.168540 Sep 05 17:04:54.849778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 212/426] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:04:54 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:04:55.439962 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0ac5ed32-143a-4b21-9bae-b2aaf8d2173d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:55.441281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0ac5ed32-143a-4b21-9bae-b2aaf8d2173d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:55.452677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ac5ed32-143a-4b21-9bae-b2aaf8d2173d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:55.453613 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ac5ed32-143a-4b21-9bae-b2aaf8d2173d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:55.454495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ac5ed32-143a-4b21-9bae-b2aaf8d2173d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:55.455231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ac5ed32-143a-4b21-9bae-b2aaf8d2173d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:55.455674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ac5ed32-143a-4b21-9bae-b2aaf8d2173d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:55.456096 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ac5ed32-143a-4b21-9bae-b2aaf8d2173d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:55.520437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0ac5ed32-143a-4b21-9bae-b2aaf8d2173d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:55.528073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0ac5ed32-143a-4b21-9bae-b2aaf8d2173d tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1266 microversion: 2.1 time: 0.095284 Sep 05 17:04:55.528686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 215/427] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:55 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:55.877389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0a6d9698-b4f8-4c3d-a4bf-eeaadff71a1a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:55.878693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0a6d9698-b4f8-4c3d-a4bf-eeaadff71a1a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:55.888905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a6d9698-b4f8-4c3d-a4bf-eeaadff71a1a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:55.890701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a6d9698-b4f8-4c3d-a4bf-eeaadff71a1a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:55.891586 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a6d9698-b4f8-4c3d-a4bf-eeaadff71a1a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:55.892978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a6d9698-b4f8-4c3d-a4bf-eeaadff71a1a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:55.893698 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a6d9698-b4f8-4c3d-a4bf-eeaadff71a1a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:55.898974 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a6d9698-b4f8-4c3d-a4bf-eeaadff71a1a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:56.048650 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0a6d9698-b4f8-4c3d-a4bf-eeaadff71a1a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:56.057739 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0a6d9698-b4f8-4c3d-a4bf-eeaadff71a1a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:56.059205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0a6d9698-b4f8-4c3d-a4bf-eeaadff71a1a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:56.060403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0a6d9698-b4f8-4c3d-a4bf-eeaadff71a1a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1722 microversion: 2.20 time: 0.189153 Sep 05 17:04:56.061117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 213/428] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:04:55 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:04:56.551512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f6508cab-f90b-428e-a4e5-325c037af927 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:56.564881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f6508cab-f90b-428e-a4e5-325c037af927 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:56.573874 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6508cab-f90b-428e-a4e5-325c037af927 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:56.574349 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6508cab-f90b-428e-a4e5-325c037af927 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:56.574806 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6508cab-f90b-428e-a4e5-325c037af927 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:56.575492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6508cab-f90b-428e-a4e5-325c037af927 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:56.575941 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6508cab-f90b-428e-a4e5-325c037af927 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:56.576378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6508cab-f90b-428e-a4e5-325c037af927 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:56.709205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f6508cab-f90b-428e-a4e5-325c037af927 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:56.717516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f6508cab-f90b-428e-a4e5-325c037af927 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1314 microversion: 2.1 time: 0.169855 Sep 05 17:04:56.718053 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 216/429] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:56 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:57.089329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-de7479c2-d05c-4edc-9dc7-e5eee86bf9ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:57.090122 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-de7479c2-d05c-4edc-9dc7-e5eee86bf9ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:57.098144 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de7479c2-d05c-4edc-9dc7-e5eee86bf9ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:57.098636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de7479c2-d05c-4edc-9dc7-e5eee86bf9ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:57.099117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de7479c2-d05c-4edc-9dc7-e5eee86bf9ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:57.099918 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de7479c2-d05c-4edc-9dc7-e5eee86bf9ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:57.100375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de7479c2-d05c-4edc-9dc7-e5eee86bf9ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:57.100846 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de7479c2-d05c-4edc-9dc7-e5eee86bf9ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:57.226242 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-841f0cdc-b2cc-42d1-b520-78ddd82540ae req-ba15697b-d238-45da-b495-a0450b470808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2", "tag": "fe76dfed-62d1-410f-a91c-fe8af16ff47c"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:57.249915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-841f0cdc-b2cc-42d1-b520-78ddd82540ae req-ba15697b-d238-45da-b495-a0450b470808 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:57.251403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-841f0cdc-b2cc-42d1-b520-78ddd82540ae req-ba15697b-d238-45da-b495-a0450b470808 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:57.252452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-841f0cdc-b2cc-42d1-b520-78ddd82540ae req-ba15697b-d238-45da-b495-a0450b470808 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:57.256430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-de7479c2-d05c-4edc-9dc7-e5eee86bf9ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:57.264846 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-de7479c2-d05c-4edc-9dc7-e5eee86bf9ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:57.276799 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-841f0cdc-b2cc-42d1-b520-78ddd82540ae req-ba15697b-d238-45da-b495-a0450b470808 service nova] Creating event network-changed:fe76dfed-62d1-410f-a91c-fe8af16ff47c for instance 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 on hv-cinder-85596 Sep 05 17:04:57.277061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-de7479c2-d05c-4edc-9dc7-e5eee86bf9ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:57.278682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-de7479c2-d05c-4edc-9dc7-e5eee86bf9ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1722 microversion: 2.20 time: 0.193474 Sep 05 17:04:57.279315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 214/430] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:04:57 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:04:57.290753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-841f0cdc-b2cc-42d1-b520-78ddd82540ae req-ba15697b-d238-45da-b495-a0450b470808 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074053 Sep 05 17:04:57.291652 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 217/431] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:04:57.636793 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-76cec826-a474-48e1-96d9-dd4cec18338b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b106c932-d1ec-44ef-ad9d-c3ace0c19790", "device": "/dev/sdb"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:04:57.640373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-76cec826-a474-48e1-96d9-dd4cec18338b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:57.642419 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:04:57.647740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76cec826-a474-48e1-96d9-dd4cec18338b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:57.648293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76cec826-a474-48e1-96d9-dd4cec18338b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:57.648737 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76cec826-a474-48e1-96d9-dd4cec18338b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:57.649540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76cec826-a474-48e1-96d9-dd4cec18338b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:57.649992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76cec826-a474-48e1-96d9-dd4cec18338b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:57.650440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76cec826-a474-48e1-96d9-dd4cec18338b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:57.743098 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-36b4e842-1e0a-4d0e-82c6-a453aa455455 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:57.743810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-36b4e842-1e0a-4d0e-82c6-a453aa455455 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:57.750648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36b4e842-1e0a-4d0e-82c6-a453aa455455 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:57.751210 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36b4e842-1e0a-4d0e-82c6-a453aa455455 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:57.751664 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36b4e842-1e0a-4d0e-82c6-a453aa455455 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:57.752463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36b4e842-1e0a-4d0e-82c6-a453aa455455 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:57.752914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36b4e842-1e0a-4d0e-82c6-a453aa455455 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:57.753323 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36b4e842-1e0a-4d0e-82c6-a453aa455455 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:57.892383 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-36b4e842-1e0a-4d0e-82c6-a453aa455455 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:57.900590 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-36b4e842-1e0a-4d0e-82c6-a453aa455455 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1314 microversion: 2.1 time: 0.162633 Sep 05 17:04:57.901127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 218/432] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:57 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:58.307087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7b3c2072-7999-466b-8d00-7209a86172fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:58.307751 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7b3c2072-7999-466b-8d00-7209a86172fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:58.315249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b3c2072-7999-466b-8d00-7209a86172fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:58.315799 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b3c2072-7999-466b-8d00-7209a86172fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:58.316319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b3c2072-7999-466b-8d00-7209a86172fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:58.317113 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b3c2072-7999-466b-8d00-7209a86172fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:58.317630 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b3c2072-7999-466b-8d00-7209a86172fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:58.318109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b3c2072-7999-466b-8d00-7209a86172fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:58.457960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7b3c2072-7999-466b-8d00-7209a86172fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:58.469364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7b3c2072-7999-466b-8d00-7209a86172fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:58.471420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7b3c2072-7999-466b-8d00-7209a86172fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:58.473071 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7b3c2072-7999-466b-8d00-7209a86172fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1722 microversion: 2.20 time: 0.170121 Sep 05 17:04:58.473906 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 219/433] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:04:58 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:04:58.930828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-91555bc6-4495-48a2-ac82-d8e3095b909c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:58.931503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-91555bc6-4495-48a2-ac82-d8e3095b909c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:58.937980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91555bc6-4495-48a2-ac82-d8e3095b909c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:58.938451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91555bc6-4495-48a2-ac82-d8e3095b909c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:58.938871 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91555bc6-4495-48a2-ac82-d8e3095b909c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:58.939548 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91555bc6-4495-48a2-ac82-d8e3095b909c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:58.939987 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91555bc6-4495-48a2-ac82-d8e3095b909c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:58.940429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91555bc6-4495-48a2-ac82-d8e3095b909c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:59.093963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-91555bc6-4495-48a2-ac82-d8e3095b909c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:59.102468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-91555bc6-4495-48a2-ac82-d8e3095b909c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1314 microversion: 2.1 time: 0.181881 Sep 05 17:04:59.103005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 220/434] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:04:58 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:04:59.501868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-02130f0c-3ed5-4042-8d50-2450195b4c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:04:59.502672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-02130f0c-3ed5-4042-8d50-2450195b4c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:04:59.509561 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02130f0c-3ed5-4042-8d50-2450195b4c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:59.510051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02130f0c-3ed5-4042-8d50-2450195b4c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:59.510486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02130f0c-3ed5-4042-8d50-2450195b4c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:59.511206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02130f0c-3ed5-4042-8d50-2450195b4c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:04:59.511663 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02130f0c-3ed5-4042-8d50-2450195b4c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:04:59.512084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02130f0c-3ed5-4042-8d50-2450195b4c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:04:59.645983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-02130f0c-3ed5-4042-8d50-2450195b4c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:59.654271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-02130f0c-3ed5-4042-8d50-2450195b4c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:59.655699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-02130f0c-3ed5-4042-8d50-2450195b4c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:04:59.656883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-02130f0c-3ed5-4042-8d50-2450195b4c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1722 microversion: 2.20 time: 0.160372 Sep 05 17:04:59.657406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 221/435] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:04:59 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:00.133397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-eb979bf6-06e6-4c49-8faa-ec3fc7dc350c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:00.134229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-eb979bf6-06e6-4c49-8faa-ec3fc7dc350c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:00.137354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:05:00.137527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:05:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 (ip 10.222.0.23) !!! Sep 05 17:05:00.145731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eb979bf6-06e6-4c49-8faa-ec3fc7dc350c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:00.146292 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eb979bf6-06e6-4c49-8faa-ec3fc7dc350c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:00.146786 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eb979bf6-06e6-4c49-8faa-ec3fc7dc350c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:00.147823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eb979bf6-06e6-4c49-8faa-ec3fc7dc350c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:00.148512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eb979bf6-06e6-4c49-8faa-ec3fc7dc350c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:00.148935 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eb979bf6-06e6-4c49-8faa-ec3fc7dc350c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:00.291933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-eb979bf6-06e6-4c49-8faa-ec3fc7dc350c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:00.299726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-eb979bf6-06e6-4c49-8faa-ec3fc7dc350c tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1314 microversion: 2.1 time: 0.172675 Sep 05 17:05:00.300497 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 222/436] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:00 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:00.686006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-59dbfeaa-91dc-4766-847b-eb7ceb6f3571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:00.686914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-59dbfeaa-91dc-4766-847b-eb7ceb6f3571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:00.695654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59dbfeaa-91dc-4766-847b-eb7ceb6f3571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:00.696170 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59dbfeaa-91dc-4766-847b-eb7ceb6f3571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:00.696591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59dbfeaa-91dc-4766-847b-eb7ceb6f3571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:00.697268 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59dbfeaa-91dc-4766-847b-eb7ceb6f3571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:00.697709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59dbfeaa-91dc-4766-847b-eb7ceb6f3571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:00.698122 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59dbfeaa-91dc-4766-847b-eb7ceb6f3571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:00.840228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-59dbfeaa-91dc-4766-847b-eb7ceb6f3571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:00.848647 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-59dbfeaa-91dc-4766-847b-eb7ceb6f3571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:00.850279 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-59dbfeaa-91dc-4766-847b-eb7ceb6f3571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:00.852171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-59dbfeaa-91dc-4766-847b-eb7ceb6f3571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1722 microversion: 2.20 time: 0.172033 Sep 05 17:05:00.852728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 223/437] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:00 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:01.323169 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-119c9eb6-12b8-4fbe-8517-a52f5c4c014b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:01.323818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-119c9eb6-12b8-4fbe-8517-a52f5c4c014b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:01.330820 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-119c9eb6-12b8-4fbe-8517-a52f5c4c014b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:01.331298 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-119c9eb6-12b8-4fbe-8517-a52f5c4c014b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:01.331720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-119c9eb6-12b8-4fbe-8517-a52f5c4c014b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:01.332458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-119c9eb6-12b8-4fbe-8517-a52f5c4c014b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:01.332910 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-119c9eb6-12b8-4fbe-8517-a52f5c4c014b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:01.333321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-119c9eb6-12b8-4fbe-8517-a52f5c4c014b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:01.471782 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-119c9eb6-12b8-4fbe-8517-a52f5c4c014b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:01.479987 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-119c9eb6-12b8-4fbe-8517-a52f5c4c014b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1314 microversion: 2.1 time: 0.160838 Sep 05 17:05:01.480640 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 224/438] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:01 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:01.877773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6437a599-53d1-4179-95a1-c0ba86423a2c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:01.878425 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6437a599-53d1-4179-95a1-c0ba86423a2c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:01.885319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6437a599-53d1-4179-95a1-c0ba86423a2c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:01.885822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6437a599-53d1-4179-95a1-c0ba86423a2c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:01.886254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6437a599-53d1-4179-95a1-c0ba86423a2c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:01.887002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6437a599-53d1-4179-95a1-c0ba86423a2c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:01.887452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6437a599-53d1-4179-95a1-c0ba86423a2c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:01.887873 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6437a599-53d1-4179-95a1-c0ba86423a2c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:02.023493 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6437a599-53d1-4179-95a1-c0ba86423a2c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:02.032047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6437a599-53d1-4179-95a1-c0ba86423a2c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:02.033690 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6437a599-53d1-4179-95a1-c0ba86423a2c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:02.034887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6437a599-53d1-4179-95a1-c0ba86423a2c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1722 microversion: 2.20 time: 0.161336 Sep 05 17:05:02.035505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 225/439] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:01 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:02.502140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e474dd4a-1a04-4035-a443-fdc9785ac1c9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:02.502871 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e474dd4a-1a04-4035-a443-fdc9785ac1c9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:02.510747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e474dd4a-1a04-4035-a443-fdc9785ac1c9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:02.511238 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e474dd4a-1a04-4035-a443-fdc9785ac1c9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:02.511663 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e474dd4a-1a04-4035-a443-fdc9785ac1c9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:02.512390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e474dd4a-1a04-4035-a443-fdc9785ac1c9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:02.512838 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e474dd4a-1a04-4035-a443-fdc9785ac1c9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:02.513227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e474dd4a-1a04-4035-a443-fdc9785ac1c9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:02.648995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e474dd4a-1a04-4035-a443-fdc9785ac1c9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:02.661004 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e474dd4a-1a04-4035-a443-fdc9785ac1c9 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1314 microversion: 2.1 time: 0.162489 Sep 05 17:05:02.661769 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 226/440] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:02 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:03.065369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-94a639cf-8bc8-4f3c-bead-2122c7a001e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:03.066395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-94a639cf-8bc8-4f3c-bead-2122c7a001e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:03.076579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-94a639cf-8bc8-4f3c-bead-2122c7a001e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:03.077378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-94a639cf-8bc8-4f3c-bead-2122c7a001e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:03.078086 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-94a639cf-8bc8-4f3c-bead-2122c7a001e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:03.079213 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-94a639cf-8bc8-4f3c-bead-2122c7a001e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:03.079962 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-94a639cf-8bc8-4f3c-bead-2122c7a001e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:03.081171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-94a639cf-8bc8-4f3c-bead-2122c7a001e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:03.230677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-94a639cf-8bc8-4f3c-bead-2122c7a001e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:03.242918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-94a639cf-8bc8-4f3c-bead-2122c7a001e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:03.244375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-94a639cf-8bc8-4f3c-bead-2122c7a001e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:03.245517 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-94a639cf-8bc8-4f3c-bead-2122c7a001e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1722 microversion: 2.20 time: 0.186797 Sep 05 17:05:03.246073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 227/441] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:03 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:03.688474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cb15b19a-62df-4e6e-bb32-4d72a14f457e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:03.689554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cb15b19a-62df-4e6e-bb32-4d72a14f457e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:03.698451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb15b19a-62df-4e6e-bb32-4d72a14f457e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:03.698925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb15b19a-62df-4e6e-bb32-4d72a14f457e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:03.699345 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb15b19a-62df-4e6e-bb32-4d72a14f457e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:03.700023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb15b19a-62df-4e6e-bb32-4d72a14f457e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:03.700505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb15b19a-62df-4e6e-bb32-4d72a14f457e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:03.700947 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb15b19a-62df-4e6e-bb32-4d72a14f457e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:03.848186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cb15b19a-62df-4e6e-bb32-4d72a14f457e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:03.852096 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:03.856763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cb15b19a-62df-4e6e-bb32-4d72a14f457e tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1314 microversion: 2.1 time: 0.174787 Sep 05 17:05:03.857341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 228/442] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:03 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:04.174173 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-4764a18a-f9ee-4236-a548-32185e61a7f7 req-39b9d6d7-b375-4329-aee9-ccf61266a785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97cc15c7-947d-4daf-80e8-8edc37c01e68", "name": "network-vif-plugged", "status": "completed", "tag": "4a115af6-123d-4baf-bd17-df6792943a2d"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:05:04.186174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-4764a18a-f9ee-4236-a548-32185e61a7f7 req-39b9d6d7-b375-4329-aee9-ccf61266a785 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:04.186644 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-4764a18a-f9ee-4236-a548-32185e61a7f7 req-39b9d6d7-b375-4329-aee9-ccf61266a785 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:04.187244 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-4764a18a-f9ee-4236-a548-32185e61a7f7 req-39b9d6d7-b375-4329-aee9-ccf61266a785 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:04.199647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-76cec826-a474-48e1-96d9-dd4cec18338b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "POST /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.566249 Sep 05 17:05:04.200741 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-4764a18a-f9ee-4236-a548-32185e61a7f7 req-39b9d6d7-b375-4329-aee9-ccf61266a785 service nova] Creating event network-vif-plugged:4a115af6-123d-4baf-bd17-df6792943a2d for instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 on hv-cinder-85596 Sep 05 17:05:04.201615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 215/443] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Sep 5 17:04:57 2022] POST /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92/os-volume_attachments => generated 194 bytes in 6570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:05:04.223633 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-4764a18a-f9ee-4236-a548-32185e61a7f7 req-39b9d6d7-b375-4329-aee9-ccf61266a785 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053585 Sep 05 17:05:04.225152 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 229/444] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:05:04.268217 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:04.268993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=6 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:04.274558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-623502c8-3869-4253-bae9-bb9e1046e24a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:04.275459 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-623502c8-3869-4253-bae9-bb9e1046e24a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:04.283315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-623502c8-3869-4253-bae9-bb9e1046e24a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:04.283798 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-623502c8-3869-4253-bae9-bb9e1046e24a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:04.284255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-623502c8-3869-4253-bae9-bb9e1046e24a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:04.284988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-623502c8-3869-4253-bae9-bb9e1046e24a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:04.285435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-623502c8-3869-4253-bae9-bb9e1046e24a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:04.285849 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-623502c8-3869-4253-bae9-bb9e1046e24a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:04.421220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-623502c8-3869-4253-bae9-bb9e1046e24a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:04.429300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-623502c8-3869-4253-bae9-bb9e1046e24a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:04.430978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-623502c8-3869-4253-bae9-bb9e1046e24a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:04.432515 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-623502c8-3869-4253-bae9-bb9e1046e24a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1743 microversion: 2.20 time: 0.165295 Sep 05 17:05:04.433073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 216/445] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:04 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:04.937841 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=2 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:04.942466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-96a9faaa-3126-4b54-bada-ca86cd19ee16 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:04.943159 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-96a9faaa-3126-4b54-bada-ca86cd19ee16 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:04.949969 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96a9faaa-3126-4b54-bada-ca86cd19ee16 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:04.950420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96a9faaa-3126-4b54-bada-ca86cd19ee16 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:04.950849 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96a9faaa-3126-4b54-bada-ca86cd19ee16 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:04.951545 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96a9faaa-3126-4b54-bada-ca86cd19ee16 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:04.951988 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96a9faaa-3126-4b54-bada-ca86cd19ee16 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:04.952612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96a9faaa-3126-4b54-bada-ca86cd19ee16 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:05.108725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-96a9faaa-3126-4b54-bada-ca86cd19ee16 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:05.119689 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-96a9faaa-3126-4b54-bada-ca86cd19ee16 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1314 microversion: 2.1 time: 0.182697 Sep 05 17:05:05.120296 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 230/446] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:04 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:05.461782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-80d562a3-4631-42fe-8b5d-98f986b2c1ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:05.462794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-80d562a3-4631-42fe-8b5d-98f986b2c1ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:05.471966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d562a3-4631-42fe-8b5d-98f986b2c1ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:05.472482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d562a3-4631-42fe-8b5d-98f986b2c1ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:05.472959 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d562a3-4631-42fe-8b5d-98f986b2c1ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:05.474154 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d562a3-4631-42fe-8b5d-98f986b2c1ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:05.474794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d562a3-4631-42fe-8b5d-98f986b2c1ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:05.475354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d562a3-4631-42fe-8b5d-98f986b2c1ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:05.615630 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-80d562a3-4631-42fe-8b5d-98f986b2c1ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:05.628037 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-80d562a3-4631-42fe-8b5d-98f986b2c1ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:05.630250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-80d562a3-4631-42fe-8b5d-98f986b2c1ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:05.632011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-80d562a3-4631-42fe-8b5d-98f986b2c1ed tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1743 microversion: 2.20 time: 0.176222 Sep 05 17:05:05.632868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 217/447] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:05 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1743 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:06.142299 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-19c5fcbb-b23e-4035-966a-a32cd6388342 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:06.142852 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-19c5fcbb-b23e-4035-966a-a32cd6388342 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:06.145254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:06.150395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-19c5fcbb-b23e-4035-966a-a32cd6388342 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:06.150890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-19c5fcbb-b23e-4035-966a-a32cd6388342 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:06.151312 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-19c5fcbb-b23e-4035-966a-a32cd6388342 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:06.151995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-19c5fcbb-b23e-4035-966a-a32cd6388342 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:06.152476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-19c5fcbb-b23e-4035-966a-a32cd6388342 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:06.152891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-19c5fcbb-b23e-4035-966a-a32cd6388342 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:06.289599 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-19c5fcbb-b23e-4035-966a-a32cd6388342 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:06.302017 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-19c5fcbb-b23e-4035-966a-a32cd6388342 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1314 microversion: 2.1 time: 0.163200 Sep 05 17:05:06.302756 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 231/448] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:06 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:06.660435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e973634f-2037-4f8e-bddd-2b611932a639 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:06.661147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e973634f-2037-4f8e-bddd-2b611932a639 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:06.669767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e973634f-2037-4f8e-bddd-2b611932a639 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:06.670383 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e973634f-2037-4f8e-bddd-2b611932a639 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:06.670957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e973634f-2037-4f8e-bddd-2b611932a639 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:06.671731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e973634f-2037-4f8e-bddd-2b611932a639 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:06.672166 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e973634f-2037-4f8e-bddd-2b611932a639 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:06.672600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e973634f-2037-4f8e-bddd-2b611932a639 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:06.811633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e973634f-2037-4f8e-bddd-2b611932a639 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:06.819869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e973634f-2037-4f8e-bddd-2b611932a639 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:06.821412 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e973634f-2037-4f8e-bddd-2b611932a639 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:06.822607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e973634f-2037-4f8e-bddd-2b611932a639 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1743 microversion: 2.20 time: 0.168430 Sep 05 17:05:06.823169 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 218/449] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:06 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:06.838242 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-d51b542b-7dba-4470-898a-a78475cd4a17 req-41577372-d128-4a3d-9959-085bad9d253e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2", "name": "network-vif-plugged", "status": "completed", "tag": "fe76dfed-62d1-410f-a91c-fe8af16ff47c"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:05:06.849926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-d51b542b-7dba-4470-898a-a78475cd4a17 req-41577372-d128-4a3d-9959-085bad9d253e service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:06.850426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-d51b542b-7dba-4470-898a-a78475cd4a17 req-41577372-d128-4a3d-9959-085bad9d253e service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:06.850853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-d51b542b-7dba-4470-898a-a78475cd4a17 req-41577372-d128-4a3d-9959-085bad9d253e service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:06.864744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-d51b542b-7dba-4470-898a-a78475cd4a17 req-41577372-d128-4a3d-9959-085bad9d253e service nova] Creating event network-vif-plugged:fe76dfed-62d1-410f-a91c-fe8af16ff47c for instance 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 on hv-cinder-85596 Sep 05 17:05:06.869574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-d51b542b-7dba-4470-898a-a78475cd4a17 req-41577372-d128-4a3d-9959-085bad9d253e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035315 Sep 05 17:05:06.870168 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 232/450] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:05:07.331815 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c65185a0-1401-4386-99b4-835c0b406fe6 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:07.332948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c65185a0-1401-4386-99b4-835c0b406fe6 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:07.340956 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c65185a0-1401-4386-99b4-835c0b406fe6 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:07.341554 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c65185a0-1401-4386-99b4-835c0b406fe6 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:07.342084 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c65185a0-1401-4386-99b4-835c0b406fe6 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:07.343617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c65185a0-1401-4386-99b4-835c0b406fe6 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:07.344225 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c65185a0-1401-4386-99b4-835c0b406fe6 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:07.344753 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c65185a0-1401-4386-99b4-835c0b406fe6 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:07.479608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c65185a0-1401-4386-99b4-835c0b406fe6 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:07.489933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c65185a0-1401-4386-99b4-835c0b406fe6 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1314 microversion: 2.1 time: 0.165277 Sep 05 17:05:07.490829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 219/451] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:07 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:07.852406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5dfa2cb3-cb82-4b18-bfb3-260e128a8a5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:07.853255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5dfa2cb3-cb82-4b18-bfb3-260e128a8a5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:07.861408 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5dfa2cb3-cb82-4b18-bfb3-260e128a8a5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:07.861994 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5dfa2cb3-cb82-4b18-bfb3-260e128a8a5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:07.862519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5dfa2cb3-cb82-4b18-bfb3-260e128a8a5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:07.863354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5dfa2cb3-cb82-4b18-bfb3-260e128a8a5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:07.863910 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5dfa2cb3-cb82-4b18-bfb3-260e128a8a5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:07.864457 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5dfa2cb3-cb82-4b18-bfb3-260e128a8a5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:08.005256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5dfa2cb3-cb82-4b18-bfb3-260e128a8a5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:08.013827 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5dfa2cb3-cb82-4b18-bfb3-260e128a8a5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:08.015543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5dfa2cb3-cb82-4b18-bfb3-260e128a8a5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:08.017101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5dfa2cb3-cb82-4b18-bfb3-260e128a8a5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1743 microversion: 2.20 time: 0.171031 Sep 05 17:05:08.017668 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 233/452] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:07 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:08.513784 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d9bb40ab-4bd6-4d97-9d68-e88440f908f2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:08.515143 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d9bb40ab-4bd6-4d97-9d68-e88440f908f2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:08.522046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9bb40ab-4bd6-4d97-9d68-e88440f908f2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:08.522628 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9bb40ab-4bd6-4d97-9d68-e88440f908f2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:08.523064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9bb40ab-4bd6-4d97-9d68-e88440f908f2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:08.523761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9bb40ab-4bd6-4d97-9d68-e88440f908f2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:08.524218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9bb40ab-4bd6-4d97-9d68-e88440f908f2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:08.524636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9bb40ab-4bd6-4d97-9d68-e88440f908f2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:08.660537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d9bb40ab-4bd6-4d97-9d68-e88440f908f2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:08.668886 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d9bb40ab-4bd6-4d97-9d68-e88440f908f2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1314 microversion: 2.1 time: 0.159359 Sep 05 17:05:08.669466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 220/453] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:08 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:09.044695 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6e0381be-05bb-4d5d-a2ce-0c06ec433f9d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:09.045314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6e0381be-05bb-4d5d-a2ce-0c06ec433f9d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:09.052634 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6e0381be-05bb-4d5d-a2ce-0c06ec433f9d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:09.053107 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6e0381be-05bb-4d5d-a2ce-0c06ec433f9d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:09.053533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6e0381be-05bb-4d5d-a2ce-0c06ec433f9d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:09.054241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6e0381be-05bb-4d5d-a2ce-0c06ec433f9d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:09.054688 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6e0381be-05bb-4d5d-a2ce-0c06ec433f9d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:09.055100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6e0381be-05bb-4d5d-a2ce-0c06ec433f9d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:09.197873 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6e0381be-05bb-4d5d-a2ce-0c06ec433f9d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:09.208342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6e0381be-05bb-4d5d-a2ce-0c06ec433f9d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:09.210550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6e0381be-05bb-4d5d-a2ce-0c06ec433f9d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:09.212438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6e0381be-05bb-4d5d-a2ce-0c06ec433f9d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1743 microversion: 2.20 time: 0.171751 Sep 05 17:05:09.213215 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 234/454] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:09 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:09.542393 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1366746356", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1456766241", "security_groups": [{"name": "tempest-secgroup-smoke-1730614449"}], "block_device_mapping_v2": [{"uuid": "5d4e8a93-21a7-4fd2-a743-0818e7abc8ae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "be9f652a-9021-475f-a5fb-90e3a9fc56f6"}]}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:05:09.663807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] validate_networks() for [('be9f652a-9021-475f-a5fb-90e3a9fc56f6', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:05:09.697322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-43c937a7-73b5-4e67-bead-5859b1733243 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:09.697929 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-43c937a7-73b5-4e67-bead-5859b1733243 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:09.704641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43c937a7-73b5-4e67-bead-5859b1733243 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:09.705135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43c937a7-73b5-4e67-bead-5859b1733243 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:09.705567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43c937a7-73b5-4e67-bead-5859b1733243 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:09.706266 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43c937a7-73b5-4e67-bead-5859b1733243 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:09.706721 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43c937a7-73b5-4e67-bead-5859b1733243 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:09.707138 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43c937a7-73b5-4e67-bead-5859b1733243 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:09.893663 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-43c937a7-73b5-4e67-bead-5859b1733243 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:09.902558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-43c937a7-73b5-4e67-bead-5859b1733243 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1498 microversion: 2.1 time: 0.209116 Sep 05 17:05:09.903127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 235/455] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:09 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1498 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:10.107077 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:05:10.107495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:05:10.107953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:05:10.108388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:05:10.108803 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:05:10.117722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:10.118192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:10.118634 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:10.119320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:10.119820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:10.120173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:10.137222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Getting quotas for project e6c32d7007a1428a8bde1b73e5883db6. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:05:10.141488 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Getting quotas for user 9b3a59d52ce8432c964f8c94a6e96a4d and project e6c32d7007a1428a8bde1b73e5883db6. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:05:10.199218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:05:10.201433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d4e8a93-21a7-4fd2-a743-0818e7abc8ae',volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:05:10.238397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d3679655-7fa4-4b3c-a2ad-ca696ec1ae3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:10.238986 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d3679655-7fa4-4b3c-a2ad-ca696ec1ae3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:10.245977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3679655-7fa4-4b3c-a2ad-ca696ec1ae3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:10.246622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3679655-7fa4-4b3c-a2ad-ca696ec1ae3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:10.247170 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3679655-7fa4-4b3c-a2ad-ca696ec1ae3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:10.248587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3679655-7fa4-4b3c-a2ad-ca696ec1ae3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:10.249054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3679655-7fa4-4b3c-a2ad-ca696ec1ae3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:10.249550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3679655-7fa4-4b3c-a2ad-ca696ec1ae3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:10.340615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-afef638b-01f3-4d89-a592-582d213435b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.801990 Sep 05 17:05:10.341183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 221/456] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:05:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 17:05:10.353954 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9ea0e02b-308f-44ff-87a2-7dba56a3f172 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:10.354278 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9ea0e02b-308f-44ff-87a2-7dba56a3f172 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:10.429384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9ea0e02b-308f-44ff-87a2-7dba56a3f172 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:10.429681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d3679655-7fa4-4b3c-a2ad-ca696ec1ae3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:10.435505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9ea0e02b-308f-44ff-87a2-7dba56a3f172 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1095 microversion: 2.1 time: 0.086144 Sep 05 17:05:10.436545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 222/457] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:10 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1095 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:10.445070 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d3679655-7fa4-4b3c-a2ad-ca696ec1ae3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:10.446731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d3679655-7fa4-4b3c-a2ad-ca696ec1ae3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:10.448253 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d3679655-7fa4-4b3c-a2ad-ca696ec1ae3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1743 microversion: 2.20 time: 0.214091 Sep 05 17:05:10.449137 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 236/458] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:10 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1743 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:10.513354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c05ca6f7-5e34-4a8f-9202-c8cb2522235f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:10.513841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c05ca6f7-5e34-4a8f-9202-c8cb2522235f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:10.523609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c05ca6f7-5e34-4a8f-9202-c8cb2522235f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:10.524140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c05ca6f7-5e34-4a8f-9202-c8cb2522235f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:10.524590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c05ca6f7-5e34-4a8f-9202-c8cb2522235f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:10.525287 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c05ca6f7-5e34-4a8f-9202-c8cb2522235f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:10.525794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c05ca6f7-5e34-4a8f-9202-c8cb2522235f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:10.526218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c05ca6f7-5e34-4a8f-9202-c8cb2522235f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:10.544475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:10.552738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c05ca6f7-5e34-4a8f-9202-c8cb2522235f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:05:10.634862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c05ca6f7-5e34-4a8f-9202-c8cb2522235f tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 204 len: 0 microversion: 2.1 time: 0.125066 Sep 05 17:05:10.635747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 223/459] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:05:10 2022] DELETE /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:05:10.644044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f20333d5-e182-46f6-9200-4d83b1aea38a tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:10.644693 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f20333d5-e182-46f6-9200-4d83b1aea38a tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:10.650659 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f20333d5-e182-46f6-9200-4d83b1aea38a tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:10.651210 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f20333d5-e182-46f6-9200-4d83b1aea38a tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:10.651642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f20333d5-e182-46f6-9200-4d83b1aea38a tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:10.652374 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f20333d5-e182-46f6-9200-4d83b1aea38a tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:10.652829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f20333d5-e182-46f6-9200-4d83b1aea38a tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:10.653350 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f20333d5-e182-46f6-9200-4d83b1aea38a tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:10.782572 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f20333d5-e182-46f6-9200-4d83b1aea38a tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:10.791301 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f20333d5-e182-46f6-9200-4d83b1aea38a tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1504 microversion: 2.1 time: 0.151502 Sep 05 17:05:10.791906 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 237/460] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:10 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:11.466516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1022bb88-6757-4702-a5de-3c51561f3ab8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:11.467690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1022bb88-6757-4702-a5de-3c51561f3ab8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:11.474792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1022bb88-6757-4702-a5de-3c51561f3ab8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:11.475282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1022bb88-6757-4702-a5de-3c51561f3ab8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:11.475636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ee7e510c-cfdd-41b0-b4c3-d4e76f4f7358 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:11.476133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1022bb88-6757-4702-a5de-3c51561f3ab8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:11.476267 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ee7e510c-cfdd-41b0-b4c3-d4e76f4f7358 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:11.476384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1022bb88-6757-4702-a5de-3c51561f3ab8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:11.477198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1022bb88-6757-4702-a5de-3c51561f3ab8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:11.477615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1022bb88-6757-4702-a5de-3c51561f3ab8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:11.483215 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee7e510c-cfdd-41b0-b4c3-d4e76f4f7358 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:11.483709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee7e510c-cfdd-41b0-b4c3-d4e76f4f7358 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:11.484140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee7e510c-cfdd-41b0-b4c3-d4e76f4f7358 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:11.484868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee7e510c-cfdd-41b0-b4c3-d4e76f4f7358 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:11.485322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee7e510c-cfdd-41b0-b4c3-d4e76f4f7358 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:11.485826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee7e510c-cfdd-41b0-b4c3-d4e76f4f7358 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:11.550598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1022bb88-6757-4702-a5de-3c51561f3ab8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:11.558805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1022bb88-6757-4702-a5de-3c51561f3ab8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1145 microversion: 2.1 time: 0.099582 Sep 05 17:05:11.559593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 224/461] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:11 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1145 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:11.634558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ee7e510c-cfdd-41b0-b4c3-d4e76f4f7358 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:11.647164 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ee7e510c-cfdd-41b0-b4c3-d4e76f4f7358 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:11.649554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ee7e510c-cfdd-41b0-b4c3-d4e76f4f7358 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:11.651432 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ee7e510c-cfdd-41b0-b4c3-d4e76f4f7358 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1743 microversion: 2.20 time: 0.179466 Sep 05 17:05:11.652264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 238/462] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:11 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:11.819042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-46cacf11-7013-4849-8f9c-b7cafe148278 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:11.820506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-46cacf11-7013-4849-8f9c-b7cafe148278 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:11.830187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46cacf11-7013-4849-8f9c-b7cafe148278 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:11.830668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46cacf11-7013-4849-8f9c-b7cafe148278 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:11.831097 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46cacf11-7013-4849-8f9c-b7cafe148278 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:11.831808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46cacf11-7013-4849-8f9c-b7cafe148278 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:11.832288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46cacf11-7013-4849-8f9c-b7cafe148278 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:11.832712 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46cacf11-7013-4849-8f9c-b7cafe148278 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:11.982428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-46cacf11-7013-4849-8f9c-b7cafe148278 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:11.990915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-46cacf11-7013-4849-8f9c-b7cafe148278 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1504 microversion: 2.1 time: 0.178371 Sep 05 17:05:11.991487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 225/463] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:11 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:12.584342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5b7c75a7-7a57-4b17-9a30-2f7e657319f9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:12.585098 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5b7c75a7-7a57-4b17-9a30-2f7e657319f9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:12.594070 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b7c75a7-7a57-4b17-9a30-2f7e657319f9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:12.594744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b7c75a7-7a57-4b17-9a30-2f7e657319f9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:12.595338 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b7c75a7-7a57-4b17-9a30-2f7e657319f9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:12.596783 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b7c75a7-7a57-4b17-9a30-2f7e657319f9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:12.597386 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b7c75a7-7a57-4b17-9a30-2f7e657319f9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:12.597957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b7c75a7-7a57-4b17-9a30-2f7e657319f9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:12.671452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5b7c75a7-7a57-4b17-9a30-2f7e657319f9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:12.679112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-93ae9a36-e92b-444c-bb73-3c876a83ad8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:12.679721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-93ae9a36-e92b-444c-bb73-3c876a83ad8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:12.679825 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5b7c75a7-7a57-4b17-9a30-2f7e657319f9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1137 microversion: 2.1 time: 0.101177 Sep 05 17:05:12.680323 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 239/464] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:12 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1137 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:12.686802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93ae9a36-e92b-444c-bb73-3c876a83ad8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:12.687295 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93ae9a36-e92b-444c-bb73-3c876a83ad8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:12.687721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93ae9a36-e92b-444c-bb73-3c876a83ad8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:12.688431 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93ae9a36-e92b-444c-bb73-3c876a83ad8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:12.688879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93ae9a36-e92b-444c-bb73-3c876a83ad8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:12.689691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93ae9a36-e92b-444c-bb73-3c876a83ad8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:12.817847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-93ae9a36-e92b-444c-bb73-3c876a83ad8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:12.826082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-93ae9a36-e92b-444c-bb73-3c876a83ad8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:12.827525 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-93ae9a36-e92b-444c-bb73-3c876a83ad8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:12.828713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-93ae9a36-e92b-444c-bb73-3c876a83ad8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1743 microversion: 2.20 time: 0.153583 Sep 05 17:05:12.829261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 226/465] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:12 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:13.018706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-64ec8a4d-c5e7-473e-896a-bc99d220fff2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:13.019715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-64ec8a4d-c5e7-473e-896a-bc99d220fff2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:13.030371 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64ec8a4d-c5e7-473e-896a-bc99d220fff2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:13.031396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64ec8a4d-c5e7-473e-896a-bc99d220fff2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:13.032250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64ec8a4d-c5e7-473e-896a-bc99d220fff2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:13.033648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64ec8a4d-c5e7-473e-896a-bc99d220fff2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:13.034399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64ec8a4d-c5e7-473e-896a-bc99d220fff2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:13.035164 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64ec8a4d-c5e7-473e-896a-bc99d220fff2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:13.200524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-64ec8a4d-c5e7-473e-896a-bc99d220fff2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:13.209263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-64ec8a4d-c5e7-473e-896a-bc99d220fff2 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1504 microversion: 2.1 time: 0.197463 Sep 05 17:05:13.215376 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 240/466] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:13 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:13.703589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-73eeb49c-b3d4-4cec-a8ac-032ead78ec6b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:13.704211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-73eeb49c-b3d4-4cec-a8ac-032ead78ec6b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:13.710922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73eeb49c-b3d4-4cec-a8ac-032ead78ec6b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:13.711402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73eeb49c-b3d4-4cec-a8ac-032ead78ec6b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:13.711824 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73eeb49c-b3d4-4cec-a8ac-032ead78ec6b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:13.712541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73eeb49c-b3d4-4cec-a8ac-032ead78ec6b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:13.712979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73eeb49c-b3d4-4cec-a8ac-032ead78ec6b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:13.713390 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73eeb49c-b3d4-4cec-a8ac-032ead78ec6b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:13.780623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-73eeb49c-b3d4-4cec-a8ac-032ead78ec6b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:13.799199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-73eeb49c-b3d4-4cec-a8ac-032ead78ec6b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1193 microversion: 2.1 time: 0.099829 Sep 05 17:05:13.799793 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 227/467] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:13 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1193 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:05:13.858890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-1320bb1b-2d93-4720-9e73-a11eda47905f req-e64d4c71-2f74-4186-a2d2-5284af8fa7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2", "name": "network-vif-deleted", "tag": "fe76dfed-62d1-410f-a91c-fe8af16ff47c"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:05:13.872427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c8c518de-675c-4b04-9b53-760f96952672 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:13.872427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c8c518de-675c-4b04-9b53-760f96952672 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:13.880216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8c518de-675c-4b04-9b53-760f96952672 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:13.880216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8c518de-675c-4b04-9b53-760f96952672 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:13.880216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8c518de-675c-4b04-9b53-760f96952672 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:13.881918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8c518de-675c-4b04-9b53-760f96952672 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:13.882713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8c518de-675c-4b04-9b53-760f96952672 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:13.883355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8c518de-675c-4b04-9b53-760f96952672 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:13.892340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-1320bb1b-2d93-4720-9e73-a11eda47905f req-e64d4c71-2f74-4186-a2d2-5284af8fa7ed service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:13.893505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-1320bb1b-2d93-4720-9e73-a11eda47905f req-e64d4c71-2f74-4186-a2d2-5284af8fa7ed service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:13.894152 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-1320bb1b-2d93-4720-9e73-a11eda47905f req-e64d4c71-2f74-4186-a2d2-5284af8fa7ed service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:13.920878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-1320bb1b-2d93-4720-9e73-a11eda47905f req-e64d4c71-2f74-4186-a2d2-5284af8fa7ed service nova] Creating event network-vif-deleted:fe76dfed-62d1-410f-a91c-fe8af16ff47c for instance 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 on hv-cinder-85596 Sep 05 17:05:13.930040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-1320bb1b-2d93-4720-9e73-a11eda47905f req-e64d4c71-2f74-4186-a2d2-5284af8fa7ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074758 Sep 05 17:05:13.933706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 228/468] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:05:14.072632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c8c518de-675c-4b04-9b53-760f96952672 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:14.083776 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c8c518de-675c-4b04-9b53-760f96952672 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:14.085254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c8c518de-675c-4b04-9b53-760f96952672 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:14.086436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c8c518de-675c-4b04-9b53-760f96952672 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1738 microversion: 2.20 time: 0.233220 Sep 05 17:05:14.086998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 241/469] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:13 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:14.234729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-85d57741-8a4b-464c-be60-4f387d4cb512 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:14.235966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-85d57741-8a4b-464c-be60-4f387d4cb512 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:14.242887 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85d57741-8a4b-464c-be60-4f387d4cb512 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:14.243536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85d57741-8a4b-464c-be60-4f387d4cb512 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:14.244316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85d57741-8a4b-464c-be60-4f387d4cb512 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:14.244871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85d57741-8a4b-464c-be60-4f387d4cb512 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:14.245356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85d57741-8a4b-464c-be60-4f387d4cb512 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:14.245865 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85d57741-8a4b-464c-be60-4f387d4cb512 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:14.283857 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85d57741-8a4b-464c-be60-4f387d4cb512 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:14.284346 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85d57741-8a4b-464c-be60-4f387d4cb512 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:14.284778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85d57741-8a4b-464c-be60-4f387d4cb512 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:14.285258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-85d57741-8a4b-464c-be60-4f387d4cb512 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lazy-loading 'fault' on Instance uuid 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:05:14.337093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-85d57741-8a4b-464c-be60-4f387d4cb512 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:14.344929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-85d57741-8a4b-464c-be60-4f387d4cb512 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1304 microversion: 2.1 time: 0.115554 Sep 05 17:05:14.345512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 229/470] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:14 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:14.823071 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2c797f9a-0b01-492d-bc5f-7e415e298ec0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:14.824126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2c797f9a-0b01-492d-bc5f-7e415e298ec0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:14.830764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c797f9a-0b01-492d-bc5f-7e415e298ec0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:14.831807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c797f9a-0b01-492d-bc5f-7e415e298ec0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:14.832509 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c797f9a-0b01-492d-bc5f-7e415e298ec0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:14.833471 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c797f9a-0b01-492d-bc5f-7e415e298ec0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:14.834041 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c797f9a-0b01-492d-bc5f-7e415e298ec0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:14.834549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c797f9a-0b01-492d-bc5f-7e415e298ec0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:14.917163 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2c797f9a-0b01-492d-bc5f-7e415e298ec0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:14.927262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2c797f9a-0b01-492d-bc5f-7e415e298ec0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1211 microversion: 2.1 time: 0.108557 Sep 05 17:05:14.928457 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 242/471] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:14 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1211 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:15.114921 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-39a8f07f-fc08-4739-85de-7e162e6445f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:15.116489 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-39a8f07f-fc08-4739-85de-7e162e6445f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:15.144184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-39a8f07f-fc08-4739-85de-7e162e6445f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:15.144695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-39a8f07f-fc08-4739-85de-7e162e6445f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:15.145125 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-39a8f07f-fc08-4739-85de-7e162e6445f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:15.145991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-39a8f07f-fc08-4739-85de-7e162e6445f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:15.146526 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-39a8f07f-fc08-4739-85de-7e162e6445f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:15.146903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-39a8f07f-fc08-4739-85de-7e162e6445f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:15.389849 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-39a8f07f-fc08-4739-85de-7e162e6445f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:15.396888 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ea972b3d-a511-4804-8a54-1e66e9270221 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:15.397742 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ea972b3d-a511-4804-8a54-1e66e9270221 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:15.402449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-39a8f07f-fc08-4739-85de-7e162e6445f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:15.404335 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-39a8f07f-fc08-4739-85de-7e162e6445f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:15.408267 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-39a8f07f-fc08-4739-85de-7e162e6445f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1738 microversion: 2.20 time: 0.297029 Sep 05 17:05:15.410731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 230/472] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:15 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:15.422142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ea972b3d-a511-4804-8a54-1e66e9270221 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:15.423153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ea972b3d-a511-4804-8a54-1e66e9270221 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:15.423756 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ea972b3d-a511-4804-8a54-1e66e9270221 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:15.424643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ea972b3d-a511-4804-8a54-1e66e9270221 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:15.425235 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ea972b3d-a511-4804-8a54-1e66e9270221 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:15.425790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ea972b3d-a511-4804-8a54-1e66e9270221 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:15.492011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ea972b3d-a511-4804-8a54-1e66e9270221 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:15.493535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ea972b3d-a511-4804-8a54-1e66e9270221 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:15.495030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ea972b3d-a511-4804-8a54-1e66e9270221 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:15.495782 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.objects.instance [None req-ea972b3d-a511-4804-8a54-1e66e9270221 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lazy-loading 'fault' on Instance uuid 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 {{(pid=120733) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:05:15.566214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ea972b3d-a511-4804-8a54-1e66e9270221 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:15.574907 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ea972b3d-a511-4804-8a54-1e66e9270221 tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1304 microversion: 2.1 time: 0.208522 Sep 05 17:05:15.575846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 243/473] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:15 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1304 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:15.951099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1bf7c22a-a9a9-414a-b0d5-c82944d4edb1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:15.951731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1bf7c22a-a9a9-414a-b0d5-c82944d4edb1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:15.960797 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bf7c22a-a9a9-414a-b0d5-c82944d4edb1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:15.961385 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bf7c22a-a9a9-414a-b0d5-c82944d4edb1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:15.961898 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bf7c22a-a9a9-414a-b0d5-c82944d4edb1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:15.962678 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bf7c22a-a9a9-414a-b0d5-c82944d4edb1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:15.963222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bf7c22a-a9a9-414a-b0d5-c82944d4edb1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:15.963709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bf7c22a-a9a9-414a-b0d5-c82944d4edb1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:16.123527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1bf7c22a-a9a9-414a-b0d5-c82944d4edb1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:16.131932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1bf7c22a-a9a9-414a-b0d5-c82944d4edb1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.184805 Sep 05 17:05:16.132885 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 231/474] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:15 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:16.440426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d95d33c1-b84e-464e-85b7-3a7f8854172c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:16.442212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d95d33c1-b84e-464e-85b7-3a7f8854172c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:16.449178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d95d33c1-b84e-464e-85b7-3a7f8854172c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:16.449731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d95d33c1-b84e-464e-85b7-3a7f8854172c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:16.450746 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d95d33c1-b84e-464e-85b7-3a7f8854172c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:16.452014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d95d33c1-b84e-464e-85b7-3a7f8854172c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:16.452897 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d95d33c1-b84e-464e-85b7-3a7f8854172c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:16.453649 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d95d33c1-b84e-464e-85b7-3a7f8854172c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:16.610706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-40b7d11b-b7b1-4947-bc98-7bffb756c84b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:16.612201 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d95d33c1-b84e-464e-85b7-3a7f8854172c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:16.613727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-40b7d11b-b7b1-4947-bc98-7bffb756c84b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:16.622758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d95d33c1-b84e-464e-85b7-3a7f8854172c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:16.624593 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d95d33c1-b84e-464e-85b7-3a7f8854172c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:16.625967 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d95d33c1-b84e-464e-85b7-3a7f8854172c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1738 microversion: 2.20 time: 0.192686 Sep 05 17:05:16.640187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 244/475] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:16 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:16.640446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40b7d11b-b7b1-4947-bc98-7bffb756c84b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:16.640446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40b7d11b-b7b1-4947-bc98-7bffb756c84b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:16.640446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40b7d11b-b7b1-4947-bc98-7bffb756c84b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:16.640446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40b7d11b-b7b1-4947-bc98-7bffb756c84b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:16.640792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40b7d11b-b7b1-4947-bc98-7bffb756c84b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:16.640792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40b7d11b-b7b1-4947-bc98-7bffb756c84b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:16.689667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40b7d11b-b7b1-4947-bc98-7bffb756c84b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:16.690284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40b7d11b-b7b1-4947-bc98-7bffb756c84b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:16.691129 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40b7d11b-b7b1-4947-bc98-7bffb756c84b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:16.691583 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-40b7d11b-b7b1-4947-bc98-7bffb756c84b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lazy-loading 'fault' on Instance uuid 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:05:16.736389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-40b7d11b-b7b1-4947-bc98-7bffb756c84b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816427b5539240ad9aa22150a922bdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6228f311304b7b8e6354d865e16e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:16.745713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-40b7d11b-b7b1-4947-bc98-7bffb756c84b tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 200 len: 1304 microversion: 2.1 time: 0.150254 Sep 05 17:05:16.760172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 232/476] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:16 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:17.176458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fca6705b-2603-4927-ab2a-18699196fd89 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:17.177138 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fca6705b-2603-4927-ab2a-18699196fd89 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:17.183674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fca6705b-2603-4927-ab2a-18699196fd89 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:17.184173 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fca6705b-2603-4927-ab2a-18699196fd89 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:17.184625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fca6705b-2603-4927-ab2a-18699196fd89 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:17.185318 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fca6705b-2603-4927-ab2a-18699196fd89 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:17.185768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fca6705b-2603-4927-ab2a-18699196fd89 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:17.186192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fca6705b-2603-4927-ab2a-18699196fd89 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:17.345942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fca6705b-2603-4927-ab2a-18699196fd89 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:17.358046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fca6705b-2603-4927-ab2a-18699196fd89 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.206079 Sep 05 17:05:17.358684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 245/477] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:17 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:17.653629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2bd6ce4d-97a0-4fd6-a0c1-b83fca69be7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:17.655076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2bd6ce4d-97a0-4fd6-a0c1-b83fca69be7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:17.662689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bd6ce4d-97a0-4fd6-a0c1-b83fca69be7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:17.663565 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bd6ce4d-97a0-4fd6-a0c1-b83fca69be7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:17.664446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bd6ce4d-97a0-4fd6-a0c1-b83fca69be7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:17.668457 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bd6ce4d-97a0-4fd6-a0c1-b83fca69be7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:17.668457 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bd6ce4d-97a0-4fd6-a0c1-b83fca69be7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:17.668457 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bd6ce4d-97a0-4fd6-a0c1-b83fca69be7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:17.769994 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-085232a2-a928-4043-a2ce-fe298d3f99bf tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:17.770611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-085232a2-a928-4043-a2ce-fe298d3f99bf tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] [instance: 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:17.785826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-085232a2-a928-4043-a2ce-fe298d3f99bf tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:17.786321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-085232a2-a928-4043-a2ce-fe298d3f99bf tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:17.786753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-085232a2-a928-4043-a2ce-fe298d3f99bf tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:17.787623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-085232a2-a928-4043-a2ce-fe298d3f99bf tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:17.788531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-085232a2-a928-4043-a2ce-fe298d3f99bf tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:17.788531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-085232a2-a928-4043-a2ce-fe298d3f99bf tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:17.803334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-085232a2-a928-4043-a2ce-fe298d3f99bf tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] HTTP exception thrown: Instance 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 could not be found. Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-085232a2-a928-4043-a2ce-fe298d3f99bf tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Request method failure captured: Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 HTTP/1.1 Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFiwXjiLThksGANDaJ9eKS9f6T6G9-S7rVY-WDbb-KFWt8YxQiW3JobP0H8-4Qyfe6mqb3kGcvLWY2EuNnER0UPEHlmbAfYWbnXOt2KKIoUpGdnPCmBr4YCWypVdSjy2s2v8wazHfXd_UDaP5_H_PfrsOeeQbxLov-2mBPZw5XPOMeQs Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: 2d6228f311304b7b8e6354d865e16e9c Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-VolumesActionsTest-347892532 Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:05:17.805916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:05:17.807254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2d6228f311304b7b8e6354d865e16e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d6228f311304b7b8e6354d865e16e9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2d6228f311304b7b8e6354d865e16e9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2d6228f311304b7b8e6354d865e16e9c"}]}] Sep 05 17:05:17.807254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-VolumesActionsTest-347892532 Sep 05 17:05:17.807254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: 2d6228f311304b7b8e6354d865e16e9c Sep 05 17:05:17.807254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-VolumesActionsTest-347892532 Sep 05 17:05:17.807254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-VolumesActionsTest-347892532-project Sep 05 17:05:17.807254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:05:17.807254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:05:17.807254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: 816427b5539240ad9aa22150a922bdc0 Sep 05 17:05:17.807254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-VolumesActionsTest-347892532-project Sep 05 17:05:17.807254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:05:17.807254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 could not be found. Sep 05 17:05:17.807254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': '5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2'} Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 could not be found. Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:05:17.808171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 could not be found. Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 could not be found. Sep 05 17:05:17.809420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:05:17.810551 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-085232a2-a928-4043-a2ce-fe298d3f99bf tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] Returning 404 to user: Instance 5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:05:17.810551 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-085232a2-a928-4043-a2ce-fe298d3f99bf tempest-VolumesActionsTest-347892532 tempest-VolumesActionsTest-347892532-project] 10.222.0.23 "GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2" status: 404 len: 111 microversion: 2.1 time: 0.040673 Sep 05 17:05:17.810551 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 246/478] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:17 2022] GET /compute/v2.1/servers/5a9b6abd-56ef-4430-89a2-bf8f0ae1d5a2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:05:17.828175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2bd6ce4d-97a0-4fd6-a0c1-b83fca69be7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:17.839940 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2bd6ce4d-97a0-4fd6-a0c1-b83fca69be7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:17.841425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2bd6ce4d-97a0-4fd6-a0c1-b83fca69be7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:17.842597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2bd6ce4d-97a0-4fd6-a0c1-b83fca69be7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1738 microversion: 2.20 time: 0.193565 Sep 05 17:05:17.854871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 233/479] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:17 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:18.379924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-37220572-bd27-4904-a7a6-ab60670e41c5 req-49b7eb2a-4ea6-4c2c-868e-ca6825316406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3820bb09-911a-4093-952b-3487f165122f", "tag": "b8d3b025-c734-4edc-9914-e4b7d38eb338"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:05:18.384058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-981625da-1708-452b-afc5-e5b1bd18b0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:18.385676 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-981625da-1708-452b-afc5-e5b1bd18b0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:18.394557 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-981625da-1708-452b-afc5-e5b1bd18b0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:18.395608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-37220572-bd27-4904-a7a6-ab60670e41c5 req-49b7eb2a-4ea6-4c2c-868e-ca6825316406 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:18.396306 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-37220572-bd27-4904-a7a6-ab60670e41c5 req-49b7eb2a-4ea6-4c2c-868e-ca6825316406 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:18.396833 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-37220572-bd27-4904-a7a6-ab60670e41c5 req-49b7eb2a-4ea6-4c2c-868e-ca6825316406 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:18.397845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-981625da-1708-452b-afc5-e5b1bd18b0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:18.398266 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-981625da-1708-452b-afc5-e5b1bd18b0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:18.399026 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-981625da-1708-452b-afc5-e5b1bd18b0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:18.400854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-981625da-1708-452b-afc5-e5b1bd18b0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:18.401512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-981625da-1708-452b-afc5-e5b1bd18b0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:18.408465 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:18.410798 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-37220572-bd27-4904-a7a6-ab60670e41c5 req-49b7eb2a-4ea6-4c2c-868e-ca6825316406 service nova] Creating event network-changed:b8d3b025-c734-4edc-9914-e4b7d38eb338 for instance 3820bb09-911a-4093-952b-3487f165122f on hv-cinder-85596 Sep 05 17:05:18.418534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-37220572-bd27-4904-a7a6-ab60670e41c5 req-49b7eb2a-4ea6-4c2c-868e-ca6825316406 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046127 Sep 05 17:05:18.422007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 247/480] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:05:18.602304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-981625da-1708-452b-afc5-e5b1bd18b0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:18.611862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-981625da-1708-452b-afc5-e5b1bd18b0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.231716 Sep 05 17:05:18.612718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 234/481] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:18 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:18.876574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e29f5ae2-f883-4231-981e-90071f91acab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:18.877797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e29f5ae2-f883-4231-981e-90071f91acab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:18.886629 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e29f5ae2-f883-4231-981e-90071f91acab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:18.887259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e29f5ae2-f883-4231-981e-90071f91acab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:18.887922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e29f5ae2-f883-4231-981e-90071f91acab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:18.888889 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e29f5ae2-f883-4231-981e-90071f91acab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:18.889745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e29f5ae2-f883-4231-981e-90071f91acab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:18.890322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e29f5ae2-f883-4231-981e-90071f91acab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:19.059544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e29f5ae2-f883-4231-981e-90071f91acab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:19.074581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e29f5ae2-f883-4231-981e-90071f91acab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:19.076531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e29f5ae2-f883-4231-981e-90071f91acab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:19.077982 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e29f5ae2-f883-4231-981e-90071f91acab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1738 microversion: 2.20 time: 0.208592 Sep 05 17:05:19.078542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 248/482] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:18 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:19.636013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-03d71a58-db36-4a2b-9d37-8aa0f8105ca1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:19.637466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-03d71a58-db36-4a2b-9d37-8aa0f8105ca1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:19.644860 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03d71a58-db36-4a2b-9d37-8aa0f8105ca1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:19.645350 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03d71a58-db36-4a2b-9d37-8aa0f8105ca1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:19.645897 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03d71a58-db36-4a2b-9d37-8aa0f8105ca1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:19.647738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03d71a58-db36-4a2b-9d37-8aa0f8105ca1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:19.648224 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03d71a58-db36-4a2b-9d37-8aa0f8105ca1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:19.648883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03d71a58-db36-4a2b-9d37-8aa0f8105ca1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:19.825138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-03d71a58-db36-4a2b-9d37-8aa0f8105ca1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:19.836987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-03d71a58-db36-4a2b-9d37-8aa0f8105ca1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.205430 Sep 05 17:05:19.844216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 235/483] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:19 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:20.108411 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3f43bd99-dde9-4ef5-8032-0f7a33960b47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:20.109427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3f43bd99-dde9-4ef5-8032-0f7a33960b47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:20.128600 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3f43bd99-dde9-4ef5-8032-0f7a33960b47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:20.129098 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3f43bd99-dde9-4ef5-8032-0f7a33960b47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:20.129522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3f43bd99-dde9-4ef5-8032-0f7a33960b47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:20.130231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3f43bd99-dde9-4ef5-8032-0f7a33960b47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:20.130933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3f43bd99-dde9-4ef5-8032-0f7a33960b47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:20.131443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3f43bd99-dde9-4ef5-8032-0f7a33960b47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:20.287757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3f43bd99-dde9-4ef5-8032-0f7a33960b47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:20.297688 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3f43bd99-dde9-4ef5-8032-0f7a33960b47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:20.299588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3f43bd99-dde9-4ef5-8032-0f7a33960b47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:20.301100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3f43bd99-dde9-4ef5-8032-0f7a33960b47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1738 microversion: 2.20 time: 0.198732 Sep 05 17:05:20.301787 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 249/484] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:20 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:20.861575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b323e7c1-ee96-42cb-8314-bed6b2f99a3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:20.862253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b323e7c1-ee96-42cb-8314-bed6b2f99a3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:20.881895 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:20.882623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=8 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:20.887231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b323e7c1-ee96-42cb-8314-bed6b2f99a3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:20.887755 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b323e7c1-ee96-42cb-8314-bed6b2f99a3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:20.889462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b323e7c1-ee96-42cb-8314-bed6b2f99a3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:20.890438 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b323e7c1-ee96-42cb-8314-bed6b2f99a3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:20.891090 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b323e7c1-ee96-42cb-8314-bed6b2f99a3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:20.891675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b323e7c1-ee96-42cb-8314-bed6b2f99a3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:21.039260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b323e7c1-ee96-42cb-8314-bed6b2f99a3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:21.047831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b323e7c1-ee96-42cb-8314-bed6b2f99a3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.190410 Sep 05 17:05:21.048576 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 236/485] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:20 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:21.326976 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ac9712ec-f239-4d7d-8f87-e971da18bc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:21.328369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ac9712ec-f239-4d7d-8f87-e971da18bc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:21.336634 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac9712ec-f239-4d7d-8f87-e971da18bc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:21.337644 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac9712ec-f239-4d7d-8f87-e971da18bc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:21.338145 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac9712ec-f239-4d7d-8f87-e971da18bc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:21.338939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac9712ec-f239-4d7d-8f87-e971da18bc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:21.339491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac9712ec-f239-4d7d-8f87-e971da18bc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:21.339970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac9712ec-f239-4d7d-8f87-e971da18bc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:21.503840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ac9712ec-f239-4d7d-8f87-e971da18bc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:21.512844 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ac9712ec-f239-4d7d-8f87-e971da18bc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:21.514321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ac9712ec-f239-4d7d-8f87-e971da18bc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:21.515505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ac9712ec-f239-4d7d-8f87-e971da18bc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1738 microversion: 2.20 time: 0.192474 Sep 05 17:05:21.516075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 250/486] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:21 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:22.073325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f1692e89-697f-43d6-b30a-5f16778efb90 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:22.073933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f1692e89-697f-43d6-b30a-5f16778efb90 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:22.080668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1692e89-697f-43d6-b30a-5f16778efb90 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:22.081538 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1692e89-697f-43d6-b30a-5f16778efb90 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:22.082263 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1692e89-697f-43d6-b30a-5f16778efb90 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:22.083215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1692e89-697f-43d6-b30a-5f16778efb90 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:22.083839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1692e89-697f-43d6-b30a-5f16778efb90 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:22.084708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1692e89-697f-43d6-b30a-5f16778efb90 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:22.232496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f1692e89-697f-43d6-b30a-5f16778efb90 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:22.241065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f1692e89-697f-43d6-b30a-5f16778efb90 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.173736 Sep 05 17:05:22.241649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 237/487] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:22 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:22.542136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-304d9e7f-aefd-4db3-b40e-897172773396 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:22.542683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-304d9e7f-aefd-4db3-b40e-897172773396 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:22.549527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-304d9e7f-aefd-4db3-b40e-897172773396 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:22.550087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-304d9e7f-aefd-4db3-b40e-897172773396 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:22.550582 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-304d9e7f-aefd-4db3-b40e-897172773396 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:22.551337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-304d9e7f-aefd-4db3-b40e-897172773396 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:22.551984 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-304d9e7f-aefd-4db3-b40e-897172773396 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:22.552846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-304d9e7f-aefd-4db3-b40e-897172773396 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:22.704713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-304d9e7f-aefd-4db3-b40e-897172773396 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:22.714325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-304d9e7f-aefd-4db3-b40e-897172773396 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:22.715763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-304d9e7f-aefd-4db3-b40e-897172773396 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:22.716983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-304d9e7f-aefd-4db3-b40e-897172773396 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1738 microversion: 2.20 time: 0.179790 Sep 05 17:05:22.718070 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 251/488] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:22 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:23.264387 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b75fd6b4-9add-4102-8622-3a3cf17b6481 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:23.265024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b75fd6b4-9add-4102-8622-3a3cf17b6481 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:23.275474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b75fd6b4-9add-4102-8622-3a3cf17b6481 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:23.275968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b75fd6b4-9add-4102-8622-3a3cf17b6481 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:23.276428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b75fd6b4-9add-4102-8622-3a3cf17b6481 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:23.277136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b75fd6b4-9add-4102-8622-3a3cf17b6481 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:23.277583 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b75fd6b4-9add-4102-8622-3a3cf17b6481 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:23.278003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b75fd6b4-9add-4102-8622-3a3cf17b6481 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:23.301557 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:23.445018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b75fd6b4-9add-4102-8622-3a3cf17b6481 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:23.453680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b75fd6b4-9add-4102-8622-3a3cf17b6481 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.193157 Sep 05 17:05:23.454858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 238/489] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:23 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:23.743804 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-84c0121b-40eb-436e-aeaa-805edc2a975f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:23.744467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-84c0121b-40eb-436e-aeaa-805edc2a975f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:23.751858 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84c0121b-40eb-436e-aeaa-805edc2a975f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:23.752408 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84c0121b-40eb-436e-aeaa-805edc2a975f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:23.753865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84c0121b-40eb-436e-aeaa-805edc2a975f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:23.754631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84c0121b-40eb-436e-aeaa-805edc2a975f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:23.756503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84c0121b-40eb-436e-aeaa-805edc2a975f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:23.757044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84c0121b-40eb-436e-aeaa-805edc2a975f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:23.898025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-84c0121b-40eb-436e-aeaa-805edc2a975f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:23.906540 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-84c0121b-40eb-436e-aeaa-805edc2a975f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:23.908358 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-84c0121b-40eb-436e-aeaa-805edc2a975f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:23.909524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-84c0121b-40eb-436e-aeaa-805edc2a975f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1738 microversion: 2.20 time: 0.169811 Sep 05 17:05:23.910110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 252/490] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:23 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:24.477585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a722c2c2-0b3d-4124-a01b-ab1edcba8330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:24.478189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a722c2c2-0b3d-4124-a01b-ab1edcba8330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:24.486168 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a722c2c2-0b3d-4124-a01b-ab1edcba8330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:24.486641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a722c2c2-0b3d-4124-a01b-ab1edcba8330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:24.487071 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a722c2c2-0b3d-4124-a01b-ab1edcba8330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:24.487760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a722c2c2-0b3d-4124-a01b-ab1edcba8330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:24.488218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a722c2c2-0b3d-4124-a01b-ab1edcba8330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:24.488692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a722c2c2-0b3d-4124-a01b-ab1edcba8330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:24.626092 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a722c2c2-0b3d-4124-a01b-ab1edcba8330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:24.634401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a722c2c2-0b3d-4124-a01b-ab1edcba8330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.161095 Sep 05 17:05:24.634967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 239/491] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:24 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:24.939343 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d4832434-8bba-4b01-9513-3337987baa27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:24.940257 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d4832434-8bba-4b01-9513-3337987baa27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:24.951701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d4832434-8bba-4b01-9513-3337987baa27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:24.952740 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d4832434-8bba-4b01-9513-3337987baa27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:24.953484 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d4832434-8bba-4b01-9513-3337987baa27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:24.954869 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d4832434-8bba-4b01-9513-3337987baa27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:24.955674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d4832434-8bba-4b01-9513-3337987baa27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:24.956475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d4832434-8bba-4b01-9513-3337987baa27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:25.095008 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d4832434-8bba-4b01-9513-3337987baa27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:25.108071 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d4832434-8bba-4b01-9513-3337987baa27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:25.110461 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d4832434-8bba-4b01-9513-3337987baa27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:25.112133 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d4832434-8bba-4b01-9513-3337987baa27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1738 microversion: 2.20 time: 0.179241 Sep 05 17:05:25.112904 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 253/492] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:24 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:25.670454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bb591d4c-f682-433f-b3b2-715470aeb78d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:25.671282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bb591d4c-f682-433f-b3b2-715470aeb78d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:25.680874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb591d4c-f682-433f-b3b2-715470aeb78d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:25.681357 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb591d4c-f682-433f-b3b2-715470aeb78d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:25.681783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb591d4c-f682-433f-b3b2-715470aeb78d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:25.682474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb591d4c-f682-433f-b3b2-715470aeb78d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:25.682923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb591d4c-f682-433f-b3b2-715470aeb78d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:25.683340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb591d4c-f682-433f-b3b2-715470aeb78d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:25.828727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bb591d4c-f682-433f-b3b2-715470aeb78d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:25.837026 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bb591d4c-f682-433f-b3b2-715470aeb78d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.173311 Sep 05 17:05:25.837588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 240/493] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:25 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:26.140401 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2eb5652a-b47b-46ac-919b-94cc5fd4374c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:26.141116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2eb5652a-b47b-46ac-919b-94cc5fd4374c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:26.149697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2eb5652a-b47b-46ac-919b-94cc5fd4374c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:26.150293 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2eb5652a-b47b-46ac-919b-94cc5fd4374c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:26.150819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2eb5652a-b47b-46ac-919b-94cc5fd4374c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:26.151662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2eb5652a-b47b-46ac-919b-94cc5fd4374c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:26.152270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2eb5652a-b47b-46ac-919b-94cc5fd4374c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:26.152780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2eb5652a-b47b-46ac-919b-94cc5fd4374c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:26.472967 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2eb5652a-b47b-46ac-919b-94cc5fd4374c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:26.485906 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2eb5652a-b47b-46ac-919b-94cc5fd4374c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:26.487953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2eb5652a-b47b-46ac-919b-94cc5fd4374c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:26.489809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2eb5652a-b47b-46ac-919b-94cc5fd4374c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1738 microversion: 2.20 time: 0.354124 Sep 05 17:05:26.490701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 254/494] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:26 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1738 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:26.872489 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-42747094-a5a1-4b0c-bb61-f1492b871c51 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:26.873485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-42747094-a5a1-4b0c-bb61-f1492b871c51 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:26.883394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42747094-a5a1-4b0c-bb61-f1492b871c51 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:26.883876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42747094-a5a1-4b0c-bb61-f1492b871c51 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:26.884344 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42747094-a5a1-4b0c-bb61-f1492b871c51 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:26.885026 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42747094-a5a1-4b0c-bb61-f1492b871c51 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:26.885472 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42747094-a5a1-4b0c-bb61-f1492b871c51 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:26.885886 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42747094-a5a1-4b0c-bb61-f1492b871c51 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:27.027284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-42747094-a5a1-4b0c-bb61-f1492b871c51 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:27.035447 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-42747094-a5a1-4b0c-bb61-f1492b871c51 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.169711 Sep 05 17:05:27.036008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 241/495] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:26 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:27.515856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2abfabb2-3ee9-432d-824e-0954897eda2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:27.516471 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2abfabb2-3ee9-432d-824e-0954897eda2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:27.523527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2abfabb2-3ee9-432d-824e-0954897eda2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:27.524022 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2abfabb2-3ee9-432d-824e-0954897eda2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:27.524508 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2abfabb2-3ee9-432d-824e-0954897eda2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:27.525186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2abfabb2-3ee9-432d-824e-0954897eda2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:27.525633 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2abfabb2-3ee9-432d-824e-0954897eda2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:27.526045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2abfabb2-3ee9-432d-824e-0954897eda2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:27.658147 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2abfabb2-3ee9-432d-824e-0954897eda2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:27.666790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2abfabb2-3ee9-432d-824e-0954897eda2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:27.668238 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2abfabb2-3ee9-432d-824e-0954897eda2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:27.669385 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2abfabb2-3ee9-432d-824e-0954897eda2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1738 microversion: 2.20 time: 0.157609 Sep 05 17:05:27.669939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 255/496] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:27 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:28.059721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d8cf2ce9-e775-4bc0-8364-74b16da39108 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:28.060370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d8cf2ce9-e775-4bc0-8364-74b16da39108 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:28.062288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:28.067618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8cf2ce9-e775-4bc0-8364-74b16da39108 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:28.068115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8cf2ce9-e775-4bc0-8364-74b16da39108 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:28.068553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8cf2ce9-e775-4bc0-8364-74b16da39108 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:28.069248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8cf2ce9-e775-4bc0-8364-74b16da39108 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:28.069985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8cf2ce9-e775-4bc0-8364-74b16da39108 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:28.070409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8cf2ce9-e775-4bc0-8364-74b16da39108 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:28.216905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d8cf2ce9-e775-4bc0-8364-74b16da39108 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:28.224724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d8cf2ce9-e775-4bc0-8364-74b16da39108 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.169045 Sep 05 17:05:28.225300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 242/497] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:28 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:28.698563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d3cccd6c-ce5d-432a-b999-a84d23011cac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:28.699377 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d3cccd6c-ce5d-432a-b999-a84d23011cac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:28.709282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3cccd6c-ce5d-432a-b999-a84d23011cac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:28.710054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3cccd6c-ce5d-432a-b999-a84d23011cac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:28.710496 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3cccd6c-ce5d-432a-b999-a84d23011cac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:28.711186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3cccd6c-ce5d-432a-b999-a84d23011cac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:28.711631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3cccd6c-ce5d-432a-b999-a84d23011cac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:28.712058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3cccd6c-ce5d-432a-b999-a84d23011cac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:28.867894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d3cccd6c-ce5d-432a-b999-a84d23011cac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:28.878879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d3cccd6c-ce5d-432a-b999-a84d23011cac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:28.881213 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d3cccd6c-ce5d-432a-b999-a84d23011cac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:28.883374 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d3cccd6c-ce5d-432a-b999-a84d23011cac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1738 microversion: 2.20 time: 0.191319 Sep 05 17:05:28.883930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 256/498] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:28 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:29.253843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bd00da59-42e7-4120-87e8-e628994839a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:29.254868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bd00da59-42e7-4120-87e8-e628994839a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:29.265888 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd00da59-42e7-4120-87e8-e628994839a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:29.266692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd00da59-42e7-4120-87e8-e628994839a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:29.267420 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd00da59-42e7-4120-87e8-e628994839a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:29.268623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd00da59-42e7-4120-87e8-e628994839a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:29.269352 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd00da59-42e7-4120-87e8-e628994839a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:29.270086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd00da59-42e7-4120-87e8-e628994839a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:29.410840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bd00da59-42e7-4120-87e8-e628994839a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:29.423390 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bd00da59-42e7-4120-87e8-e628994839a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.176811 Sep 05 17:05:29.424211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 243/499] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:29 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:29.918049 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3774e8d4-9d05-4b54-8995-9533e2a94e32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:29.918049 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3774e8d4-9d05-4b54-8995-9533e2a94e32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:29.919167 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3774e8d4-9d05-4b54-8995-9533e2a94e32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:29.919664 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3774e8d4-9d05-4b54-8995-9533e2a94e32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:29.920099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3774e8d4-9d05-4b54-8995-9533e2a94e32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:29.920836 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3774e8d4-9d05-4b54-8995-9533e2a94e32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:29.921281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3774e8d4-9d05-4b54-8995-9533e2a94e32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:29.921728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3774e8d4-9d05-4b54-8995-9533e2a94e32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:30.065842 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3774e8d4-9d05-4b54-8995-9533e2a94e32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:30.074942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3774e8d4-9d05-4b54-8995-9533e2a94e32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:30.076418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3774e8d4-9d05-4b54-8995-9533e2a94e32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:30.077575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3774e8d4-9d05-4b54-8995-9533e2a94e32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1720 microversion: 2.20 time: 0.170591 Sep 05 17:05:30.078147 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 257/500] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:29 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:30.447854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-77c1ef34-46a8-41b5-bfc3-840431d622d6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:30.448568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-77c1ef34-46a8-41b5-bfc3-840431d622d6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:30.455663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77c1ef34-46a8-41b5-bfc3-840431d622d6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:30.456175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77c1ef34-46a8-41b5-bfc3-840431d622d6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:30.456614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77c1ef34-46a8-41b5-bfc3-840431d622d6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:30.457584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77c1ef34-46a8-41b5-bfc3-840431d622d6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:30.458041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77c1ef34-46a8-41b5-bfc3-840431d622d6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:30.458465 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77c1ef34-46a8-41b5-bfc3-840431d622d6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:30.596455 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-77c1ef34-46a8-41b5-bfc3-840431d622d6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:30.605703 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-77c1ef34-46a8-41b5-bfc3-840431d622d6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.162787 Sep 05 17:05:30.607276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 244/501] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:30 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:31.109070 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b662345b-d372-4fc7-aa6b-08ef1abc40e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:31.110477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b662345b-d372-4fc7-aa6b-08ef1abc40e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:31.118701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b662345b-d372-4fc7-aa6b-08ef1abc40e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:31.121961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b662345b-d372-4fc7-aa6b-08ef1abc40e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:31.124277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b662345b-d372-4fc7-aa6b-08ef1abc40e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:31.125252 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b662345b-d372-4fc7-aa6b-08ef1abc40e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:31.125840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b662345b-d372-4fc7-aa6b-08ef1abc40e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:31.126381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b662345b-d372-4fc7-aa6b-08ef1abc40e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:31.264414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b662345b-d372-4fc7-aa6b-08ef1abc40e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:31.272874 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b662345b-d372-4fc7-aa6b-08ef1abc40e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:31.274312 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b662345b-d372-4fc7-aa6b-08ef1abc40e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:31.275508 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b662345b-d372-4fc7-aa6b-08ef1abc40e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1720 microversion: 2.20 time: 0.171878 Sep 05 17:05:31.276053 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 258/502] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:31 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:31.629899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bfd6df12-8997-47fb-9bb8-4cbb5162c5aa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:31.630510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bfd6df12-8997-47fb-9bb8-4cbb5162c5aa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:31.637573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfd6df12-8997-47fb-9bb8-4cbb5162c5aa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:31.638092 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfd6df12-8997-47fb-9bb8-4cbb5162c5aa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:31.638527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfd6df12-8997-47fb-9bb8-4cbb5162c5aa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:31.639226 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfd6df12-8997-47fb-9bb8-4cbb5162c5aa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:31.639675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfd6df12-8997-47fb-9bb8-4cbb5162c5aa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:31.640091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfd6df12-8997-47fb-9bb8-4cbb5162c5aa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:31.785358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bfd6df12-8997-47fb-9bb8-4cbb5162c5aa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:31.794361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bfd6df12-8997-47fb-9bb8-4cbb5162c5aa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.168313 Sep 05 17:05:31.794922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 245/503] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:31 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:05:32.320749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1c667d51-03e7-4ef1-ae36-2ae0730ab4e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:32.322190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1c667d51-03e7-4ef1-ae36-2ae0730ab4e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:32.343792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c667d51-03e7-4ef1-ae36-2ae0730ab4e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:32.344743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c667d51-03e7-4ef1-ae36-2ae0730ab4e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:32.345271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c667d51-03e7-4ef1-ae36-2ae0730ab4e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:32.348191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c667d51-03e7-4ef1-ae36-2ae0730ab4e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:32.348772 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c667d51-03e7-4ef1-ae36-2ae0730ab4e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:32.349327 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c667d51-03e7-4ef1-ae36-2ae0730ab4e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:32.512034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1c667d51-03e7-4ef1-ae36-2ae0730ab4e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:32.521363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1c667d51-03e7-4ef1-ae36-2ae0730ab4e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:32.523302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1c667d51-03e7-4ef1-ae36-2ae0730ab4e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:32.524852 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1c667d51-03e7-4ef1-ae36-2ae0730ab4e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1720 microversion: 2.20 time: 0.208504 Sep 05 17:05:32.526666 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 259/504] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:32 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1720 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:32.819334 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5675639b-0cd0-4aba-a33a-cf60c951f5e0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:32.820876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5675639b-0cd0-4aba-a33a-cf60c951f5e0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:32.829912 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5675639b-0cd0-4aba-a33a-cf60c951f5e0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:32.830565 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5675639b-0cd0-4aba-a33a-cf60c951f5e0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:32.831171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5675639b-0cd0-4aba-a33a-cf60c951f5e0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:32.832132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5675639b-0cd0-4aba-a33a-cf60c951f5e0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:32.832910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5675639b-0cd0-4aba-a33a-cf60c951f5e0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:32.833457 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5675639b-0cd0-4aba-a33a-cf60c951f5e0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:33.000386 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5675639b-0cd0-4aba-a33a-cf60c951f5e0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:33.010279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5675639b-0cd0-4aba-a33a-cf60c951f5e0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.196529 Sep 05 17:05:33.011064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 246/505] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:32 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:33.555690 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-af3d91ce-e9d5-4aa3-b05a-d90badfeb130 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:33.556346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-af3d91ce-e9d5-4aa3-b05a-d90badfeb130 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:33.564855 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af3d91ce-e9d5-4aa3-b05a-d90badfeb130 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:33.565309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af3d91ce-e9d5-4aa3-b05a-d90badfeb130 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:33.565841 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af3d91ce-e9d5-4aa3-b05a-d90badfeb130 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:33.566775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af3d91ce-e9d5-4aa3-b05a-d90badfeb130 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:33.567412 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af3d91ce-e9d5-4aa3-b05a-d90badfeb130 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:33.567962 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af3d91ce-e9d5-4aa3-b05a-d90badfeb130 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:33.741651 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-af3d91ce-e9d5-4aa3-b05a-d90badfeb130 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:33.751762 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-af3d91ce-e9d5-4aa3-b05a-d90badfeb130 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:33.753705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-af3d91ce-e9d5-4aa3-b05a-d90badfeb130 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:33.755412 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-af3d91ce-e9d5-4aa3-b05a-d90badfeb130 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1720 microversion: 2.20 time: 0.203448 Sep 05 17:05:33.755629 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 260/506] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:33 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1720 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:34.033919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6556f5ba-a30a-4652-a2c7-f5c7b13f9710 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:34.035270 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6556f5ba-a30a-4652-a2c7-f5c7b13f9710 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:34.043402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6556f5ba-a30a-4652-a2c7-f5c7b13f9710 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:34.044214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6556f5ba-a30a-4652-a2c7-f5c7b13f9710 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:34.044834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6556f5ba-a30a-4652-a2c7-f5c7b13f9710 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:34.046369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6556f5ba-a30a-4652-a2c7-f5c7b13f9710 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:34.047026 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6556f5ba-a30a-4652-a2c7-f5c7b13f9710 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:34.047653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6556f5ba-a30a-4652-a2c7-f5c7b13f9710 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:34.201079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6556f5ba-a30a-4652-a2c7-f5c7b13f9710 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:34.210639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6556f5ba-a30a-4652-a2c7-f5c7b13f9710 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.180829 Sep 05 17:05:34.211670 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 247/507] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:34 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:34.783047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5c41a545-c004-4003-b8ad-a64e6c2da2ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:34.784394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5c41a545-c004-4003-b8ad-a64e6c2da2ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:34.791038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5c41a545-c004-4003-b8ad-a64e6c2da2ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:34.791524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5c41a545-c004-4003-b8ad-a64e6c2da2ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:34.791980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5c41a545-c004-4003-b8ad-a64e6c2da2ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:34.792834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5c41a545-c004-4003-b8ad-a64e6c2da2ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:34.793279 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5c41a545-c004-4003-b8ad-a64e6c2da2ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:34.793698 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5c41a545-c004-4003-b8ad-a64e6c2da2ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:34.936941 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5c41a545-c004-4003-b8ad-a64e6c2da2ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:34.946047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5c41a545-c004-4003-b8ad-a64e6c2da2ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:34.947813 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5c41a545-c004-4003-b8ad-a64e6c2da2ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:34.949082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5c41a545-c004-4003-b8ad-a64e6c2da2ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1720 microversion: 2.20 time: 0.170293 Sep 05 17:05:34.949678 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 261/508] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:34 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 17:05:35.233557 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b11df185-e0dd-4227-901d-ae4d0891e8a7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:35.234922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b11df185-e0dd-4227-901d-ae4d0891e8a7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:35.241736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b11df185-e0dd-4227-901d-ae4d0891e8a7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:35.242872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b11df185-e0dd-4227-901d-ae4d0891e8a7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:35.242872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b11df185-e0dd-4227-901d-ae4d0891e8a7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:35.243599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b11df185-e0dd-4227-901d-ae4d0891e8a7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:35.244466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b11df185-e0dd-4227-901d-ae4d0891e8a7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:35.244951 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b11df185-e0dd-4227-901d-ae4d0891e8a7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:35.419203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b11df185-e0dd-4227-901d-ae4d0891e8a7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:35.427318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b11df185-e0dd-4227-901d-ae4d0891e8a7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1279 microversion: 2.1 time: 0.197648 Sep 05 17:05:35.428013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 248/509] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:35 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1279 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:35.799980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-175907fa-4c24-45c7-9620-150d8e68bc92 req-4afc0b57-1e2e-4f0f-b228-118ee86eda15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97cc15c7-947d-4daf-80e8-8edc37c01e68", "name": "network-vif-unplugged", "status": "completed", "tag": "4a115af6-123d-4baf-bd17-df6792943a2d"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:05:35.813864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-175907fa-4c24-45c7-9620-150d8e68bc92 req-4afc0b57-1e2e-4f0f-b228-118ee86eda15 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:35.814640 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-175907fa-4c24-45c7-9620-150d8e68bc92 req-4afc0b57-1e2e-4f0f-b228-118ee86eda15 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:35.815566 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-175907fa-4c24-45c7-9620-150d8e68bc92 req-4afc0b57-1e2e-4f0f-b228-118ee86eda15 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:35.830422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-175907fa-4c24-45c7-9620-150d8e68bc92 req-4afc0b57-1e2e-4f0f-b228-118ee86eda15 service nova] Creating event network-vif-unplugged:4a115af6-123d-4baf-bd17-df6792943a2d for instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 on hv-cinder-85596 Sep 05 17:05:35.836489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-175907fa-4c24-45c7-9620-150d8e68bc92 req-4afc0b57-1e2e-4f0f-b228-118ee86eda15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041344 Sep 05 17:05:35.837736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 262/510] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:05:35.974432 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0d955ee5-a039-40d4-9486-f5619f1ee764 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:35.974986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0d955ee5-a039-40d4-9486-f5619f1ee764 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:35.986664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d955ee5-a039-40d4-9486-f5619f1ee764 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:35.987451 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d955ee5-a039-40d4-9486-f5619f1ee764 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:35.987879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d955ee5-a039-40d4-9486-f5619f1ee764 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:35.988796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d955ee5-a039-40d4-9486-f5619f1ee764 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:35.989397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d955ee5-a039-40d4-9486-f5619f1ee764 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:35.989958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d955ee5-a039-40d4-9486-f5619f1ee764 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:36.136702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0d955ee5-a039-40d4-9486-f5619f1ee764 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:36.147161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0d955ee5-a039-40d4-9486-f5619f1ee764 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:36.148951 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0d955ee5-a039-40d4-9486-f5619f1ee764 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:36.150506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0d955ee5-a039-40d4-9486-f5619f1ee764 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1720 microversion: 2.20 time: 0.180323 Sep 05 17:05:36.151180 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 249/511] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:35 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:36.451753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-618bf6cf-2f19-4a05-b35f-0d66d44e66cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:36.452495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-618bf6cf-2f19-4a05-b35f-0d66d44e66cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:36.454764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=66 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:36.461202 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-618bf6cf-2f19-4a05-b35f-0d66d44e66cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:36.461696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-618bf6cf-2f19-4a05-b35f-0d66d44e66cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:36.462131 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-618bf6cf-2f19-4a05-b35f-0d66d44e66cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:36.462832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-618bf6cf-2f19-4a05-b35f-0d66d44e66cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:36.463286 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-618bf6cf-2f19-4a05-b35f-0d66d44e66cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:36.463874 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-618bf6cf-2f19-4a05-b35f-0d66d44e66cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:36.653534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-618bf6cf-2f19-4a05-b35f-0d66d44e66cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:36.661814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-618bf6cf-2f19-4a05-b35f-0d66d44e66cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.214355 Sep 05 17:05:36.662392 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 263/512] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:36 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:37.186479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7eae28d2-e43b-4438-be2d-839c9b75f897 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:37.187438 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7eae28d2-e43b-4438-be2d-839c9b75f897 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:37.195251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7eae28d2-e43b-4438-be2d-839c9b75f897 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:37.196063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7eae28d2-e43b-4438-be2d-839c9b75f897 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:37.196799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7eae28d2-e43b-4438-be2d-839c9b75f897 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:37.198425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7eae28d2-e43b-4438-be2d-839c9b75f897 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:37.199156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7eae28d2-e43b-4438-be2d-839c9b75f897 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:37.199659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7eae28d2-e43b-4438-be2d-839c9b75f897 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:37.347592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7eae28d2-e43b-4438-be2d-839c9b75f897 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:37.357277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7eae28d2-e43b-4438-be2d-839c9b75f897 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:37.359060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7eae28d2-e43b-4438-be2d-839c9b75f897 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:37.360770 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7eae28d2-e43b-4438-be2d-839c9b75f897 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1720 microversion: 2.20 time: 0.179324 Sep 05 17:05:37.375376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 250/513] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:37 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:37.686439 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f45240fc-b863-4310-b003-4077f36374eb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:37.688067 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f45240fc-b863-4310-b003-4077f36374eb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:37.695274 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f45240fc-b863-4310-b003-4077f36374eb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:37.695991 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f45240fc-b863-4310-b003-4077f36374eb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:37.696601 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f45240fc-b863-4310-b003-4077f36374eb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:37.697611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f45240fc-b863-4310-b003-4077f36374eb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:37.698164 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f45240fc-b863-4310-b003-4077f36374eb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:37.698696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f45240fc-b863-4310-b003-4077f36374eb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:37.928550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f45240fc-b863-4310-b003-4077f36374eb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:37.948625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f45240fc-b863-4310-b003-4077f36374eb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.265610 Sep 05 17:05:37.953619 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 264/514] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:37 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:38.391863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fe46761b-86ae-4273-994d-2e0d5da211bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:38.393121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fe46761b-86ae-4273-994d-2e0d5da211bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:38.400554 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe46761b-86ae-4273-994d-2e0d5da211bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:38.401263 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe46761b-86ae-4273-994d-2e0d5da211bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:38.401615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe46761b-86ae-4273-994d-2e0d5da211bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:38.402318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe46761b-86ae-4273-994d-2e0d5da211bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:38.402762 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe46761b-86ae-4273-994d-2e0d5da211bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:38.403353 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe46761b-86ae-4273-994d-2e0d5da211bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:38.576186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fe46761b-86ae-4273-994d-2e0d5da211bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:38.593730 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fe46761b-86ae-4273-994d-2e0d5da211bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:38.596434 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fe46761b-86ae-4273-994d-2e0d5da211bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:38.597902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fe46761b-86ae-4273-994d-2e0d5da211bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1723 microversion: 2.20 time: 0.210361 Sep 05 17:05:38.611415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 251/515] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:38 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:38.635686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-089d950b-f9a1-4961-b897-8e8492e48915 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1de1c19-f726-4715-afc0-12c2b2cd1a68"}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:05:38.638318 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-089d950b-f9a1-4961-b897-8e8492e48915 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:38.644613 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-089d950b-f9a1-4961-b897-8e8492e48915 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:38.645590 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-089d950b-f9a1-4961-b897-8e8492e48915 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:38.646176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-089d950b-f9a1-4961-b897-8e8492e48915 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:38.647212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-089d950b-f9a1-4961-b897-8e8492e48915 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:38.647814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-089d950b-f9a1-4961-b897-8e8492e48915 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:38.648405 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-089d950b-f9a1-4961-b897-8e8492e48915 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:38.653101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:38.975470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6478a24f-34cd-48d9-89a2-a0e5e8d78aac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:38.976731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6478a24f-34cd-48d9-89a2-a0e5e8d78aac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:38.985094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6478a24f-34cd-48d9-89a2-a0e5e8d78aac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:38.985768 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6478a24f-34cd-48d9-89a2-a0e5e8d78aac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:38.986296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6478a24f-34cd-48d9-89a2-a0e5e8d78aac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:38.987123 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6478a24f-34cd-48d9-89a2-a0e5e8d78aac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:38.987672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6478a24f-34cd-48d9-89a2-a0e5e8d78aac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:38.988206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6478a24f-34cd-48d9-89a2-a0e5e8d78aac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:39.083006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-089d950b-f9a1-4961-b897-8e8492e48915 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "POST /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.452019 Sep 05 17:05:39.084712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 265/516] 10.222.0.23 () {62 vars in 1364 bytes} [Mon Sep 5 17:05:38 2022] POST /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 188 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:05:39.180721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6478a24f-34cd-48d9-89a2-a0e5e8d78aac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:39.197433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6478a24f-34cd-48d9-89a2-a0e5e8d78aac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.226392 Sep 05 17:05:39.205272 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 252/517] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:38 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:05:39.255343 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8c70f161-d014-486f-a692-1869b06f04af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:05:39.255935 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8c70f161-d014-486f-a692-1869b06f04af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:39.263388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c70f161-d014-486f-a692-1869b06f04af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:39.263896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c70f161-d014-486f-a692-1869b06f04af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:39.264341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c70f161-d014-486f-a692-1869b06f04af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:39.265052 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c70f161-d014-486f-a692-1869b06f04af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:39.265498 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c70f161-d014-486f-a692-1869b06f04af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:39.265909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c70f161-d014-486f-a692-1869b06f04af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:39.318697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8c70f161-d014-486f-a692-1869b06f04af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120733) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 05 17:05:39.443211 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8c70f161-d014-486f-a692-1869b06f04af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "POST /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/action" status: 202 len: 0 microversion: 2.20 time: 0.191950 Sep 05 17:05:39.444010 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 266/518] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Sep 5 17:05:39 2022] POST /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:05:39.456857 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-24800ca0-55ae-49d7-87e3-03811a2124c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:39.457478 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-24800ca0-55ae-49d7-87e3-03811a2124c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:39.477724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24800ca0-55ae-49d7-87e3-03811a2124c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:39.479810 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24800ca0-55ae-49d7-87e3-03811a2124c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:39.480333 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24800ca0-55ae-49d7-87e3-03811a2124c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:39.483853 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24800ca0-55ae-49d7-87e3-03811a2124c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:39.486798 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24800ca0-55ae-49d7-87e3-03811a2124c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:39.486798 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24800ca0-55ae-49d7-87e3-03811a2124c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:39.666201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-24800ca0-55ae-49d7-87e3-03811a2124c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:39.685178 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-24800ca0-55ae-49d7-87e3-03811a2124c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:39.696119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-24800ca0-55ae-49d7-87e3-03811a2124c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:39.697682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-24800ca0-55ae-49d7-87e3-03811a2124c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1749 microversion: 2.20 time: 0.245098 Sep 05 17:05:39.709622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 253/519] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:39 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1749 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:40.227027 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7f33045d-d1a0-4bcd-98f1-9c5df25416f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:40.228741 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7f33045d-d1a0-4bcd-98f1-9c5df25416f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:40.237056 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f33045d-d1a0-4bcd-98f1-9c5df25416f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:40.237824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f33045d-d1a0-4bcd-98f1-9c5df25416f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:40.238620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f33045d-d1a0-4bcd-98f1-9c5df25416f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:40.239572 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f33045d-d1a0-4bcd-98f1-9c5df25416f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:40.240380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f33045d-d1a0-4bcd-98f1-9c5df25416f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:40.241127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f33045d-d1a0-4bcd-98f1-9c5df25416f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:40.489541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7f33045d-d1a0-4bcd-98f1-9c5df25416f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:40.498835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7f33045d-d1a0-4bcd-98f1-9c5df25416f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.276483 Sep 05 17:05:40.499730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 267/520] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:40 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:40.728017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-591401fd-e046-488c-a62e-b3a5e3e95ebb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:40.729841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-591401fd-e046-488c-a62e-b3a5e3e95ebb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:40.738332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-591401fd-e046-488c-a62e-b3a5e3e95ebb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:40.739450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-591401fd-e046-488c-a62e-b3a5e3e95ebb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:40.740107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-591401fd-e046-488c-a62e-b3a5e3e95ebb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:40.741049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-591401fd-e046-488c-a62e-b3a5e3e95ebb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:40.741658 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-591401fd-e046-488c-a62e-b3a5e3e95ebb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:40.742243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-591401fd-e046-488c-a62e-b3a5e3e95ebb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:40.850299 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-983ddfa7-d223-48ac-a4b1-4a3d1b4e245e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:40.851058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-983ddfa7-d223-48ac-a4b1-4a3d1b4e245e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:40.865135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-983ddfa7-d223-48ac-a4b1-4a3d1b4e245e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:40.865657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-983ddfa7-d223-48ac-a4b1-4a3d1b4e245e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:40.866120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-983ddfa7-d223-48ac-a4b1-4a3d1b4e245e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:40.866825 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-983ddfa7-d223-48ac-a4b1-4a3d1b4e245e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:40.867259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-983ddfa7-d223-48ac-a4b1-4a3d1b4e245e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:40.867678 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-983ddfa7-d223-48ac-a4b1-4a3d1b4e245e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:40.936018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-591401fd-e046-488c-a62e-b3a5e3e95ebb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:40.945563 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-591401fd-e046-488c-a62e-b3a5e3e95ebb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:40.948610 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-591401fd-e046-488c-a62e-b3a5e3e95ebb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:40.950092 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-591401fd-e046-488c-a62e-b3a5e3e95ebb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1749 microversion: 2.20 time: 0.227283 Sep 05 17:05:40.951255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 254/521] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:40 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1749 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:41.030845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.objects.instance [None req-983ddfa7-d223-48ac-a4b1-4a3d1b4e245e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lazy-loading 'services' on Instance uuid e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 {{(pid=120733) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:05:41.171887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-983ddfa7-d223-48ac-a4b1-4a3d1b4e245e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92/os-volume_attachments/b106c932-d1ec-44ef-ad9d-c3ace0c19790" status: 202 len: 0 microversion: 2.1 time: 0.325106 Sep 05 17:05:41.172726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 268/522] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Sep 5 17:05:40 2022] DELETE /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92/os-volume_attachments/b106c932-d1ec-44ef-ad9d-c3ace0c19790 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:05:41.522415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c9ea3582-df59-484c-aebd-f099a5da6f2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:41.523066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c9ea3582-df59-484c-aebd-f099a5da6f2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:41.530969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9ea3582-df59-484c-aebd-f099a5da6f2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:41.532100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9ea3582-df59-484c-aebd-f099a5da6f2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:41.532569 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9ea3582-df59-484c-aebd-f099a5da6f2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:41.533498 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9ea3582-df59-484c-aebd-f099a5da6f2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:41.534072 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9ea3582-df59-484c-aebd-f099a5da6f2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:41.534507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9ea3582-df59-484c-aebd-f099a5da6f2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:41.540054 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:41.676814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c9ea3582-df59-484c-aebd-f099a5da6f2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:41.685127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c9ea3582-df59-484c-aebd-f099a5da6f2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.167273 Sep 05 17:05:41.685697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 255/523] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:41 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:41.979382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-807b6a79-cde6-4949-9ac5-9f3d5d8f43b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:41.990096 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-807b6a79-cde6-4949-9ac5-9f3d5d8f43b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:42.005651 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-807b6a79-cde6-4949-9ac5-9f3d5d8f43b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:42.006155 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-807b6a79-cde6-4949-9ac5-9f3d5d8f43b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:42.006592 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-807b6a79-cde6-4949-9ac5-9f3d5d8f43b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:42.007309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-807b6a79-cde6-4949-9ac5-9f3d5d8f43b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:42.007762 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-807b6a79-cde6-4949-9ac5-9f3d5d8f43b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:42.008217 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-807b6a79-cde6-4949-9ac5-9f3d5d8f43b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:42.165361 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-807b6a79-cde6-4949-9ac5-9f3d5d8f43b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:42.174503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-807b6a79-cde6-4949-9ac5-9f3d5d8f43b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:42.176877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-807b6a79-cde6-4949-9ac5-9f3d5d8f43b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:42.178110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-807b6a79-cde6-4949-9ac5-9f3d5d8f43b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1751 microversion: 2.20 time: 0.203910 Sep 05 17:05:42.178665 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 269/524] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:41 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:42.709305 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-942e027a-bfcd-4688-b8ec-7a330da2f0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:42.710060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-942e027a-bfcd-4688-b8ec-7a330da2f0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:42.717583 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-942e027a-bfcd-4688-b8ec-7a330da2f0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:42.718047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-942e027a-bfcd-4688-b8ec-7a330da2f0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:42.718705 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-942e027a-bfcd-4688-b8ec-7a330da2f0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:42.719408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-942e027a-bfcd-4688-b8ec-7a330da2f0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:42.719861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-942e027a-bfcd-4688-b8ec-7a330da2f0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:42.720305 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-942e027a-bfcd-4688-b8ec-7a330da2f0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:42.869920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-942e027a-bfcd-4688-b8ec-7a330da2f0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:42.880047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-942e027a-bfcd-4688-b8ec-7a330da2f0fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.174753 Sep 05 17:05:42.880709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 256/525] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:42 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:43.205462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3c38ae68-8028-4dc2-be4f-4e5d6ab7468d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:43.206987 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3c38ae68-8028-4dc2-be4f-4e5d6ab7468d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:43.213868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c38ae68-8028-4dc2-be4f-4e5d6ab7468d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:43.214776 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c38ae68-8028-4dc2-be4f-4e5d6ab7468d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:43.215388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c38ae68-8028-4dc2-be4f-4e5d6ab7468d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:43.216436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c38ae68-8028-4dc2-be4f-4e5d6ab7468d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:43.216898 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c38ae68-8028-4dc2-be4f-4e5d6ab7468d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:43.217320 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c38ae68-8028-4dc2-be4f-4e5d6ab7468d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:43.370051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3c38ae68-8028-4dc2-be4f-4e5d6ab7468d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:43.394274 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3c38ae68-8028-4dc2-be4f-4e5d6ab7468d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:43.395935 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3c38ae68-8028-4dc2-be4f-4e5d6ab7468d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:43.397250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3c38ae68-8028-4dc2-be4f-4e5d6ab7468d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.195765 Sep 05 17:05:43.397846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 270/526] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:43 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:43.919258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6084c114-0957-4aeb-b87b-2c2a46f91433 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:43.919941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6084c114-0957-4aeb-b87b-2c2a46f91433 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:43.926691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6084c114-0957-4aeb-b87b-2c2a46f91433 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:43.927404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6084c114-0957-4aeb-b87b-2c2a46f91433 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:43.928023 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6084c114-0957-4aeb-b87b-2c2a46f91433 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:43.928910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6084c114-0957-4aeb-b87b-2c2a46f91433 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:43.929520 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6084c114-0957-4aeb-b87b-2c2a46f91433 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:43.930098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6084c114-0957-4aeb-b87b-2c2a46f91433 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:44.072356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6084c114-0957-4aeb-b87b-2c2a46f91433 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:44.081189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6084c114-0957-4aeb-b87b-2c2a46f91433 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.166036 Sep 05 17:05:44.081778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 257/527] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:43 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:44.422672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cb447b43-381c-45a2-b0ea-3596fba058c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:44.423985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cb447b43-381c-45a2-b0ea-3596fba058c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:44.430674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb447b43-381c-45a2-b0ea-3596fba058c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:44.431693 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb447b43-381c-45a2-b0ea-3596fba058c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:44.432413 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb447b43-381c-45a2-b0ea-3596fba058c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:44.433364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb447b43-381c-45a2-b0ea-3596fba058c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:44.434120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb447b43-381c-45a2-b0ea-3596fba058c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:44.434688 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb447b43-381c-45a2-b0ea-3596fba058c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:44.650420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cb447b43-381c-45a2-b0ea-3596fba058c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:44.662818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cb447b43-381c-45a2-b0ea-3596fba058c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:44.665570 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cb447b43-381c-45a2-b0ea-3596fba058c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:44.666737 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cb447b43-381c-45a2-b0ea-3596fba058c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.248682 Sep 05 17:05:44.668471 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 271/528] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:44 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:45.104662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1cb38e9f-669c-435c-812b-7f1eba4bf23b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:45.106241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1cb38e9f-669c-435c-812b-7f1eba4bf23b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:45.112996 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cb38e9f-669c-435c-812b-7f1eba4bf23b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:45.113779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cb38e9f-669c-435c-812b-7f1eba4bf23b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:45.114220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cb38e9f-669c-435c-812b-7f1eba4bf23b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:45.114942 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cb38e9f-669c-435c-812b-7f1eba4bf23b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:45.115406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cb38e9f-669c-435c-812b-7f1eba4bf23b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:45.116052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cb38e9f-669c-435c-812b-7f1eba4bf23b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:45.273886 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1cb38e9f-669c-435c-812b-7f1eba4bf23b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:45.282876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1cb38e9f-669c-435c-812b-7f1eba4bf23b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.182725 Sep 05 17:05:45.284194 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 258/529] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:45 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:45.538805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-83a619dc-fdfc-404d-a5a1-92a79a5cd5c7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:45.539380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-83a619dc-fdfc-404d-a5a1-92a79a5cd5c7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:45.556750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83a619dc-fdfc-404d-a5a1-92a79a5cd5c7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:45.557608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83a619dc-fdfc-404d-a5a1-92a79a5cd5c7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:45.559445 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83a619dc-fdfc-404d-a5a1-92a79a5cd5c7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:45.560495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83a619dc-fdfc-404d-a5a1-92a79a5cd5c7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:45.561859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83a619dc-fdfc-404d-a5a1-92a79a5cd5c7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:45.562642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83a619dc-fdfc-404d-a5a1-92a79a5cd5c7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:45.611195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-83a619dc-fdfc-404d-a5a1-92a79a5cd5c7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Going to try to terminate instance {{(pid=120733) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:05:45.703089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4961db4c-a37b-4dcc-88e6-1b975ea8ecdc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:45.703955 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4961db4c-a37b-4dcc-88e6-1b975ea8ecdc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:45.715213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4961db4c-a37b-4dcc-88e6-1b975ea8ecdc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:45.716340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4961db4c-a37b-4dcc-88e6-1b975ea8ecdc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:45.717289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4961db4c-a37b-4dcc-88e6-1b975ea8ecdc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:45.718847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4961db4c-a37b-4dcc-88e6-1b975ea8ecdc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:45.719780 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4961db4c-a37b-4dcc-88e6-1b975ea8ecdc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:45.720924 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4961db4c-a37b-4dcc-88e6-1b975ea8ecdc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:45.832038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-83a619dc-fdfc-404d-a5a1-92a79a5cd5c7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 204 len: 0 microversion: 2.1 time: 0.296888 Sep 05 17:05:45.833326 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 272/530] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:05:45 2022] DELETE /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:05:45.842253 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ac2f099b-d472-4d9a-8f26-1f8c5e31e0b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:45.843187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ac2f099b-d472-4d9a-8f26-1f8c5e31e0b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:45.849697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac2f099b-d472-4d9a-8f26-1f8c5e31e0b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:45.850236 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac2f099b-d472-4d9a-8f26-1f8c5e31e0b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:45.850835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac2f099b-d472-4d9a-8f26-1f8c5e31e0b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:45.851913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac2f099b-d472-4d9a-8f26-1f8c5e31e0b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:45.852394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac2f099b-d472-4d9a-8f26-1f8c5e31e0b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:45.852814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac2f099b-d472-4d9a-8f26-1f8c5e31e0b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:45.959310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4961db4c-a37b-4dcc-88e6-1b975ea8ecdc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:45.970686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4961db4c-a37b-4dcc-88e6-1b975ea8ecdc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:45.972457 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4961db4c-a37b-4dcc-88e6-1b975ea8ecdc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:45.974035 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4961db4c-a37b-4dcc-88e6-1b975ea8ecdc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.279502 Sep 05 17:05:45.974817 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 259/531] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:45 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:46.023512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ac2f099b-d472-4d9a-8f26-1f8c5e31e0b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:46.031816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ac2f099b-d472-4d9a-8f26-1f8c5e31e0b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1511 microversion: 2.1 time: 0.194281 Sep 05 17:05:46.032686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 273/532] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:45 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1511 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:05:46.307277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-410a4141-faed-470b-86d2-c1d8f2b168be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:46.309136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-410a4141-faed-470b-86d2-c1d8f2b168be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:46.316357 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-410a4141-faed-470b-86d2-c1d8f2b168be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:46.317153 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-410a4141-faed-470b-86d2-c1d8f2b168be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:46.317801 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-410a4141-faed-470b-86d2-c1d8f2b168be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:46.318625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-410a4141-faed-470b-86d2-c1d8f2b168be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:46.319159 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-410a4141-faed-470b-86d2-c1d8f2b168be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:46.319664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-410a4141-faed-470b-86d2-c1d8f2b168be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:46.472703 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-410a4141-faed-470b-86d2-c1d8f2b168be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:46.481877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-410a4141-faed-470b-86d2-c1d8f2b168be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.178553 Sep 05 17:05:46.482468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 260/533] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:46 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:47.006747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3bf665cc-2655-463f-b923-df39357240ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:47.007715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3bf665cc-2655-463f-b923-df39357240ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:47.018829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bf665cc-2655-463f-b923-df39357240ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:47.019701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bf665cc-2655-463f-b923-df39357240ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:47.020533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bf665cc-2655-463f-b923-df39357240ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:47.021811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bf665cc-2655-463f-b923-df39357240ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:47.022746 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bf665cc-2655-463f-b923-df39357240ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:47.023509 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bf665cc-2655-463f-b923-df39357240ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:47.066720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-316cf34c-6579-45dc-8d2d-61dfee86da8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:47.067326 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-316cf34c-6579-45dc-8d2d-61dfee86da8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:47.073742 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-316cf34c-6579-45dc-8d2d-61dfee86da8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:47.074229 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-316cf34c-6579-45dc-8d2d-61dfee86da8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:47.074650 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-316cf34c-6579-45dc-8d2d-61dfee86da8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:47.075343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-316cf34c-6579-45dc-8d2d-61dfee86da8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:47.075784 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-316cf34c-6579-45dc-8d2d-61dfee86da8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:47.076182 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-316cf34c-6579-45dc-8d2d-61dfee86da8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:47.208921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3bf665cc-2655-463f-b923-df39357240ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:47.217997 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3bf665cc-2655-463f-b923-df39357240ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:47.219441 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3bf665cc-2655-463f-b923-df39357240ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:47.220674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3bf665cc-2655-463f-b923-df39357240ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.220576 Sep 05 17:05:47.232175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 274/534] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:46 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:47.235458 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-316cf34c-6579-45dc-8d2d-61dfee86da8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:47.243448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-316cf34c-6579-45dc-8d2d-61dfee86da8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1511 microversion: 2.1 time: 0.180685 Sep 05 17:05:47.244010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 261/535] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:47 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:47.513853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-58a302a3-09ac-4a6d-b7c4-2fe3459489df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:47.514430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-58a302a3-09ac-4a6d-b7c4-2fe3459489df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:47.520459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58a302a3-09ac-4a6d-b7c4-2fe3459489df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:47.520948 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58a302a3-09ac-4a6d-b7c4-2fe3459489df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:47.521376 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58a302a3-09ac-4a6d-b7c4-2fe3459489df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:47.522064 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58a302a3-09ac-4a6d-b7c4-2fe3459489df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:47.522515 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58a302a3-09ac-4a6d-b7c4-2fe3459489df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:47.522929 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58a302a3-09ac-4a6d-b7c4-2fe3459489df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:47.660943 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-58a302a3-09ac-4a6d-b7c4-2fe3459489df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:47.664621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:47.676183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-58a302a3-09ac-4a6d-b7c4-2fe3459489df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.166273 Sep 05 17:05:47.677091 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 275/536] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:47 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:48.248572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-329be483-5ba2-41f2-91b1-c4792e9aef8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:48.249302 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-329be483-5ba2-41f2-91b1-c4792e9aef8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:48.257313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-329be483-5ba2-41f2-91b1-c4792e9aef8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:48.257811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-329be483-5ba2-41f2-91b1-c4792e9aef8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:48.258361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-329be483-5ba2-41f2-91b1-c4792e9aef8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:48.259602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-329be483-5ba2-41f2-91b1-c4792e9aef8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:48.260257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-329be483-5ba2-41f2-91b1-c4792e9aef8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:48.261000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-329be483-5ba2-41f2-91b1-c4792e9aef8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:48.289328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6d908386-c7b0-4e42-bc6e-a6a8d625d709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:48.290458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6d908386-c7b0-4e42-bc6e-a6a8d625d709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:48.299611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6d908386-c7b0-4e42-bc6e-a6a8d625d709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:48.300318 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6d908386-c7b0-4e42-bc6e-a6a8d625d709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:48.300749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6d908386-c7b0-4e42-bc6e-a6a8d625d709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:48.301611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6d908386-c7b0-4e42-bc6e-a6a8d625d709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:48.302242 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6d908386-c7b0-4e42-bc6e-a6a8d625d709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:48.302823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6d908386-c7b0-4e42-bc6e-a6a8d625d709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:48.485225 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-329be483-5ba2-41f2-91b1-c4792e9aef8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:48.500093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-329be483-5ba2-41f2-91b1-c4792e9aef8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:48.506200 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-329be483-5ba2-41f2-91b1-c4792e9aef8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:48.510818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-329be483-5ba2-41f2-91b1-c4792e9aef8c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.268094 Sep 05 17:05:48.513311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 262/537] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:48 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:48.563601 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6d908386-c7b0-4e42-bc6e-a6a8d625d709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:48.576646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6d908386-c7b0-4e42-bc6e-a6a8d625d709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1511 microversion: 2.1 time: 0.310182 Sep 05 17:05:48.584885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 276/538] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:48 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:48.699298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-867522be-8d86-415c-8e5d-8809babd8415 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:48.699972 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-867522be-8d86-415c-8e5d-8809babd8415 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:48.714223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-867522be-8d86-415c-8e5d-8809babd8415 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:48.714859 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-867522be-8d86-415c-8e5d-8809babd8415 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:48.718978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-867522be-8d86-415c-8e5d-8809babd8415 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:48.721291 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-867522be-8d86-415c-8e5d-8809babd8415 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:48.722663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-867522be-8d86-415c-8e5d-8809babd8415 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:48.723753 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-867522be-8d86-415c-8e5d-8809babd8415 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:48.930809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-827c8284-26ca-4aff-91d5-a272e714669a req-aced35ce-8a97-400f-95f9-15b7bb6ea7ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92", "name": "network-vif-deleted", "tag": "387901fa-8d53-44e1-82d9-a131fb4468c2"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:05:48.953992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-827c8284-26ca-4aff-91d5-a272e714669a req-aced35ce-8a97-400f-95f9-15b7bb6ea7ca service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:48.954720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-827c8284-26ca-4aff-91d5-a272e714669a req-aced35ce-8a97-400f-95f9-15b7bb6ea7ca service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:48.955250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-827c8284-26ca-4aff-91d5-a272e714669a req-aced35ce-8a97-400f-95f9-15b7bb6ea7ca service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:48.967900 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-827c8284-26ca-4aff-91d5-a272e714669a req-aced35ce-8a97-400f-95f9-15b7bb6ea7ca service nova] Creating event network-vif-deleted:387901fa-8d53-44e1-82d9-a131fb4468c2 for instance e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 on hv-cinder-85596 Sep 05 17:05:48.975614 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-827c8284-26ca-4aff-91d5-a272e714669a req-aced35ce-8a97-400f-95f9-15b7bb6ea7ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048975 Sep 05 17:05:48.981346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 277/539] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:05:48.987754 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-867522be-8d86-415c-8e5d-8809babd8415 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:48.996227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-867522be-8d86-415c-8e5d-8809babd8415 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.301186 Sep 05 17:05:48.997420 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 263/540] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:48 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:49.550983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-72dd853d-9dec-4f71-89e5-4c1e1659f41c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:49.552919 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-72dd853d-9dec-4f71-89e5-4c1e1659f41c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:49.574014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72dd853d-9dec-4f71-89e5-4c1e1659f41c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:49.576329 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72dd853d-9dec-4f71-89e5-4c1e1659f41c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:49.576775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72dd853d-9dec-4f71-89e5-4c1e1659f41c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:49.581922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72dd853d-9dec-4f71-89e5-4c1e1659f41c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:49.582400 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72dd853d-9dec-4f71-89e5-4c1e1659f41c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:49.582828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72dd853d-9dec-4f71-89e5-4c1e1659f41c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:49.610622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-38eade6f-0353-4ea3-a836-d0b3965bf2f4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:49.611278 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-38eade6f-0353-4ea3-a836-d0b3965bf2f4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:49.633120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38eade6f-0353-4ea3-a836-d0b3965bf2f4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:49.633603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38eade6f-0353-4ea3-a836-d0b3965bf2f4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:49.634028 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38eade6f-0353-4ea3-a836-d0b3965bf2f4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:49.634837 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38eade6f-0353-4ea3-a836-d0b3965bf2f4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:49.635290 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38eade6f-0353-4ea3-a836-d0b3965bf2f4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:49.636013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38eade6f-0353-4ea3-a836-d0b3965bf2f4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:49.780222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-38eade6f-0353-4ea3-a836-d0b3965bf2f4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:49.788782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-38eade6f-0353-4ea3-a836-d0b3965bf2f4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1469 microversion: 2.1 time: 0.182278 Sep 05 17:05:49.789636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 264/541] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:49 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1469 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:49.959463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-72dd853d-9dec-4f71-89e5-4c1e1659f41c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:49.971464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-72dd853d-9dec-4f71-89e5-4c1e1659f41c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:49.973802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-72dd853d-9dec-4f71-89e5-4c1e1659f41c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:49.975218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-72dd853d-9dec-4f71-89e5-4c1e1659f41c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.433675 Sep 05 17:05:49.994237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 278/542] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:49 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:50.025253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a57cab36-cfc1-43b7-8826-9635d6c8152b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:50.026124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a57cab36-cfc1-43b7-8826-9635d6c8152b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:50.033557 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a57cab36-cfc1-43b7-8826-9635d6c8152b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:50.034135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a57cab36-cfc1-43b7-8826-9635d6c8152b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:50.034741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a57cab36-cfc1-43b7-8826-9635d6c8152b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:50.035738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a57cab36-cfc1-43b7-8826-9635d6c8152b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:50.036298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a57cab36-cfc1-43b7-8826-9635d6c8152b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:50.036790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a57cab36-cfc1-43b7-8826-9635d6c8152b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:50.369894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-5aebfe5f-27e0-40be-b66e-877a0b918246 req-02c4e81c-294a-477c-8924-25e7520700db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3820bb09-911a-4093-952b-3487f165122f", "name": "network-vif-plugged", "status": "completed", "tag": "b8d3b025-c734-4edc-9914-e4b7d38eb338"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:05:50.372273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a57cab36-cfc1-43b7-8826-9635d6c8152b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:50.388052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a57cab36-cfc1-43b7-8826-9635d6c8152b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.371037 Sep 05 17:05:50.389394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 265/543] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:50 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:50.390751 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-5aebfe5f-27e0-40be-b66e-877a0b918246 req-02c4e81c-294a-477c-8924-25e7520700db service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:50.391854 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-5aebfe5f-27e0-40be-b66e-877a0b918246 req-02c4e81c-294a-477c-8924-25e7520700db service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:50.392858 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-5aebfe5f-27e0-40be-b66e-877a0b918246 req-02c4e81c-294a-477c-8924-25e7520700db service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:50.405623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-5aebfe5f-27e0-40be-b66e-877a0b918246 req-02c4e81c-294a-477c-8924-25e7520700db service nova] Creating event network-vif-plugged:b8d3b025-c734-4edc-9914-e4b7d38eb338 for instance 3820bb09-911a-4093-952b-3487f165122f on hv-cinder-85596 Sep 05 17:05:50.412354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-5aebfe5f-27e0-40be-b66e-877a0b918246 req-02c4e81c-294a-477c-8924-25e7520700db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055044 Sep 05 17:05:50.417380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 279/544] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:05:50.815919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d436633e-dc97-4ca6-8507-0881e7092430 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:50.816625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d436633e-dc97-4ca6-8507-0881e7092430 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:50.827494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d436633e-dc97-4ca6-8507-0881e7092430 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:50.828077 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d436633e-dc97-4ca6-8507-0881e7092430 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:50.828674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d436633e-dc97-4ca6-8507-0881e7092430 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:50.829766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d436633e-dc97-4ca6-8507-0881e7092430 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:50.830789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d436633e-dc97-4ca6-8507-0881e7092430 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:50.831468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d436633e-dc97-4ca6-8507-0881e7092430 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:50.926872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d436633e-dc97-4ca6-8507-0881e7092430 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:50.939744 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d436633e-dc97-4ca6-8507-0881e7092430 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1469 microversion: 2.1 time: 0.124634 Sep 05 17:05:50.939744 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 266/545] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:50 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1469 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:05:51.012852 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7da5c977-1fdb-4497-bb3b-29f314edf4cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:51.016852 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7da5c977-1fdb-4497-bb3b-29f314edf4cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:51.037960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7da5c977-1fdb-4497-bb3b-29f314edf4cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:51.038934 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7da5c977-1fdb-4497-bb3b-29f314edf4cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:51.040498 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7da5c977-1fdb-4497-bb3b-29f314edf4cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:51.041398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7da5c977-1fdb-4497-bb3b-29f314edf4cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:51.042221 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7da5c977-1fdb-4497-bb3b-29f314edf4cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:51.042915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7da5c977-1fdb-4497-bb3b-29f314edf4cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:51.205898 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7da5c977-1fdb-4497-bb3b-29f314edf4cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:51.219015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7da5c977-1fdb-4497-bb3b-29f314edf4cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:51.221066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7da5c977-1fdb-4497-bb3b-29f314edf4cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:51.222715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7da5c977-1fdb-4497-bb3b-29f314edf4cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.222052 Sep 05 17:05:51.223348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 280/546] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:50 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:51.419254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-485b9a80-d215-420e-8a2b-3eb2fc7a6889 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:51.420574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-485b9a80-d215-420e-8a2b-3eb2fc7a6889 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:51.428029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-485b9a80-d215-420e-8a2b-3eb2fc7a6889 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:51.428742 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-485b9a80-d215-420e-8a2b-3eb2fc7a6889 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:51.429168 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-485b9a80-d215-420e-8a2b-3eb2fc7a6889 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:51.429867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-485b9a80-d215-420e-8a2b-3eb2fc7a6889 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:51.430484 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-485b9a80-d215-420e-8a2b-3eb2fc7a6889 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:51.431079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-485b9a80-d215-420e-8a2b-3eb2fc7a6889 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:51.587625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-485b9a80-d215-420e-8a2b-3eb2fc7a6889 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:51.597717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-485b9a80-d215-420e-8a2b-3eb2fc7a6889 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.184378 Sep 05 17:05:51.598312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 267/547] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:51 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:51.958611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-36ea7b66-cbf6-4571-8dbf-a37387563fc7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:51.959326 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-36ea7b66-cbf6-4571-8dbf-a37387563fc7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:51.965810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36ea7b66-cbf6-4571-8dbf-a37387563fc7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:51.966382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36ea7b66-cbf6-4571-8dbf-a37387563fc7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:51.966885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36ea7b66-cbf6-4571-8dbf-a37387563fc7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:51.967652 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36ea7b66-cbf6-4571-8dbf-a37387563fc7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:51.968223 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36ea7b66-cbf6-4571-8dbf-a37387563fc7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:51.969842 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36ea7b66-cbf6-4571-8dbf-a37387563fc7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:52.037607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-36ea7b66-cbf6-4571-8dbf-a37387563fc7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:52.046265 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-36ea7b66-cbf6-4571-8dbf-a37387563fc7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1469 microversion: 2.1 time: 0.091536 Sep 05 17:05:52.050131 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 281/548] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:51 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1469 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:52.249641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-eda693a4-d914-4556-ab21-06c5958b0501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:52.251027 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-eda693a4-d914-4556-ab21-06c5958b0501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:52.267605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eda693a4-d914-4556-ab21-06c5958b0501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:52.268425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eda693a4-d914-4556-ab21-06c5958b0501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:52.269059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eda693a4-d914-4556-ab21-06c5958b0501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:52.269958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eda693a4-d914-4556-ab21-06c5958b0501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:52.270689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eda693a4-d914-4556-ab21-06c5958b0501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:52.271348 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eda693a4-d914-4556-ab21-06c5958b0501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:52.475380 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eda693a4-d914-4556-ab21-06c5958b0501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:52.491930 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eda693a4-d914-4556-ab21-06c5958b0501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:52.493527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eda693a4-d914-4556-ab21-06c5958b0501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:52.494951 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-eda693a4-d914-4556-ab21-06c5958b0501 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.249555 Sep 05 17:05:52.495636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 268/549] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:52 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:52.638117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5fe670c1-4789-47fe-8837-f32ed575c773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:52.639297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5fe670c1-4789-47fe-8837-f32ed575c773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:52.646632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fe670c1-4789-47fe-8837-f32ed575c773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:52.647615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fe670c1-4789-47fe-8837-f32ed575c773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:52.648359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fe670c1-4789-47fe-8837-f32ed575c773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:52.649441 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fe670c1-4789-47fe-8837-f32ed575c773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:52.650178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fe670c1-4789-47fe-8837-f32ed575c773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:52.650860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fe670c1-4789-47fe-8837-f32ed575c773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:52.822225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5fe670c1-4789-47fe-8837-f32ed575c773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:52.830101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5fe670c1-4789-47fe-8837-f32ed575c773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.196247 Sep 05 17:05:52.830644 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 282/550] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:52 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:53.070733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a1653b80-542a-4da1-a5ac-95dc7d72acb7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:53.071248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a1653b80-542a-4da1-a5ac-95dc7d72acb7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:53.077642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1653b80-542a-4da1-a5ac-95dc7d72acb7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:53.078128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1653b80-542a-4da1-a5ac-95dc7d72acb7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:53.078555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1653b80-542a-4da1-a5ac-95dc7d72acb7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:53.079351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1653b80-542a-4da1-a5ac-95dc7d72acb7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:53.079846 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1653b80-542a-4da1-a5ac-95dc7d72acb7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:53.080315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1653b80-542a-4da1-a5ac-95dc7d72acb7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:53.147967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a1653b80-542a-4da1-a5ac-95dc7d72acb7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:53.155863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a1653b80-542a-4da1-a5ac-95dc7d72acb7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1469 microversion: 2.1 time: 0.089193 Sep 05 17:05:53.156454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 269/551] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:53 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1469 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:53.521191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1652e4f9-ec97-4a67-9b05-eb5128de8b05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:53.522485 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1652e4f9-ec97-4a67-9b05-eb5128de8b05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:53.533466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1652e4f9-ec97-4a67-9b05-eb5128de8b05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:53.534622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1652e4f9-ec97-4a67-9b05-eb5128de8b05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:53.535605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1652e4f9-ec97-4a67-9b05-eb5128de8b05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:53.537162 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1652e4f9-ec97-4a67-9b05-eb5128de8b05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:53.538380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1652e4f9-ec97-4a67-9b05-eb5128de8b05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:53.539328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1652e4f9-ec97-4a67-9b05-eb5128de8b05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:53.703814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1652e4f9-ec97-4a67-9b05-eb5128de8b05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:53.730612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1652e4f9-ec97-4a67-9b05-eb5128de8b05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:53.732341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1652e4f9-ec97-4a67-9b05-eb5128de8b05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:53.733671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1652e4f9-ec97-4a67-9b05-eb5128de8b05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.216488 Sep 05 17:05:53.736711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 283/552] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:53 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:53.857564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-34cb9bd6-a3ae-4f84-9f95-e53e2de361a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:53.858280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-34cb9bd6-a3ae-4f84-9f95-e53e2de361a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:53.874812 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34cb9bd6-a3ae-4f84-9f95-e53e2de361a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:53.875314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34cb9bd6-a3ae-4f84-9f95-e53e2de361a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:53.875957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34cb9bd6-a3ae-4f84-9f95-e53e2de361a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:53.876715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34cb9bd6-a3ae-4f84-9f95-e53e2de361a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:53.877172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34cb9bd6-a3ae-4f84-9f95-e53e2de361a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:53.877590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34cb9bd6-a3ae-4f84-9f95-e53e2de361a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:54.022990 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-34cb9bd6-a3ae-4f84-9f95-e53e2de361a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:54.031424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-34cb9bd6-a3ae-4f84-9f95-e53e2de361a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.177835 Sep 05 17:05:54.031993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 270/553] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:53 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:54.181468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-56127750-9c18-4414-81a9-ce71b38e92f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:54.182221 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-56127750-9c18-4414-81a9-ce71b38e92f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:54.190132 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56127750-9c18-4414-81a9-ce71b38e92f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:54.190854 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56127750-9c18-4414-81a9-ce71b38e92f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:54.191486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56127750-9c18-4414-81a9-ce71b38e92f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:54.192599 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56127750-9c18-4414-81a9-ce71b38e92f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:54.193059 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56127750-9c18-4414-81a9-ce71b38e92f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:54.193497 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56127750-9c18-4414-81a9-ce71b38e92f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:54.255914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-56127750-9c18-4414-81a9-ce71b38e92f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:54.264397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-56127750-9c18-4414-81a9-ce71b38e92f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1469 microversion: 2.1 time: 0.089295 Sep 05 17:05:54.264971 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 284/554] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:54 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1469 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:54.766480 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-55db5a77-86eb-458d-8fe6-11163fbbe552 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:54.767247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-55db5a77-86eb-458d-8fe6-11163fbbe552 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:54.774412 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55db5a77-86eb-458d-8fe6-11163fbbe552 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:54.775097 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55db5a77-86eb-458d-8fe6-11163fbbe552 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:54.775540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55db5a77-86eb-458d-8fe6-11163fbbe552 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:54.776387 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55db5a77-86eb-458d-8fe6-11163fbbe552 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:54.777196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55db5a77-86eb-458d-8fe6-11163fbbe552 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:54.777741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55db5a77-86eb-458d-8fe6-11163fbbe552 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:54.921963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-55db5a77-86eb-458d-8fe6-11163fbbe552 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:54.926376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:54.932941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-55db5a77-86eb-458d-8fe6-11163fbbe552 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:54.934540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-55db5a77-86eb-458d-8fe6-11163fbbe552 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:54.935869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-55db5a77-86eb-458d-8fe6-11163fbbe552 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.176860 Sep 05 17:05:54.936784 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 271/555] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:54 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:55.055165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f044e2b0-f241-4015-82cd-42a35826f4e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:55.055775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f044e2b0-f241-4015-82cd-42a35826f4e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:55.062874 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f044e2b0-f241-4015-82cd-42a35826f4e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:55.063366 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f044e2b0-f241-4015-82cd-42a35826f4e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:55.063799 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f044e2b0-f241-4015-82cd-42a35826f4e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:55.064540 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f044e2b0-f241-4015-82cd-42a35826f4e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:55.064988 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f044e2b0-f241-4015-82cd-42a35826f4e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:55.065427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f044e2b0-f241-4015-82cd-42a35826f4e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:55.206902 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f044e2b0-f241-4015-82cd-42a35826f4e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:55.215008 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f044e2b0-f241-4015-82cd-42a35826f4e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.163835 Sep 05 17:05:55.215694 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 285/556] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:55 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:55.288695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5a9e6ee7-be81-47d0-82ce-96911bf28f3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:55.289507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5a9e6ee7-be81-47d0-82ce-96911bf28f3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:55.296478 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a9e6ee7-be81-47d0-82ce-96911bf28f3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:55.296965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a9e6ee7-be81-47d0-82ce-96911bf28f3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:55.297394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a9e6ee7-be81-47d0-82ce-96911bf28f3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:55.298095 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a9e6ee7-be81-47d0-82ce-96911bf28f3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:55.298544 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a9e6ee7-be81-47d0-82ce-96911bf28f3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:55.298963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a9e6ee7-be81-47d0-82ce-96911bf28f3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:55.363712 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5a9e6ee7-be81-47d0-82ce-96911bf28f3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:55.373510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5a9e6ee7-be81-47d0-82ce-96911bf28f3e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1469 microversion: 2.1 time: 0.089770 Sep 05 17:05:55.384641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 272/557] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:55 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1469 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:55.965347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-28eaff89-a90b-453f-9948-6940f87ea784 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:55.966164 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-28eaff89-a90b-453f-9948-6940f87ea784 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:55.972690 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-28eaff89-a90b-453f-9948-6940f87ea784 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:55.973168 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-28eaff89-a90b-453f-9948-6940f87ea784 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:55.973601 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-28eaff89-a90b-453f-9948-6940f87ea784 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:55.974276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-28eaff89-a90b-453f-9948-6940f87ea784 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:55.974723 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-28eaff89-a90b-453f-9948-6940f87ea784 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:55.975137 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-28eaff89-a90b-453f-9948-6940f87ea784 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:56.113366 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-28eaff89-a90b-453f-9948-6940f87ea784 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:56.126685 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-28eaff89-a90b-453f-9948-6940f87ea784 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:56.128680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-28eaff89-a90b-453f-9948-6940f87ea784 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:56.129809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-28eaff89-a90b-453f-9948-6940f87ea784 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.171111 Sep 05 17:05:56.130365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 286/558] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:55 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:56.242955 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-09c76bef-59d8-4274-989a-86fcbd9cee2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:56.243962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-09c76bef-59d8-4274-989a-86fcbd9cee2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:56.254867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09c76bef-59d8-4274-989a-86fcbd9cee2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:56.255663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09c76bef-59d8-4274-989a-86fcbd9cee2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:56.256432 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09c76bef-59d8-4274-989a-86fcbd9cee2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:56.257560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09c76bef-59d8-4274-989a-86fcbd9cee2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:56.258314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09c76bef-59d8-4274-989a-86fcbd9cee2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:56.259008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09c76bef-59d8-4274-989a-86fcbd9cee2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:56.397138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-09c76bef-59d8-4274-989a-86fcbd9cee2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:56.398039 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0f66147b-c5ae-4e78-8e04-ebba01fdea5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:56.398641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0f66147b-c5ae-4e78-8e04-ebba01fdea5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:56.405253 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f66147b-c5ae-4e78-8e04-ebba01fdea5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:56.405452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-09c76bef-59d8-4274-989a-86fcbd9cee2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.168918 Sep 05 17:05:56.405730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f66147b-c5ae-4e78-8e04-ebba01fdea5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:56.407317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 273/559] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:56 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:56.407469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f66147b-c5ae-4e78-8e04-ebba01fdea5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:56.407469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f66147b-c5ae-4e78-8e04-ebba01fdea5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:56.407469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f66147b-c5ae-4e78-8e04-ebba01fdea5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:56.407741 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f66147b-c5ae-4e78-8e04-ebba01fdea5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:56.468580 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0f66147b-c5ae-4e78-8e04-ebba01fdea5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:56.479734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0f66147b-c5ae-4e78-8e04-ebba01fdea5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1469 microversion: 2.1 time: 0.085252 Sep 05 17:05:56.480642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 287/560] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:56 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1469 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:57.156066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0e337726-b925-4ec4-aa3a-817c08af4c64 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:57.156699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0e337726-b925-4ec4-aa3a-817c08af4c64 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:57.163392 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e337726-b925-4ec4-aa3a-817c08af4c64 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:57.163865 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e337726-b925-4ec4-aa3a-817c08af4c64 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:57.164325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e337726-b925-4ec4-aa3a-817c08af4c64 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:57.165003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e337726-b925-4ec4-aa3a-817c08af4c64 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:57.165448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e337726-b925-4ec4-aa3a-817c08af4c64 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:57.165863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e337726-b925-4ec4-aa3a-817c08af4c64 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:57.302574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0e337726-b925-4ec4-aa3a-817c08af4c64 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:57.312021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0e337726-b925-4ec4-aa3a-817c08af4c64 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:57.313506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0e337726-b925-4ec4-aa3a-817c08af4c64 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:57.314655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0e337726-b925-4ec4-aa3a-817c08af4c64 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.162735 Sep 05 17:05:57.315214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 274/561] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:57 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:57.428388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f97a8957-ce01-4a3e-917b-610c3dc6f7ca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:57.429001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f97a8957-ce01-4a3e-917b-610c3dc6f7ca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:57.436254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97a8957-ce01-4a3e-917b-610c3dc6f7ca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:57.436743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97a8957-ce01-4a3e-917b-610c3dc6f7ca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:57.437175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97a8957-ce01-4a3e-917b-610c3dc6f7ca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:57.437864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97a8957-ce01-4a3e-917b-610c3dc6f7ca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:57.438319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97a8957-ce01-4a3e-917b-610c3dc6f7ca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:57.438735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97a8957-ce01-4a3e-917b-610c3dc6f7ca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:57.509937 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-86d119b1-3729-44f7-8a56-66e09260ae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:57.510643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-86d119b1-3729-44f7-8a56-66e09260ae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:57.516845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86d119b1-3729-44f7-8a56-66e09260ae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:57.517378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86d119b1-3729-44f7-8a56-66e09260ae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:57.517761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86d119b1-3729-44f7-8a56-66e09260ae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:57.518474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86d119b1-3729-44f7-8a56-66e09260ae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:57.518949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86d119b1-3729-44f7-8a56-66e09260ae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:57.519357 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86d119b1-3729-44f7-8a56-66e09260ae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:57.597963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-86d119b1-3729-44f7-8a56-66e09260ae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:57.602415 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f97a8957-ce01-4a3e-917b-610c3dc6f7ca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:57.606100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-86d119b1-3729-44f7-8a56-66e09260ae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1469 microversion: 2.1 time: 0.100112 Sep 05 17:05:57.606756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 275/562] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:57 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1469 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:05:57.610410 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f97a8957-ce01-4a3e-917b-610c3dc6f7ca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.186099 Sep 05 17:05:57.610998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 288/563] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:57 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:58.339506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a5cd82eb-1d10-45e8-9bad-89fa8b4744d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:58.341294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a5cd82eb-1d10-45e8-9bad-89fa8b4744d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:58.343522 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=68 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:05:58.349343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5cd82eb-1d10-45e8-9bad-89fa8b4744d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:58.349879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5cd82eb-1d10-45e8-9bad-89fa8b4744d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:58.350240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5cd82eb-1d10-45e8-9bad-89fa8b4744d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:58.351174 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5cd82eb-1d10-45e8-9bad-89fa8b4744d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:58.351967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5cd82eb-1d10-45e8-9bad-89fa8b4744d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:58.352413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5cd82eb-1d10-45e8-9bad-89fa8b4744d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:58.630610 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c7c86c8b-d925-4bbc-82b8-9ff7fc0a9719 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:58.631352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c7c86c8b-d925-4bbc-82b8-9ff7fc0a9719 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:58.639471 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7c86c8b-d925-4bbc-82b8-9ff7fc0a9719 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:58.640045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7c86c8b-d925-4bbc-82b8-9ff7fc0a9719 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:58.640563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7c86c8b-d925-4bbc-82b8-9ff7fc0a9719 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:58.641380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7c86c8b-d925-4bbc-82b8-9ff7fc0a9719 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:58.641936 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7c86c8b-d925-4bbc-82b8-9ff7fc0a9719 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:58.642454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7c86c8b-d925-4bbc-82b8-9ff7fc0a9719 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:58.717662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a5cd82eb-1d10-45e8-9bad-89fa8b4744d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:58.728192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a5cd82eb-1d10-45e8-9bad-89fa8b4744d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:58.730054 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a5cd82eb-1d10-45e8-9bad-89fa8b4744d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:58.731618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a5cd82eb-1d10-45e8-9bad-89fa8b4744d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.395768 Sep 05 17:05:58.744295 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 276/564] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:58 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:58.744573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c7c86c8b-d925-4bbc-82b8-9ff7fc0a9719 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:58.744694 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cc478a05-fba6-428d-8bf0-67da7e0360f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:58.745067 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c7c86c8b-d925-4bbc-82b8-9ff7fc0a9719 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1469 microversion: 2.1 time: 0.119187 Sep 05 17:05:58.745320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cc478a05-fba6-428d-8bf0-67da7e0360f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:58.746012 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 289/565] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:58 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1469 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:58.755042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc478a05-fba6-428d-8bf0-67da7e0360f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:58.755655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc478a05-fba6-428d-8bf0-67da7e0360f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:58.756212 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc478a05-fba6-428d-8bf0-67da7e0360f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:58.757018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc478a05-fba6-428d-8bf0-67da7e0360f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:58.757575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc478a05-fba6-428d-8bf0-67da7e0360f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:58.758091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc478a05-fba6-428d-8bf0-67da7e0360f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:58.934678 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cc478a05-fba6-428d-8bf0-67da7e0360f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:58.949686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cc478a05-fba6-428d-8bf0-67da7e0360f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.214471 Sep 05 17:05:58.951113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 277/566] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:58 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:59.761775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-bfbbb6aa-8627-44c3-abe2-7a37247234fe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:59.762812 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-bfbbb6aa-8627-44c3-abe2-7a37247234fe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:59.772581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dfa7bfe8-276b-4db6-8789-e658aaaaae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:59.774276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dfa7bfe8-276b-4db6-8789-e658aaaaae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:59.774585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bfbbb6aa-8627-44c3-abe2-7a37247234fe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:59.776015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bfbbb6aa-8627-44c3-abe2-7a37247234fe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:59.777196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bfbbb6aa-8627-44c3-abe2-7a37247234fe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:59.778712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bfbbb6aa-8627-44c3-abe2-7a37247234fe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:59.779403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bfbbb6aa-8627-44c3-abe2-7a37247234fe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:59.780054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bfbbb6aa-8627-44c3-abe2-7a37247234fe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:59.783325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfa7bfe8-276b-4db6-8789-e658aaaaae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:59.783825 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfa7bfe8-276b-4db6-8789-e658aaaaae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:59.784289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfa7bfe8-276b-4db6-8789-e658aaaaae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:59.785002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfa7bfe8-276b-4db6-8789-e658aaaaae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:59.785475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfa7bfe8-276b-4db6-8789-e658aaaaae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:59.785984 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfa7bfe8-276b-4db6-8789-e658aaaaae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:59.883231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dfa7bfe8-276b-4db6-8789-e658aaaaae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:59.892491 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dfa7bfe8-276b-4db6-8789-e658aaaaae63 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1469 microversion: 2.1 time: 0.126448 Sep 05 17:05:59.893102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 278/567] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:59 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1469 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:05:59.965887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bfbbb6aa-8627-44c3-abe2-7a37247234fe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:59.977264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bfbbb6aa-8627-44c3-abe2-7a37247234fe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:59.978701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bfbbb6aa-8627-44c3-abe2-7a37247234fe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:05:59.979195 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3fadec3b-4357-4798-89bf-7dc810fd1bd9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:05:59.979808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3fadec3b-4357-4798-89bf-7dc810fd1bd9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:05:59.979930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-bfbbb6aa-8627-44c3-abe2-7a37247234fe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.225277 Sep 05 17:05:59.980791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 290/568] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:05:59 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:05:59.986604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fadec3b-4357-4798-89bf-7dc810fd1bd9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:59.987104 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fadec3b-4357-4798-89bf-7dc810fd1bd9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:59.987524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fadec3b-4357-4798-89bf-7dc810fd1bd9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:05:59.988239 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fadec3b-4357-4798-89bf-7dc810fd1bd9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:05:59.988695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fadec3b-4357-4798-89bf-7dc810fd1bd9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:05:59.989109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fadec3b-4357-4798-89bf-7dc810fd1bd9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:00.153154 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3fadec3b-4357-4798-89bf-7dc810fd1bd9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:00.161249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3fadec3b-4357-4798-89bf-7dc810fd1bd9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.186188 Sep 05 17:06:00.161862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 279/569] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:05:59 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:06:00.916823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-dc5bf4f8-48f6-45dc-87c6-1eb25482f7ae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:00.917495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-dc5bf4f8-48f6-45dc-87c6-1eb25482f7ae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:00.925287 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dc5bf4f8-48f6-45dc-87c6-1eb25482f7ae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:00.925723 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dc5bf4f8-48f6-45dc-87c6-1eb25482f7ae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:00.926152 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dc5bf4f8-48f6-45dc-87c6-1eb25482f7ae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:00.926841 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dc5bf4f8-48f6-45dc-87c6-1eb25482f7ae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:00.927288 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dc5bf4f8-48f6-45dc-87c6-1eb25482f7ae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:00.927705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dc5bf4f8-48f6-45dc-87c6-1eb25482f7ae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:00.991695 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-dc5bf4f8-48f6-45dc-87c6-1eb25482f7ae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:01.000354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-dc5bf4f8-48f6-45dc-87c6-1eb25482f7ae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1469 microversion: 2.1 time: 0.087434 Sep 05 17:06:01.001218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 291/570] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:00 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1469 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:01.007775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8d343c3e-f8ca-4147-bbb4-68453da1be55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:01.008507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8d343c3e-f8ca-4147-bbb4-68453da1be55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:01.018992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d343c3e-f8ca-4147-bbb4-68453da1be55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:01.019481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d343c3e-f8ca-4147-bbb4-68453da1be55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:01.019914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d343c3e-f8ca-4147-bbb4-68453da1be55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:01.020688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d343c3e-f8ca-4147-bbb4-68453da1be55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:01.021213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d343c3e-f8ca-4147-bbb4-68453da1be55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:01.021727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d343c3e-f8ca-4147-bbb4-68453da1be55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:01.166303 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8d343c3e-f8ca-4147-bbb4-68453da1be55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:01.172749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8d343c3e-f8ca-4147-bbb4-68453da1be55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:01.174201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8d343c3e-f8ca-4147-bbb4-68453da1be55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:01.175389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8d343c3e-f8ca-4147-bbb4-68453da1be55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.171486 Sep 05 17:06:01.175960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 280/571] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:01 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:01.184092 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9a391606-441b-4df4-aab1-83a4d2041400 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:01.184736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9a391606-441b-4df4-aab1-83a4d2041400 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:01.190893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a391606-441b-4df4-aab1-83a4d2041400 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:01.191369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a391606-441b-4df4-aab1-83a4d2041400 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:01.191790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a391606-441b-4df4-aab1-83a4d2041400 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:01.192502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a391606-441b-4df4-aab1-83a4d2041400 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:01.192952 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a391606-441b-4df4-aab1-83a4d2041400 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:01.193455 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a391606-441b-4df4-aab1-83a4d2041400 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:01.332379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9a391606-441b-4df4-aab1-83a4d2041400 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:01.341710 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9a391606-441b-4df4-aab1-83a4d2041400 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.161330 Sep 05 17:06:01.342650 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 292/572] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:01 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:02.027601 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f3467e7b-b9a9-4823-a07f-3191f28d2126 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:02.028833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f3467e7b-b9a9-4823-a07f-3191f28d2126 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:02.037251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3467e7b-b9a9-4823-a07f-3191f28d2126 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:02.037681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3467e7b-b9a9-4823-a07f-3191f28d2126 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:02.038134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3467e7b-b9a9-4823-a07f-3191f28d2126 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:02.038683 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3467e7b-b9a9-4823-a07f-3191f28d2126 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:02.039136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3467e7b-b9a9-4823-a07f-3191f28d2126 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:02.039562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3467e7b-b9a9-4823-a07f-3191f28d2126 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:02.101119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f3467e7b-b9a9-4823-a07f-3191f28d2126 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:02.109392 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f3467e7b-b9a9-4823-a07f-3191f28d2126 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1303 microversion: 2.1 time: 0.088390 Sep 05 17:06:02.110258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 281/573] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:02 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1303 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:02.206495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b41a4d07-db73-4db1-a1c4-062895fe7615 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:02.207771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b41a4d07-db73-4db1-a1c4-062895fe7615 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:02.218149 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b41a4d07-db73-4db1-a1c4-062895fe7615 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:02.218933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b41a4d07-db73-4db1-a1c4-062895fe7615 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:02.219706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b41a4d07-db73-4db1-a1c4-062895fe7615 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:02.220419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b41a4d07-db73-4db1-a1c4-062895fe7615 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:02.220865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b41a4d07-db73-4db1-a1c4-062895fe7615 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:02.221271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b41a4d07-db73-4db1-a1c4-062895fe7615 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:02.360585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b41a4d07-db73-4db1-a1c4-062895fe7615 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:02.364135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:06:02.366976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6cade371-daf0-4e07-9bce-589898846e82 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:02.367593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6cade371-daf0-4e07-9bce-589898846e82 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:02.370917 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b41a4d07-db73-4db1-a1c4-062895fe7615 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:02.372529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b41a4d07-db73-4db1-a1c4-062895fe7615 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:02.373754 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6cade371-daf0-4e07-9bce-589898846e82 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:02.374032 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b41a4d07-db73-4db1-a1c4-062895fe7615 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.175658 Sep 05 17:06:02.374609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6cade371-daf0-4e07-9bce-589898846e82 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:02.384247 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 293/574] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:02 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:02.384951 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6cade371-daf0-4e07-9bce-589898846e82 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:02.385643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6cade371-daf0-4e07-9bce-589898846e82 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:02.386100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6cade371-daf0-4e07-9bce-589898846e82 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:02.386543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6cade371-daf0-4e07-9bce-589898846e82 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:02.525960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6cade371-daf0-4e07-9bce-589898846e82 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:02.538057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6cade371-daf0-4e07-9bce-589898846e82 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.174972 Sep 05 17:06:02.538637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 282/575] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:02 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:06:03.132429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-18e0ff65-44a2-414b-b8e1-999542b4d06f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:03.133306 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-18e0ff65-44a2-414b-b8e1-999542b4d06f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:03.140336 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18e0ff65-44a2-414b-b8e1-999542b4d06f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:03.140916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18e0ff65-44a2-414b-b8e1-999542b4d06f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:03.141348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18e0ff65-44a2-414b-b8e1-999542b4d06f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:03.142035 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18e0ff65-44a2-414b-b8e1-999542b4d06f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:03.142586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18e0ff65-44a2-414b-b8e1-999542b4d06f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:03.142947 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18e0ff65-44a2-414b-b8e1-999542b4d06f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:03.205573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-18e0ff65-44a2-414b-b8e1-999542b4d06f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:03.214910 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-18e0ff65-44a2-414b-b8e1-999542b4d06f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1303 microversion: 2.1 time: 0.086320 Sep 05 17:06:03.215693 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 294/576] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:03 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1303 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:03.402695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-47ca7157-eacd-4116-a4dd-07e2da61a302 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:03.403313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-47ca7157-eacd-4116-a4dd-07e2da61a302 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:03.412723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47ca7157-eacd-4116-a4dd-07e2da61a302 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:03.413210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47ca7157-eacd-4116-a4dd-07e2da61a302 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:03.413641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47ca7157-eacd-4116-a4dd-07e2da61a302 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:03.414370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47ca7157-eacd-4116-a4dd-07e2da61a302 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:03.414921 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47ca7157-eacd-4116-a4dd-07e2da61a302 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:03.415512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47ca7157-eacd-4116-a4dd-07e2da61a302 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:03.553592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-47ca7157-eacd-4116-a4dd-07e2da61a302 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:03.561740 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-caabb578-27aa-4fea-8387-fc851868b2e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:03.562403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-caabb578-27aa-4fea-8387-fc851868b2e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:03.562796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-47ca7157-eacd-4116-a4dd-07e2da61a302 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:03.564297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-47ca7157-eacd-4116-a4dd-07e2da61a302 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:03.565545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-47ca7157-eacd-4116-a4dd-07e2da61a302 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.169365 Sep 05 17:06:03.566107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 283/577] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:03 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:03.569195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-caabb578-27aa-4fea-8387-fc851868b2e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:03.569651 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-caabb578-27aa-4fea-8387-fc851868b2e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:03.570108 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-caabb578-27aa-4fea-8387-fc851868b2e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:03.570821 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-caabb578-27aa-4fea-8387-fc851868b2e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:03.571285 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-caabb578-27aa-4fea-8387-fc851868b2e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:03.571721 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-caabb578-27aa-4fea-8387-fc851868b2e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:03.712594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-caabb578-27aa-4fea-8387-fc851868b2e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:03.724650 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-caabb578-27aa-4fea-8387-fc851868b2e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.166704 Sep 05 17:06:03.725473 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 295/578] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:03 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:06:04.239962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e2da1a42-f5c8-433a-9dbc-e6e3d80fdc6c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:04.240630 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e2da1a42-f5c8-433a-9dbc-e6e3d80fdc6c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:04.247984 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2da1a42-f5c8-433a-9dbc-e6e3d80fdc6c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:04.248617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2da1a42-f5c8-433a-9dbc-e6e3d80fdc6c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:04.249117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2da1a42-f5c8-433a-9dbc-e6e3d80fdc6c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:04.249911 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2da1a42-f5c8-433a-9dbc-e6e3d80fdc6c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:04.250415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2da1a42-f5c8-433a-9dbc-e6e3d80fdc6c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:04.250904 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2da1a42-f5c8-433a-9dbc-e6e3d80fdc6c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:04.287329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2da1a42-f5c8-433a-9dbc-e6e3d80fdc6c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:04.287802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2da1a42-f5c8-433a-9dbc-e6e3d80fdc6c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:04.288256 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2da1a42-f5c8-433a-9dbc-e6e3d80fdc6c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:04.288692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-e2da1a42-f5c8-433a-9dbc-e6e3d80fdc6c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lazy-loading 'fault' on Instance uuid e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:06:04.333018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e2da1a42-f5c8-433a-9dbc-e6e3d80fdc6c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:04.341507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e2da1a42-f5c8-433a-9dbc-e6e3d80fdc6c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1308 microversion: 2.1 time: 0.106329 Sep 05 17:06:04.342238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 284/579] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:04 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:04.591730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4620e9c5-a348-4b29-b58d-6577e6892b4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:04.592432 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4620e9c5-a348-4b29-b58d-6577e6892b4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:04.599195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4620e9c5-a348-4b29-b58d-6577e6892b4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:04.599668 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4620e9c5-a348-4b29-b58d-6577e6892b4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:04.600091 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4620e9c5-a348-4b29-b58d-6577e6892b4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:04.600794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4620e9c5-a348-4b29-b58d-6577e6892b4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:04.601585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4620e9c5-a348-4b29-b58d-6577e6892b4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:04.601998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4620e9c5-a348-4b29-b58d-6577e6892b4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:04.740331 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4620e9c5-a348-4b29-b58d-6577e6892b4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:04.748215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0a8f22ac-694d-4319-a6c4-9d7281e669fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:04.748832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0a8f22ac-694d-4319-a6c4-9d7281e669fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:04.749128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4620e9c5-a348-4b29-b58d-6577e6892b4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:04.750548 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4620e9c5-a348-4b29-b58d-6577e6892b4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:04.751747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4620e9c5-a348-4b29-b58d-6577e6892b4b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.164197 Sep 05 17:06:04.752458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 296/580] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:04 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:04.755927 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a8f22ac-694d-4319-a6c4-9d7281e669fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:04.756388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a8f22ac-694d-4319-a6c4-9d7281e669fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:04.756821 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a8f22ac-694d-4319-a6c4-9d7281e669fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:04.757519 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a8f22ac-694d-4319-a6c4-9d7281e669fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:04.757967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a8f22ac-694d-4319-a6c4-9d7281e669fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:04.758406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a8f22ac-694d-4319-a6c4-9d7281e669fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:04.900469 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0a8f22ac-694d-4319-a6c4-9d7281e669fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:04.912096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0a8f22ac-694d-4319-a6c4-9d7281e669fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1267 microversion: 2.1 time: 0.167927 Sep 05 17:06:04.912881 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 285/581] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:04 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:06:05.368016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c83b4cdf-de9a-4c60-8be7-e280752bc01e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:05.368689 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c83b4cdf-de9a-4c60-8be7-e280752bc01e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:05.375116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c83b4cdf-de9a-4c60-8be7-e280752bc01e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:05.375603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c83b4cdf-de9a-4c60-8be7-e280752bc01e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:05.376064 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c83b4cdf-de9a-4c60-8be7-e280752bc01e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:05.376821 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c83b4cdf-de9a-4c60-8be7-e280752bc01e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:05.377276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c83b4cdf-de9a-4c60-8be7-e280752bc01e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:05.377698 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c83b4cdf-de9a-4c60-8be7-e280752bc01e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:05.409473 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c83b4cdf-de9a-4c60-8be7-e280752bc01e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:05.409922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c83b4cdf-de9a-4c60-8be7-e280752bc01e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:05.410332 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c83b4cdf-de9a-4c60-8be7-e280752bc01e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:05.410774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.objects.instance [None req-c83b4cdf-de9a-4c60-8be7-e280752bc01e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lazy-loading 'fault' on Instance uuid e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 {{(pid=120733) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:06:05.452480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c83b4cdf-de9a-4c60-8be7-e280752bc01e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:05.460793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c83b4cdf-de9a-4c60-8be7-e280752bc01e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 200 len: 1308 microversion: 2.1 time: 0.097374 Sep 05 17:06:05.461376 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 297/582] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:05 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:05.777939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1416a5e2-43a4-486c-ad9c-67fb132f7814 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:05.778545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1416a5e2-43a4-486c-ad9c-67fb132f7814 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:05.786636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1416a5e2-43a4-486c-ad9c-67fb132f7814 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:05.787170 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1416a5e2-43a4-486c-ad9c-67fb132f7814 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:05.787531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1416a5e2-43a4-486c-ad9c-67fb132f7814 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:05.788261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1416a5e2-43a4-486c-ad9c-67fb132f7814 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:05.788702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1416a5e2-43a4-486c-ad9c-67fb132f7814 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:05.789115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1416a5e2-43a4-486c-ad9c-67fb132f7814 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:05.935349 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4374d0ce-6ebf-4ef0-afd4-1368a48f2821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:05.935988 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4374d0ce-6ebf-4ef0-afd4-1368a48f2821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:05.942656 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4374d0ce-6ebf-4ef0-afd4-1368a48f2821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:05.943682 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4374d0ce-6ebf-4ef0-afd4-1368a48f2821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:05.944105 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4374d0ce-6ebf-4ef0-afd4-1368a48f2821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:05.944831 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4374d0ce-6ebf-4ef0-afd4-1368a48f2821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:05.945282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4374d0ce-6ebf-4ef0-afd4-1368a48f2821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:05.945702 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4374d0ce-6ebf-4ef0-afd4-1368a48f2821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:05.968799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1416a5e2-43a4-486c-ad9c-67fb132f7814 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:05.979630 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1416a5e2-43a4-486c-ad9c-67fb132f7814 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:05.981408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1416a5e2-43a4-486c-ad9c-67fb132f7814 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:05.982652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1416a5e2-43a4-486c-ad9c-67fb132f7814 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.208709 Sep 05 17:06:05.983202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 286/583] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:05 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:06.122740 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4374d0ce-6ebf-4ef0-afd4-1368a48f2821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:06.136594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4374d0ce-6ebf-4ef0-afd4-1368a48f2821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1454 microversion: 2.1 time: 0.205211 Sep 05 17:06:06.137186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 298/584] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:05 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1454 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:06:06.159257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3368a2ad-ea29-4ea1-b127-63e85f495330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:06.159864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3368a2ad-ea29-4ea1-b127-63e85f495330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:06.166610 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3368a2ad-ea29-4ea1-b127-63e85f495330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:06.167157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3368a2ad-ea29-4ea1-b127-63e85f495330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:06.167585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3368a2ad-ea29-4ea1-b127-63e85f495330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:06.168679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3368a2ad-ea29-4ea1-b127-63e85f495330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:06.169175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3368a2ad-ea29-4ea1-b127-63e85f495330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:06.169806 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3368a2ad-ea29-4ea1-b127-63e85f495330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:06.331013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3368a2ad-ea29-4ea1-b127-63e85f495330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:06.339066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3368a2ad-ea29-4ea1-b127-63e85f495330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1454 microversion: 2.1 time: 0.183721 Sep 05 17:06:06.339637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 287/585] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:06 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1454 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:06.489307 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-427233d8-6ffe-4bda-9653-59238ba5fee7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:06.491075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-427233d8-6ffe-4bda-9653-59238ba5fee7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:06.496134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:06:06.510629 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-427233d8-6ffe-4bda-9653-59238ba5fee7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:06.511596 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-427233d8-6ffe-4bda-9653-59238ba5fee7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:06.512043 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-427233d8-6ffe-4bda-9653-59238ba5fee7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:06.512858 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-427233d8-6ffe-4bda-9653-59238ba5fee7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:06.513311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-427233d8-6ffe-4bda-9653-59238ba5fee7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:06.515506 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-427233d8-6ffe-4bda-9653-59238ba5fee7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:06.531970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-427233d8-6ffe-4bda-9653-59238ba5fee7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] HTTP exception thrown: Instance e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 could not be found. Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-427233d8-6ffe-4bda-9653-59238ba5fee7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Request method failure captured: Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 HTTP/1.1 Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFiv047nns6uD-wGeK0APYfmPcpVx3CCKv5sjmDl9k5BfSQQcGDjxae1Hoku_TFUfk_UjneJKy_7-R4qOOvWRCP-6IunVIGnx5AiCwIGQh3yw7DnLIg4vTUMAQo_JWV0Oz6P6VXKWsBRDRxjCAKXg6e6hyMEC2vWV5yjpuZDQ8EY9oAs Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: 375cd031a57847ed99991340bf65d3d3 Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-VolumesSnapshotTestJSON-437066400 Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:06:06.533859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:06:06.535516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/375cd031a57847ed99991340bf65d3d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/375cd031a57847ed99991340bf65d3d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/375cd031a57847ed99991340bf65d3d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_375cd031a57847ed99991340bf65d3d3"}]}] Sep 05 17:06:06.535516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-VolumesSnapshotTestJSON-437066400 Sep 05 17:06:06.535516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: 375cd031a57847ed99991340bf65d3d3 Sep 05 17:06:06.535516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-437066400 Sep 05 17:06:06.535516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-VolumesSnapshotTestJSON-437066400-project Sep 05 17:06:06.535516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:06:06.535516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:06:06.535516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: dc83779cc4e54be794873d62e3ac9061 Sep 05 17:06:06.535516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-VolumesSnapshotTestJSON-437066400-project Sep 05 17:06:06.535516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:06:06.535516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 could not be found. Sep 05 17:06:06.535516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': 'e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92'} Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 could not be found. Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:06:06.536912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 could not be found. Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 could not be found. Sep 05 17:06:06.538531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:06:06.543335 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-427233d8-6ffe-4bda-9653-59238ba5fee7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Returning 404 to user: Instance e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:06:06.544242 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-427233d8-6ffe-4bda-9653-59238ba5fee7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92" status: 404 len: 111 microversion: 2.1 time: 0.063112 Sep 05 17:06:06.544817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 299/586] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:06 2022] GET /compute/v2.1/servers/e1a1bf12-bfe6-4c8f-bf23-7f8d30328f92 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:06:07.008847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1a79840e-c596-444a-b02a-ec14cb525ba1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:07.010151 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1a79840e-c596-444a-b02a-ec14cb525ba1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:07.016648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a79840e-c596-444a-b02a-ec14cb525ba1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:07.017199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a79840e-c596-444a-b02a-ec14cb525ba1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:07.017696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a79840e-c596-444a-b02a-ec14cb525ba1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:07.018575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a79840e-c596-444a-b02a-ec14cb525ba1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:07.019095 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a79840e-c596-444a-b02a-ec14cb525ba1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:07.019573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a79840e-c596-444a-b02a-ec14cb525ba1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:07.024375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:06:07.268761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1a79840e-c596-444a-b02a-ec14cb525ba1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:07.282398 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1a79840e-c596-444a-b02a-ec14cb525ba1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:07.284832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1a79840e-c596-444a-b02a-ec14cb525ba1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:07.288358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1a79840e-c596-444a-b02a-ec14cb525ba1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.283736 Sep 05 17:06:07.300291 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 288/587] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:07 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:08.319083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1b9d47c9-baba-4668-bf1f-4fa6e98a9694 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:08.320558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1b9d47c9-baba-4668-bf1f-4fa6e98a9694 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:08.328898 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b9d47c9-baba-4668-bf1f-4fa6e98a9694 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:08.329679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b9d47c9-baba-4668-bf1f-4fa6e98a9694 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:08.330431 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b9d47c9-baba-4668-bf1f-4fa6e98a9694 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:08.331358 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b9d47c9-baba-4668-bf1f-4fa6e98a9694 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:08.332358 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b9d47c9-baba-4668-bf1f-4fa6e98a9694 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:08.333032 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b9d47c9-baba-4668-bf1f-4fa6e98a9694 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:08.582154 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1b9d47c9-baba-4668-bf1f-4fa6e98a9694 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:08.593101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1b9d47c9-baba-4668-bf1f-4fa6e98a9694 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:08.594820 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1b9d47c9-baba-4668-bf1f-4fa6e98a9694 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:08.595985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1b9d47c9-baba-4668-bf1f-4fa6e98a9694 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.284873 Sep 05 17:06:08.599760 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 300/588] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:08 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:08.933258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-5861fa89-3187-44b5-a02a-98003655dffc req-591d8373-8d37-470b-bd0b-670d2560232a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3820bb09-911a-4093-952b-3487f165122f", "tag": "b8d3b025-c734-4edc-9914-e4b7d38eb338"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:06:08.944444 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-5861fa89-3187-44b5-a02a-98003655dffc req-591d8373-8d37-470b-bd0b-670d2560232a service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:08.944840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-5861fa89-3187-44b5-a02a-98003655dffc req-591d8373-8d37-470b-bd0b-670d2560232a service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:08.945261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-5861fa89-3187-44b5-a02a-98003655dffc req-591d8373-8d37-470b-bd0b-670d2560232a service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:08.958350 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-5861fa89-3187-44b5-a02a-98003655dffc req-591d8373-8d37-470b-bd0b-670d2560232a service nova] Creating event network-changed:b8d3b025-c734-4edc-9914-e4b7d38eb338 for instance 3820bb09-911a-4093-952b-3487f165122f on hv-cinder-85596 Sep 05 17:06:08.970049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-5861fa89-3187-44b5-a02a-98003655dffc req-591d8373-8d37-470b-bd0b-670d2560232a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041311 Sep 05 17:06:08.970760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 289/589] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:06:09.621197 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a50e7220-f2de-4667-bcac-cd39302b628f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:09.622488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a50e7220-f2de-4667-bcac-cd39302b628f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:09.631365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a50e7220-f2de-4667-bcac-cd39302b628f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:09.631860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a50e7220-f2de-4667-bcac-cd39302b628f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:09.636869 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a50e7220-f2de-4667-bcac-cd39302b628f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:09.637632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a50e7220-f2de-4667-bcac-cd39302b628f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:09.638128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a50e7220-f2de-4667-bcac-cd39302b628f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:09.638557 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a50e7220-f2de-4667-bcac-cd39302b628f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:09.930407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a50e7220-f2de-4667-bcac-cd39302b628f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:09.946169 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a50e7220-f2de-4667-bcac-cd39302b628f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:09.947612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a50e7220-f2de-4667-bcac-cd39302b628f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:09.948824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a50e7220-f2de-4667-bcac-cd39302b628f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.331599 Sep 05 17:06:09.949389 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 301/590] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:09 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:10.978888 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bd752ca8-233c-4c52-a1ab-4b27dfcbc5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:10.979581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bd752ca8-233c-4c52-a1ab-4b27dfcbc5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:10.986363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd752ca8-233c-4c52-a1ab-4b27dfcbc5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:10.986574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd752ca8-233c-4c52-a1ab-4b27dfcbc5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:10.986969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd752ca8-233c-4c52-a1ab-4b27dfcbc5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:10.987896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd752ca8-233c-4c52-a1ab-4b27dfcbc5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:10.988115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd752ca8-233c-4c52-a1ab-4b27dfcbc5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:10.988576 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd752ca8-233c-4c52-a1ab-4b27dfcbc5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:11.209469 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bd752ca8-233c-4c52-a1ab-4b27dfcbc5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:11.219370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bd752ca8-233c-4c52-a1ab-4b27dfcbc5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:11.220972 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bd752ca8-233c-4c52-a1ab-4b27dfcbc5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:11.222633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bd752ca8-233c-4c52-a1ab-4b27dfcbc5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.249162 Sep 05 17:06:11.244998 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 290/591] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:10 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:12.255173 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d2ff8cff-6d48-4e68-a08e-69f82f6c0fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:12.256268 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d2ff8cff-6d48-4e68-a08e-69f82f6c0fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:12.263732 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2ff8cff-6d48-4e68-a08e-69f82f6c0fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:12.264840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2ff8cff-6d48-4e68-a08e-69f82f6c0fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:12.265543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2ff8cff-6d48-4e68-a08e-69f82f6c0fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:12.266657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2ff8cff-6d48-4e68-a08e-69f82f6c0fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:12.267217 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2ff8cff-6d48-4e68-a08e-69f82f6c0fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:12.267899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2ff8cff-6d48-4e68-a08e-69f82f6c0fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:12.471896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d2ff8cff-6d48-4e68-a08e-69f82f6c0fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:12.484530 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d2ff8cff-6d48-4e68-a08e-69f82f6c0fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:12.486309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d2ff8cff-6d48-4e68-a08e-69f82f6c0fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:12.488861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d2ff8cff-6d48-4e68-a08e-69f82f6c0fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.238880 Sep 05 17:06:12.489799 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 302/592] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:12 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:13.515187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8e764301-3c43-458a-a7bb-32bb058b3c78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:13.515789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8e764301-3c43-458a-a7bb-32bb058b3c78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:13.527649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e764301-3c43-458a-a7bb-32bb058b3c78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:13.528545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e764301-3c43-458a-a7bb-32bb058b3c78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:13.531112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e764301-3c43-458a-a7bb-32bb058b3c78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:13.532079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e764301-3c43-458a-a7bb-32bb058b3c78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:13.532733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e764301-3c43-458a-a7bb-32bb058b3c78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:13.533306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e764301-3c43-458a-a7bb-32bb058b3c78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:13.868811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8e764301-3c43-458a-a7bb-32bb058b3c78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:13.878832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8e764301-3c43-458a-a7bb-32bb058b3c78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:13.880349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8e764301-3c43-458a-a7bb-32bb058b3c78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:13.884950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8e764301-3c43-458a-a7bb-32bb058b3c78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.371941 Sep 05 17:06:13.885791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 291/593] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:13 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:14.913318 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2369a465-fa45-41f5-b4e8-14d78128e24b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:14.915504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2369a465-fa45-41f5-b4e8-14d78128e24b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:14.923638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2369a465-fa45-41f5-b4e8-14d78128e24b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:14.924390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2369a465-fa45-41f5-b4e8-14d78128e24b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:14.924991 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2369a465-fa45-41f5-b4e8-14d78128e24b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:14.925849 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2369a465-fa45-41f5-b4e8-14d78128e24b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:14.926488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2369a465-fa45-41f5-b4e8-14d78128e24b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:14.927057 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2369a465-fa45-41f5-b4e8-14d78128e24b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:15.096964 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2369a465-fa45-41f5-b4e8-14d78128e24b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:15.108676 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2369a465-fa45-41f5-b4e8-14d78128e24b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:15.111598 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2369a465-fa45-41f5-b4e8-14d78128e24b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:15.113555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2369a465-fa45-41f5-b4e8-14d78128e24b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.205259 Sep 05 17:06:15.114830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 303/594] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:14 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:16.143531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-81422205-1ec9-4ee2-87be-60629a00ce9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:16.144128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-81422205-1ec9-4ee2-87be-60629a00ce9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:16.151413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81422205-1ec9-4ee2-87be-60629a00ce9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:16.152200 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81422205-1ec9-4ee2-87be-60629a00ce9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:16.152818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81422205-1ec9-4ee2-87be-60629a00ce9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:16.153816 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81422205-1ec9-4ee2-87be-60629a00ce9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:16.154428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81422205-1ec9-4ee2-87be-60629a00ce9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:16.155007 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81422205-1ec9-4ee2-87be-60629a00ce9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:16.316353 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-81422205-1ec9-4ee2-87be-60629a00ce9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:16.328963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-81422205-1ec9-4ee2-87be-60629a00ce9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:16.330777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-81422205-1ec9-4ee2-87be-60629a00ce9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:16.333693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-81422205-1ec9-4ee2-87be-60629a00ce9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.194215 Sep 05 17:06:16.334388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 292/595] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:16 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 17:06:17.391038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-53314290-9041-4646-9479-63d633f2a67b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:17.392965 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-53314290-9041-4646-9479-63d633f2a67b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:17.400430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53314290-9041-4646-9479-63d633f2a67b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:17.400798 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53314290-9041-4646-9479-63d633f2a67b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:17.401232 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53314290-9041-4646-9479-63d633f2a67b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:17.402138 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53314290-9041-4646-9479-63d633f2a67b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:17.402592 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53314290-9041-4646-9479-63d633f2a67b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:17.403010 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53314290-9041-4646-9479-63d633f2a67b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:17.567569 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-53314290-9041-4646-9479-63d633f2a67b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:17.577128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-53314290-9041-4646-9479-63d633f2a67b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:17.578681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-53314290-9041-4646-9479-63d633f2a67b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:17.579968 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-53314290-9041-4646-9479-63d633f2a67b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.224859 Sep 05 17:06:17.580645 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 304/596] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:17 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 17:06:18.609732 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1ca320ad-da78-46c5-8574-3f268f2d7b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:18.611082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1ca320ad-da78-46c5-8574-3f268f2d7b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:18.639513 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ca320ad-da78-46c5-8574-3f268f2d7b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:18.640040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ca320ad-da78-46c5-8574-3f268f2d7b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:18.640726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ca320ad-da78-46c5-8574-3f268f2d7b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:18.641465 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ca320ad-da78-46c5-8574-3f268f2d7b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:18.641913 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ca320ad-da78-46c5-8574-3f268f2d7b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:18.642345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ca320ad-da78-46c5-8574-3f268f2d7b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:18.864483 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1710499575", "imageRef": "c1a4f3d3-4d68-489a-a57b-bae7854beb29", "flavorRef": "452", "networks": [{"uuid": "e11c3f3f-a1e3-40cc-b5a2-e53e07acc40b"}]}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:06:18.890630 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1ca320ad-da78-46c5-8574-3f268f2d7b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:18.903747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1ca320ad-da78-46c5-8574-3f268f2d7b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:18.905224 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1ca320ad-da78-46c5-8574-3f268f2d7b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:18.906462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1ca320ad-da78-46c5-8574-3f268f2d7b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.300740 Sep 05 17:06:18.907368 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 293/597] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:18 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:18.969491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.network.neutron [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] validate_networks() for [('e11c3f3f-a1e3-40cc-b5a2-e53e07acc40b', None, None, None, None, None)] {{(pid=120733) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:06:19.409483 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Flavor limits 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:06:19.409905 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Image limits 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:06:19.410369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Flavor pref 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:06:19.410824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Image pref 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:06:19.411398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:06:19.425174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:19.425649 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:19.426738 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:19.427612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:19.428071 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:19.428514 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:19.457019 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Getting quotas for project 375cd031a57847ed99991340bf65d3d3. Resources: {'ram', 'cores', 'instances'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:06:19.462681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Getting quotas for user dc83779cc4e54be794873d62e3ac9061 and project 375cd031a57847ed99991340bf65d3d3. Resources: {'ram', 'cores', 'instances'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:06:19.477296 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Going to run 1 instances... {{(pid=120733) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:06:19.480180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a4f3d3-4d68-489a-a57b-bae7854beb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120733) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:06:19.550574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6f9e3316-9823-4edf-ad2b-004859460c6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690938 Sep 05 17:06:19.562117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 305/598] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:06:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 05 17:06:19.567215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-eec63f0f-2dfd-4343-ae44-0d2f36ae3c77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:19.568242 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-eec63f0f-2dfd-4343-ae44-0d2f36ae3c77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:19.658382 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eec63f0f-2dfd-4343-ae44-0d2f36ae3c77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:19.674113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-eec63f0f-2dfd-4343-ae44-0d2f36ae3c77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1219 microversion: 2.1 time: 0.110930 Sep 05 17:06:19.674835 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 294/599] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:19 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:06:19.933442 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-bca173e7-8c19-4bc7-b228-62481a4e1ad5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:19.935050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-bca173e7-8c19-4bc7-b228-62481a4e1ad5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:19.943728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bca173e7-8c19-4bc7-b228-62481a4e1ad5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:19.951360 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bca173e7-8c19-4bc7-b228-62481a4e1ad5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:19.952093 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bca173e7-8c19-4bc7-b228-62481a4e1ad5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:19.953036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bca173e7-8c19-4bc7-b228-62481a4e1ad5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:19.953644 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bca173e7-8c19-4bc7-b228-62481a4e1ad5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:19.954218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bca173e7-8c19-4bc7-b228-62481a4e1ad5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:20.246722 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bca173e7-8c19-4bc7-b228-62481a4e1ad5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:20.266131 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bca173e7-8c19-4bc7-b228-62481a4e1ad5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:20.271089 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bca173e7-8c19-4bc7-b228-62481a4e1ad5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:20.272899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-bca173e7-8c19-4bc7-b228-62481a4e1ad5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.344330 Sep 05 17:06:20.274004 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 306/600] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:19 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:20.339245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-e4974a98-519e-4957-99f0-b72324997f57 req-38f6f5d5-4b2d-47d9-aed8-ce9a92589a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97cc15c7-947d-4daf-80e8-8edc37c01e68", "name": "network-vif-plugged", "status": "completed", "tag": "4a115af6-123d-4baf-bd17-df6792943a2d"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:06:20.357999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-e4974a98-519e-4957-99f0-b72324997f57 req-38f6f5d5-4b2d-47d9-aed8-ce9a92589a15 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:20.359751 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-e4974a98-519e-4957-99f0-b72324997f57 req-38f6f5d5-4b2d-47d9-aed8-ce9a92589a15 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:20.363420 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-e4974a98-519e-4957-99f0-b72324997f57 req-38f6f5d5-4b2d-47d9-aed8-ce9a92589a15 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:20.393610 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-e4974a98-519e-4957-99f0-b72324997f57 req-38f6f5d5-4b2d-47d9-aed8-ce9a92589a15 service nova] Creating event network-vif-plugged:4a115af6-123d-4baf-bd17-df6792943a2d for instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 on hv-cinder-85596 Sep 05 17:06:20.406962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-e4974a98-519e-4957-99f0-b72324997f57 req-38f6f5d5-4b2d-47d9-aed8-ce9a92589a15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071881 Sep 05 17:06:20.412190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 295/601] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:06:20.700629 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9cc669bc-7da9-4a4e-a444-9d41885248e2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:20.701617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9cc669bc-7da9-4a4e-a444-9d41885248e2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:20.717287 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9cc669bc-7da9-4a4e-a444-9d41885248e2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:20.718153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9cc669bc-7da9-4a4e-a444-9d41885248e2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:20.718826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9cc669bc-7da9-4a4e-a444-9d41885248e2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:20.719804 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9cc669bc-7da9-4a4e-a444-9d41885248e2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:20.720522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9cc669bc-7da9-4a4e-a444-9d41885248e2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:20.721166 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9cc669bc-7da9-4a4e-a444-9d41885248e2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:20.804287 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9cc669bc-7da9-4a4e-a444-9d41885248e2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:20.818942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9cc669bc-7da9-4a4e-a444-9d41885248e2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1271 microversion: 2.1 time: 0.122022 Sep 05 17:06:20.819755 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 307/602] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:20 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:21.301711 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5504311b-eb5d-4dbb-8a35-d18241f70a96 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:21.303186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5504311b-eb5d-4dbb-8a35-d18241f70a96 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:21.314341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5504311b-eb5d-4dbb-8a35-d18241f70a96 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:21.314999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5504311b-eb5d-4dbb-8a35-d18241f70a96 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:21.315607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5504311b-eb5d-4dbb-8a35-d18241f70a96 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:21.316341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5504311b-eb5d-4dbb-8a35-d18241f70a96 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:21.316971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5504311b-eb5d-4dbb-8a35-d18241f70a96 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:21.317534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5504311b-eb5d-4dbb-8a35-d18241f70a96 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:21.480220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5504311b-eb5d-4dbb-8a35-d18241f70a96 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:21.494495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5504311b-eb5d-4dbb-8a35-d18241f70a96 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:21.496756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5504311b-eb5d-4dbb-8a35-d18241f70a96 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:21.498184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5504311b-eb5d-4dbb-8a35-d18241f70a96 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.201879 Sep 05 17:06:21.499146 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 296/603] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:21 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:21.844344 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7b59e8c8-6992-467a-99f4-c6a1613c06ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:21.845715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7b59e8c8-6992-467a-99f4-c6a1613c06ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:21.858809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b59e8c8-6992-467a-99f4-c6a1613c06ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:21.859392 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b59e8c8-6992-467a-99f4-c6a1613c06ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:21.860238 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b59e8c8-6992-467a-99f4-c6a1613c06ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:21.861425 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b59e8c8-6992-467a-99f4-c6a1613c06ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:21.862249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b59e8c8-6992-467a-99f4-c6a1613c06ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:21.862887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b59e8c8-6992-467a-99f4-c6a1613c06ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:21.935047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7b59e8c8-6992-467a-99f4-c6a1613c06ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:21.945146 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7b59e8c8-6992-467a-99f4-c6a1613c06ec tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1271 microversion: 2.1 time: 0.106101 Sep 05 17:06:21.945995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 308/604] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:21 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1271 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:22.526996 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2a144f3a-5b77-4175-93c9-3f881749b59f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:22.528581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2a144f3a-5b77-4175-93c9-3f881749b59f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:22.535518 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a144f3a-5b77-4175-93c9-3f881749b59f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:22.536348 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a144f3a-5b77-4175-93c9-3f881749b59f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:22.536979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a144f3a-5b77-4175-93c9-3f881749b59f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:22.538545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a144f3a-5b77-4175-93c9-3f881749b59f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:22.539223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a144f3a-5b77-4175-93c9-3f881749b59f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:22.542514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a144f3a-5b77-4175-93c9-3f881749b59f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:22.702502 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2a144f3a-5b77-4175-93c9-3f881749b59f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:22.712347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2a144f3a-5b77-4175-93c9-3f881749b59f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:22.714059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2a144f3a-5b77-4175-93c9-3f881749b59f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:22.715342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2a144f3a-5b77-4175-93c9-3f881749b59f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.195292 Sep 05 17:06:22.716181 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 297/605] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:22 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:22.970985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b096e6f8-eb40-47ec-a16b-65ebe5b13c80 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:22.972221 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b096e6f8-eb40-47ec-a16b-65ebe5b13c80 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:22.980776 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b096e6f8-eb40-47ec-a16b-65ebe5b13c80 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:22.981499 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b096e6f8-eb40-47ec-a16b-65ebe5b13c80 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:22.982173 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b096e6f8-eb40-47ec-a16b-65ebe5b13c80 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:22.982954 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b096e6f8-eb40-47ec-a16b-65ebe5b13c80 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:22.983411 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b096e6f8-eb40-47ec-a16b-65ebe5b13c80 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:22.983831 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b096e6f8-eb40-47ec-a16b-65ebe5b13c80 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:23.059453 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b096e6f8-eb40-47ec-a16b-65ebe5b13c80 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:23.077467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b096e6f8-eb40-47ec-a16b-65ebe5b13c80 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1279 microversion: 2.1 time: 0.108001 Sep 05 17:06:23.079726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 309/606] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:22 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1279 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:23.743322 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c9cdd245-1fe6-4ddd-99a3-07ae09f7ab54 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:23.744015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c9cdd245-1fe6-4ddd-99a3-07ae09f7ab54 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:23.751528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9cdd245-1fe6-4ddd-99a3-07ae09f7ab54 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:23.752016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9cdd245-1fe6-4ddd-99a3-07ae09f7ab54 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:23.753000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9cdd245-1fe6-4ddd-99a3-07ae09f7ab54 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:23.764762 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9cdd245-1fe6-4ddd-99a3-07ae09f7ab54 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:23.765465 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9cdd245-1fe6-4ddd-99a3-07ae09f7ab54 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:23.766070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9cdd245-1fe6-4ddd-99a3-07ae09f7ab54 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:24.103249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c59f827a-7849-4e78-ba12-ec1734d65fb8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:24.104032 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c59f827a-7849-4e78-ba12-ec1734d65fb8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:24.116126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c59f827a-7849-4e78-ba12-ec1734d65fb8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:24.116574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c59f827a-7849-4e78-ba12-ec1734d65fb8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:24.117006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c59f827a-7849-4e78-ba12-ec1734d65fb8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:24.117788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c59f827a-7849-4e78-ba12-ec1734d65fb8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:24.118258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c59f827a-7849-4e78-ba12-ec1734d65fb8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:24.120674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c59f827a-7849-4e78-ba12-ec1734d65fb8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:24.223227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c9cdd245-1fe6-4ddd-99a3-07ae09f7ab54 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:24.234813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c9cdd245-1fe6-4ddd-99a3-07ae09f7ab54 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:24.236365 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c9cdd245-1fe6-4ddd-99a3-07ae09f7ab54 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:24.251937 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c9cdd245-1fe6-4ddd-99a3-07ae09f7ab54 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1807 microversion: 2.20 time: 0.513463 Sep 05 17:06:24.252891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 298/607] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:23 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1807 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:24.417435 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c59f827a-7849-4e78-ba12-ec1734d65fb8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:24.429033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c59f827a-7849-4e78-ba12-ec1734d65fb8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.330299 Sep 05 17:06:24.445836 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 310/608] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:24 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:06:24.974377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-c2b52f3d-33d2-4b6d-ab48-1c57090dfdcb req-ede5a98e-c63e-41d8-8cc0-cdfdf1d6a3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba4a1fa-a126-4e6b-9ac4-32290e275435", "tag": "cb173271-65d0-4643-8208-fb9a3bbbf346"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:06:24.987348 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-c2b52f3d-33d2-4b6d-ab48-1c57090dfdcb req-ede5a98e-c63e-41d8-8cc0-cdfdf1d6a3c0 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:24.988069 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-c2b52f3d-33d2-4b6d-ab48-1c57090dfdcb req-ede5a98e-c63e-41d8-8cc0-cdfdf1d6a3c0 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:24.989092 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-c2b52f3d-33d2-4b6d-ab48-1c57090dfdcb req-ede5a98e-c63e-41d8-8cc0-cdfdf1d6a3c0 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:25.001629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-c2b52f3d-33d2-4b6d-ab48-1c57090dfdcb req-ede5a98e-c63e-41d8-8cc0-cdfdf1d6a3c0 service nova] Creating event network-changed:cb173271-65d0-4643-8208-fb9a3bbbf346 for instance cba4a1fa-a126-4e6b-9ac4-32290e275435 on hv-cinder-85596 Sep 05 17:06:25.007391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-c2b52f3d-33d2-4b6d-ab48-1c57090dfdcb req-ede5a98e-c63e-41d8-8cc0-cdfdf1d6a3c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036851 Sep 05 17:06:25.008268 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 299/609] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:06:25.277779 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-aefa9011-e703-4067-8c2c-57c4521e102c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:25.279261 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-aefa9011-e703-4067-8c2c-57c4521e102c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:25.286960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aefa9011-e703-4067-8c2c-57c4521e102c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:25.287817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aefa9011-e703-4067-8c2c-57c4521e102c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:25.288357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aefa9011-e703-4067-8c2c-57c4521e102c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:25.289477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aefa9011-e703-4067-8c2c-57c4521e102c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:25.290123 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aefa9011-e703-4067-8c2c-57c4521e102c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:25.290743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aefa9011-e703-4067-8c2c-57c4521e102c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:25.313034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:06:25.448358 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-aefa9011-e703-4067-8c2c-57c4521e102c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:25.454571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-20cbe1ff-572f-4fbd-8554-a4e94b695afe tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:25.455540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-20cbe1ff-572f-4fbd-8554-a4e94b695afe tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:25.459423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-aefa9011-e703-4067-8c2c-57c4521e102c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:25.461208 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-aefa9011-e703-4067-8c2c-57c4521e102c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:25.462628 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-aefa9011-e703-4067-8c2c-57c4521e102c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1794 microversion: 2.20 time: 0.188837 Sep 05 17:06:25.463865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 311/610] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:06:25 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1794 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:06:25.500566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20cbe1ff-572f-4fbd-8554-a4e94b695afe tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:25.501406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20cbe1ff-572f-4fbd-8554-a4e94b695afe tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:25.502019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20cbe1ff-572f-4fbd-8554-a4e94b695afe tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:25.502941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20cbe1ff-572f-4fbd-8554-a4e94b695afe tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:25.503395 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20cbe1ff-572f-4fbd-8554-a4e94b695afe tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:25.503993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20cbe1ff-572f-4fbd-8554-a4e94b695afe tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:25.657215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-20cbe1ff-572f-4fbd-8554-a4e94b695afe tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:25.668018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-20cbe1ff-572f-4fbd-8554-a4e94b695afe tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.217940 Sep 05 17:06:25.680548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 300/611] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:25 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:06:26.693961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c4bc61f3-b14d-4078-8978-066a19f72de3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:26.694570 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c4bc61f3-b14d-4078-8978-066a19f72de3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:26.701348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4bc61f3-b14d-4078-8978-066a19f72de3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:26.701841 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4bc61f3-b14d-4078-8978-066a19f72de3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:26.702265 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4bc61f3-b14d-4078-8978-066a19f72de3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:26.702943 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4bc61f3-b14d-4078-8978-066a19f72de3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:26.703673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4bc61f3-b14d-4078-8978-066a19f72de3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:26.704089 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4bc61f3-b14d-4078-8978-066a19f72de3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:26.846492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c4bc61f3-b14d-4078-8978-066a19f72de3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:26.855447 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c4bc61f3-b14d-4078-8978-066a19f72de3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.165744 Sep 05 17:06:26.856923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 312/612] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:26 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:27.304861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cf07010c-c825-4a54-83c5-91a28b268308 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Action: 'create', calling method: .version_select at 0x7f1d3afb3a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-728167551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwiQQhTBJuzqqdqMSrp9ofefxYM2dkJ+2/m8UJGRYI33YNhWoIIXDCQPei7JiOcR0r0njJDDM09tljDwWoCP1gZ0oqxUu96D10gxTvwaEepVNclFk4uiLFitTe2MeeADQ=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:06:27.321403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-cf07010c-c825-4a54-83c5-91a28b268308 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Getting quotas for project 0b2e9de2e0a64e67beb01dc673c653e5. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:06:27.325282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-cf07010c-c825-4a54-83c5-91a28b268308 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Getting quotas for user c8b8aa2ae43a4d89ad579a5fdd87d564 and project 0b2e9de2e0a64e67beb01dc673c653e5. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:06:27.351021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cf07010c-c825-4a54-83c5-91a28b268308 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050050 Sep 05 17:06:27.351970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 301/613] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Sep 5 17:06:27 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:06:27.403380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-587056137", "imageRef": "8db99fd8-d23a-42d8-937b-2ea1ec4c5c2f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-728167551", "networks": [{"uuid": "14095fa6-e1ac-4a6c-b5f1-65acc4f1ca3c"}]}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:06:27.459693 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.network.neutron [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] validate_networks() for [('14095fa6-e1ac-4a6c-b5f1-65acc4f1ca3c', None, None, None, None, None)] {{(pid=120733) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:06:27.852522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Flavor limits 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:06:27.853369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Image limits 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:06:27.853867 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Flavor pref 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:06:27.854487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Image pref 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:06:27.855093 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:06:27.866171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:27.866654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:27.867088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:27.867836 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:27.868323 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:27.868743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:27.878867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-03ee8cb4-11a8-4057-9970-2811e74dc714 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:27.879462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-03ee8cb4-11a8-4057-9970-2811e74dc714 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:27.885699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03ee8cb4-11a8-4057-9970-2811e74dc714 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:27.886176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03ee8cb4-11a8-4057-9970-2811e74dc714 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:27.886321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Getting quotas for project 0b2e9de2e0a64e67beb01dc673c653e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:06:27.886599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03ee8cb4-11a8-4057-9970-2811e74dc714 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:27.887282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03ee8cb4-11a8-4057-9970-2811e74dc714 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:27.887729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03ee8cb4-11a8-4057-9970-2811e74dc714 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:27.888215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03ee8cb4-11a8-4057-9970-2811e74dc714 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:27.891276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Getting quotas for user c8b8aa2ae43a4d89ad579a5fdd87d564 and project 0b2e9de2e0a64e67beb01dc673c653e5. Resources: {'ram', 'cores', 'instances'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:06:27.902555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Going to run 1 instances... {{(pid=120733) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:06:27.904680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8db99fd8-d23a-42d8-937b-2ea1ec4c5c2f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120733) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:06:27.955984 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-02d56acf-2a35-4fc0-9c5f-f4327a026063 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556453 Sep 05 17:06:27.956916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 313/614] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:06:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 17:06:27.967884 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8a541611-9a4b-4888-a8f2-26e6227c96e4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:27.968527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8a541611-9a4b-4888-a8f2-26e6227c96e4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:28.034147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-03ee8cb4-11a8-4057-9970-2811e74dc714 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:28.043022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-03ee8cb4-11a8-4057-9970-2811e74dc714 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.167991 Sep 05 17:06:28.051217 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 302/615] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:27 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:28.194991 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8a541611-9a4b-4888-a8f2-26e6227c96e4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:28.201838 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8a541611-9a4b-4888-a8f2-26e6227c96e4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1257 microversion: 2.1 time: 0.237719 Sep 05 17:06:28.202406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 314/616] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:27 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1257 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:06:29.065791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f56573e9-9068-4dd6-849e-531c6c8aafa6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:29.066375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f56573e9-9068-4dd6-849e-531c6c8aafa6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:29.069378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:06:29.075818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f56573e9-9068-4dd6-849e-531c6c8aafa6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:29.076389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f56573e9-9068-4dd6-849e-531c6c8aafa6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:29.076812 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f56573e9-9068-4dd6-849e-531c6c8aafa6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:29.077712 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f56573e9-9068-4dd6-849e-531c6c8aafa6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:29.078160 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f56573e9-9068-4dd6-849e-531c6c8aafa6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:29.078573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f56573e9-9068-4dd6-849e-531c6c8aafa6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:29.226016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f97020cb-755e-4451-8f28-28ffc84980d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:29.227708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f97020cb-755e-4451-8f28-28ffc84980d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:29.234829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97020cb-755e-4451-8f28-28ffc84980d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:29.235653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97020cb-755e-4451-8f28-28ffc84980d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:29.236083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97020cb-755e-4451-8f28-28ffc84980d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:29.236822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97020cb-755e-4451-8f28-28ffc84980d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:29.237327 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97020cb-755e-4451-8f28-28ffc84980d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:29.237748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97020cb-755e-4451-8f28-28ffc84980d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:29.288449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f56573e9-9068-4dd6-849e-531c6c8aafa6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:29.297269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f56573e9-9068-4dd6-849e-531c6c8aafa6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.235209 Sep 05 17:06:29.298333 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 303/617] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:29 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:29.305174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f97020cb-755e-4451-8f28-28ffc84980d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:29.313042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f97020cb-755e-4451-8f28-28ffc84980d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1309 microversion: 2.1 time: 0.091232 Sep 05 17:06:29.316287 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 315/618] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:29 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:06:30.322167 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2033c1d3-0452-4266-b092-82e79ddda03f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:30.323480 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2033c1d3-0452-4266-b092-82e79ddda03f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:30.336647 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5a92ab81-fba3-4239-a3ca-f6b17fc32c93 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:30.337883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5a92ab81-fba3-4239-a3ca-f6b17fc32c93 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:30.344259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2033c1d3-0452-4266-b092-82e79ddda03f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:30.349117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2033c1d3-0452-4266-b092-82e79ddda03f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:30.349645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2033c1d3-0452-4266-b092-82e79ddda03f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:30.350443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2033c1d3-0452-4266-b092-82e79ddda03f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:30.350918 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2033c1d3-0452-4266-b092-82e79ddda03f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:30.351738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2033c1d3-0452-4266-b092-82e79ddda03f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:30.352841 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a92ab81-fba3-4239-a3ca-f6b17fc32c93 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:30.353837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a92ab81-fba3-4239-a3ca-f6b17fc32c93 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:30.354948 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a92ab81-fba3-4239-a3ca-f6b17fc32c93 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:30.358421 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a92ab81-fba3-4239-a3ca-f6b17fc32c93 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:30.360799 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a92ab81-fba3-4239-a3ca-f6b17fc32c93 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:30.361385 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a92ab81-fba3-4239-a3ca-f6b17fc32c93 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:30.712884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2033c1d3-0452-4266-b092-82e79ddda03f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:30.723070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2033c1d3-0452-4266-b092-82e79ddda03f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.405339 Sep 05 17:06:30.723819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 304/619] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:30 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:30.728515 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5a92ab81-fba3-4239-a3ca-f6b17fc32c93 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:30.741530 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5a92ab81-fba3-4239-a3ca-f6b17fc32c93 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.409025 Sep 05 17:06:30.745100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 316/620] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:30 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:31.747381 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-09077d34-4765-414c-ae25-c8a5721e2b13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:31.747940 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-09077d34-4765-414c-ae25-c8a5721e2b13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:31.754814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09077d34-4765-414c-ae25-c8a5721e2b13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:31.755295 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09077d34-4765-414c-ae25-c8a5721e2b13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:31.755713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09077d34-4765-414c-ae25-c8a5721e2b13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:31.756446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09077d34-4765-414c-ae25-c8a5721e2b13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:31.756890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09077d34-4765-414c-ae25-c8a5721e2b13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:31.757306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09077d34-4765-414c-ae25-c8a5721e2b13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:31.765032 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3c65e7c4-065f-4aca-9357-5b98bc39d9b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:31.765637 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3c65e7c4-065f-4aca-9357-5b98bc39d9b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:31.772404 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c65e7c4-065f-4aca-9357-5b98bc39d9b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:31.772865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c65e7c4-065f-4aca-9357-5b98bc39d9b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:31.773757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c65e7c4-065f-4aca-9357-5b98bc39d9b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:31.774573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c65e7c4-065f-4aca-9357-5b98bc39d9b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:31.775024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c65e7c4-065f-4aca-9357-5b98bc39d9b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:31.775443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c65e7c4-065f-4aca-9357-5b98bc39d9b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:31.968005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-09077d34-4765-414c-ae25-c8a5721e2b13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:31.973013 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3c65e7c4-065f-4aca-9357-5b98bc39d9b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:31.977814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-09077d34-4765-414c-ae25-c8a5721e2b13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.234249 Sep 05 17:06:31.978292 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 305/621] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:31 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:31.981598 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3c65e7c4-065f-4aca-9357-5b98bc39d9b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.220415 Sep 05 17:06:31.982069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 317/622] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:31 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:32.424054 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-b8bbee30-39c1-4e07-af3a-a7c92de2c432 req-a347ec26-0d81-403e-9b7e-cdf6056e6e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba4a1fa-a126-4e6b-9ac4-32290e275435", "name": "network-vif-plugged", "status": "completed", "tag": "cb173271-65d0-4643-8208-fb9a3bbbf346"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:06:32.444942 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-b8bbee30-39c1-4e07-af3a-a7c92de2c432 req-a347ec26-0d81-403e-9b7e-cdf6056e6e48 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:32.445682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-b8bbee30-39c1-4e07-af3a-a7c92de2c432 req-a347ec26-0d81-403e-9b7e-cdf6056e6e48 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:32.446284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-b8bbee30-39c1-4e07-af3a-a7c92de2c432 req-a347ec26-0d81-403e-9b7e-cdf6056e6e48 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:32.458762 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-b8bbee30-39c1-4e07-af3a-a7c92de2c432 req-a347ec26-0d81-403e-9b7e-cdf6056e6e48 service nova] Creating event network-vif-plugged:cb173271-65d0-4643-8208-fb9a3bbbf346 for instance cba4a1fa-a126-4e6b-9ac4-32290e275435 on hv-cinder-85596 Sep 05 17:06:32.463933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-b8bbee30-39c1-4e07-af3a-a7c92de2c432 req-a347ec26-0d81-403e-9b7e-cdf6056e6e48 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043595 Sep 05 17:06:32.465184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 306/623] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:06:32.999878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6c776d30-0dbe-477f-acbb-58b8c77dfe64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:33.000502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6c776d30-0dbe-477f-acbb-58b8c77dfe64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:33.008694 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c776d30-0dbe-477f-acbb-58b8c77dfe64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:33.009449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c776d30-0dbe-477f-acbb-58b8c77dfe64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:33.010034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c776d30-0dbe-477f-acbb-58b8c77dfe64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:33.010894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c776d30-0dbe-477f-acbb-58b8c77dfe64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:33.011678 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c776d30-0dbe-477f-acbb-58b8c77dfe64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:33.012275 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c776d30-0dbe-477f-acbb-58b8c77dfe64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:33.012555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-61ff15db-7361-4841-bfc6-705a35483c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:33.014847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-61ff15db-7361-4841-bfc6-705a35483c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:33.021908 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61ff15db-7361-4841-bfc6-705a35483c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:33.022625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61ff15db-7361-4841-bfc6-705a35483c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:33.023547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61ff15db-7361-4841-bfc6-705a35483c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:33.024747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61ff15db-7361-4841-bfc6-705a35483c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:33.025480 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61ff15db-7361-4841-bfc6-705a35483c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:33.026065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61ff15db-7361-4841-bfc6-705a35483c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:33.242454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6c776d30-0dbe-477f-acbb-58b8c77dfe64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:33.246610 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-61ff15db-7361-4841-bfc6-705a35483c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:33.250376 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6c776d30-0dbe-477f-acbb-58b8c77dfe64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.254357 Sep 05 17:06:33.250892 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 318/624] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:32 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:33.254741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-61ff15db-7361-4841-bfc6-705a35483c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.248574 Sep 05 17:06:33.255329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 307/625] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:33 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:34.275226 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7ac2abf7-cf09-46df-8c58-dc966227e0d3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:34.275913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7ac2abf7-cf09-46df-8c58-dc966227e0d3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:34.281475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a3c9db5f-f84e-4165-a6e7-1fa4599277a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:34.282139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a3c9db5f-f84e-4165-a6e7-1fa4599277a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:34.283894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ac2abf7-cf09-46df-8c58-dc966227e0d3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:34.284752 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ac2abf7-cf09-46df-8c58-dc966227e0d3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:34.285293 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ac2abf7-cf09-46df-8c58-dc966227e0d3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:34.286558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ac2abf7-cf09-46df-8c58-dc966227e0d3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:34.287616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ac2abf7-cf09-46df-8c58-dc966227e0d3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:34.288616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ac2abf7-cf09-46df-8c58-dc966227e0d3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:34.290564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3c9db5f-f84e-4165-a6e7-1fa4599277a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:34.291291 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3c9db5f-f84e-4165-a6e7-1fa4599277a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:34.292080 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3c9db5f-f84e-4165-a6e7-1fa4599277a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:34.293072 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3c9db5f-f84e-4165-a6e7-1fa4599277a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:34.293737 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3c9db5f-f84e-4165-a6e7-1fa4599277a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:34.294407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3c9db5f-f84e-4165-a6e7-1fa4599277a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:34.494517 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7ac2abf7-cf09-46df-8c58-dc966227e0d3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:34.502364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7ac2abf7-cf09-46df-8c58-dc966227e0d3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.231205 Sep 05 17:06:34.502987 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 319/626] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:34 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:34.511250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a3c9db5f-f84e-4165-a6e7-1fa4599277a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:34.519422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a3c9db5f-f84e-4165-a6e7-1fa4599277a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.241813 Sep 05 17:06:34.520024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 308/627] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:34 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:35.526612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-755b1435-b555-4f5c-b67b-b538d4c5a026 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:35.527193 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-755b1435-b555-4f5c-b67b-b538d4c5a026 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:35.533846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-755b1435-b555-4f5c-b67b-b538d4c5a026 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:35.534326 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-755b1435-b555-4f5c-b67b-b538d4c5a026 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:35.534751 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-755b1435-b555-4f5c-b67b-b538d4c5a026 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:35.535434 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-755b1435-b555-4f5c-b67b-b538d4c5a026 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:35.535881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-755b1435-b555-4f5c-b67b-b538d4c5a026 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:35.536385 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-755b1435-b555-4f5c-b67b-b538d4c5a026 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:35.543680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-534d50e0-e708-4ab8-a85d-902c112b88bd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:35.544356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-534d50e0-e708-4ab8-a85d-902c112b88bd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:35.550828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-534d50e0-e708-4ab8-a85d-902c112b88bd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:35.551309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-534d50e0-e708-4ab8-a85d-902c112b88bd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:35.552165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-534d50e0-e708-4ab8-a85d-902c112b88bd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:35.552872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-534d50e0-e708-4ab8-a85d-902c112b88bd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:35.553320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-534d50e0-e708-4ab8-a85d-902c112b88bd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:35.553738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-534d50e0-e708-4ab8-a85d-902c112b88bd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:35.572044 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:06:35.742450 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-755b1435-b555-4f5c-b67b-b538d4c5a026 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:35.751529 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-534d50e0-e708-4ab8-a85d-902c112b88bd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:35.754208 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-755b1435-b555-4f5c-b67b-b538d4c5a026 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.232297 Sep 05 17:06:35.755446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 320/628] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:35 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:35.760952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-534d50e0-e708-4ab8-a85d-902c112b88bd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.221698 Sep 05 17:06:35.761717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 309/629] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:35 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:06:36.786074 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1eecd88e-f77b-4800-81ff-14b66d045da0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:36.787420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1eecd88e-f77b-4800-81ff-14b66d045da0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:36.795556 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f642cabd-fc8c-4cde-8e2b-1d5d2239c51d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:36.799610 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1eecd88e-f77b-4800-81ff-14b66d045da0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:36.800471 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1eecd88e-f77b-4800-81ff-14b66d045da0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:36.801398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1eecd88e-f77b-4800-81ff-14b66d045da0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:36.802460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f642cabd-fc8c-4cde-8e2b-1d5d2239c51d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:36.802668 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1eecd88e-f77b-4800-81ff-14b66d045da0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:36.803474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1eecd88e-f77b-4800-81ff-14b66d045da0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:36.804468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1eecd88e-f77b-4800-81ff-14b66d045da0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:36.812789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f642cabd-fc8c-4cde-8e2b-1d5d2239c51d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:36.813836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f642cabd-fc8c-4cde-8e2b-1d5d2239c51d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:36.814524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f642cabd-fc8c-4cde-8e2b-1d5d2239c51d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:36.815637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f642cabd-fc8c-4cde-8e2b-1d5d2239c51d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:36.816370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f642cabd-fc8c-4cde-8e2b-1d5d2239c51d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:36.817032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f642cabd-fc8c-4cde-8e2b-1d5d2239c51d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:37.013665 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1eecd88e-f77b-4800-81ff-14b66d045da0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:37.016844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f642cabd-fc8c-4cde-8e2b-1d5d2239c51d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:37.021489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1eecd88e-f77b-4800-81ff-14b66d045da0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.244724 Sep 05 17:06:37.022146 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 321/630] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:36 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:37.025091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f642cabd-fc8c-4cde-8e2b-1d5d2239c51d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.242774 Sep 05 17:06:37.025776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 310/631] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:36 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:38.048028 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7a546aef-44c1-4479-bd63-48bd36228a66 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:38.048833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ca16d805-80fc-4b87-8d18-672a25794aeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:38.048833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ca16d805-80fc-4b87-8d18-672a25794aeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:38.050238 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7a546aef-44c1-4479-bd63-48bd36228a66 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:38.052775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=4 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:06:38.053512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=6 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:06:38.059099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a546aef-44c1-4479-bd63-48bd36228a66 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:38.059636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a546aef-44c1-4479-bd63-48bd36228a66 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:38.060062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a546aef-44c1-4479-bd63-48bd36228a66 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:38.060201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca16d805-80fc-4b87-8d18-672a25794aeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:38.060677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca16d805-80fc-4b87-8d18-672a25794aeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:38.060817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a546aef-44c1-4479-bd63-48bd36228a66 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:38.061104 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca16d805-80fc-4b87-8d18-672a25794aeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:38.061222 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a546aef-44c1-4479-bd63-48bd36228a66 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:38.061636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a546aef-44c1-4479-bd63-48bd36228a66 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:38.061821 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca16d805-80fc-4b87-8d18-672a25794aeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:38.062283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca16d805-80fc-4b87-8d18-672a25794aeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:38.062696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca16d805-80fc-4b87-8d18-672a25794aeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:38.199440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=14 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:06:38.260618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7a546aef-44c1-4479-bd63-48bd36228a66 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:38.265319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ca16d805-80fc-4b87-8d18-672a25794aeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:38.268752 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7a546aef-44c1-4479-bd63-48bd36228a66 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.224902 Sep 05 17:06:38.269667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 322/632] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:38 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:38.282158 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ca16d805-80fc-4b87-8d18-672a25794aeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.237835 Sep 05 17:06:38.284261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 311/633] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:38 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:39.296417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c3185705-4e45-4cf3-a737-dc0835adf378 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:39.296980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c3185705-4e45-4cf3-a737-dc0835adf378 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:39.299236 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:06:39.306214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3185705-4e45-4cf3-a737-dc0835adf378 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:39.306765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3185705-4e45-4cf3-a737-dc0835adf378 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:39.307201 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3185705-4e45-4cf3-a737-dc0835adf378 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:39.307427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-46cdec09-9a41-4c0a-b0c2-4ea4f93936f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:39.307928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3185705-4e45-4cf3-a737-dc0835adf378 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:39.308377 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3185705-4e45-4cf3-a737-dc0835adf378 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:39.308795 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3185705-4e45-4cf3-a737-dc0835adf378 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:39.309780 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-46cdec09-9a41-4c0a-b0c2-4ea4f93936f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:39.317577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46cdec09-9a41-4c0a-b0c2-4ea4f93936f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:39.318595 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46cdec09-9a41-4c0a-b0c2-4ea4f93936f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:39.319462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46cdec09-9a41-4c0a-b0c2-4ea4f93936f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:39.320570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46cdec09-9a41-4c0a-b0c2-4ea4f93936f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:39.321244 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46cdec09-9a41-4c0a-b0c2-4ea4f93936f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:39.321878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46cdec09-9a41-4c0a-b0c2-4ea4f93936f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:39.520208 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c3185705-4e45-4cf3-a737-dc0835adf378 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:39.528257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-46cdec09-9a41-4c0a-b0c2-4ea4f93936f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:39.543463 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-46cdec09-9a41-4c0a-b0c2-4ea4f93936f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.240888 Sep 05 17:06:39.544420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c3185705-4e45-4cf3-a737-dc0835adf378 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.253786 Sep 05 17:06:39.545678 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 323/634] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:39 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:39.568835 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 312/635] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:39 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:40.581514 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6c1478fa-5edd-4ef8-bd9a-e66839ca932c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:40.582501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6c1478fa-5edd-4ef8-bd9a-e66839ca932c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:40.583067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-70f26d4e-dd33-421e-baad-8a27af7133d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:40.584079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-70f26d4e-dd33-421e-baad-8a27af7133d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:40.594053 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c1478fa-5edd-4ef8-bd9a-e66839ca932c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:40.594263 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70f26d4e-dd33-421e-baad-8a27af7133d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:40.594738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70f26d4e-dd33-421e-baad-8a27af7133d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:40.595362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70f26d4e-dd33-421e-baad-8a27af7133d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:40.595519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c1478fa-5edd-4ef8-bd9a-e66839ca932c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:40.596056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70f26d4e-dd33-421e-baad-8a27af7133d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:40.596295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c1478fa-5edd-4ef8-bd9a-e66839ca932c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:40.597097 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c1478fa-5edd-4ef8-bd9a-e66839ca932c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:40.597589 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c1478fa-5edd-4ef8-bd9a-e66839ca932c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:40.598012 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c1478fa-5edd-4ef8-bd9a-e66839ca932c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:40.600623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70f26d4e-dd33-421e-baad-8a27af7133d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:40.601961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70f26d4e-dd33-421e-baad-8a27af7133d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:40.819789 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6c1478fa-5edd-4ef8-bd9a-e66839ca932c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:40.823062 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-70f26d4e-dd33-421e-baad-8a27af7133d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:40.833033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-70f26d4e-dd33-421e-baad-8a27af7133d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.256483 Sep 05 17:06:40.833634 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 313/636] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:40 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:40.836106 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6c1478fa-5edd-4ef8-bd9a-e66839ca932c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.261936 Sep 05 17:06:40.850043 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 324/637] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:40 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:41.861914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1926c26e-d432-43c3-814d-4204dbb5fd27 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:41.862933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1926c26e-d432-43c3-814d-4204dbb5fd27 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:41.863777 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f9dcd47c-5705-4508-82fc-744847731ef2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:41.864838 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f9dcd47c-5705-4508-82fc-744847731ef2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:41.874076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1926c26e-d432-43c3-814d-4204dbb5fd27 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:41.874855 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1926c26e-d432-43c3-814d-4204dbb5fd27 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:41.876139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1926c26e-d432-43c3-814d-4204dbb5fd27 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:41.876953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1926c26e-d432-43c3-814d-4204dbb5fd27 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:41.877415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1926c26e-d432-43c3-814d-4204dbb5fd27 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:41.877846 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1926c26e-d432-43c3-814d-4204dbb5fd27 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:41.880229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f9dcd47c-5705-4508-82fc-744847731ef2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:41.881281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f9dcd47c-5705-4508-82fc-744847731ef2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:41.881929 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f9dcd47c-5705-4508-82fc-744847731ef2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:41.882905 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f9dcd47c-5705-4508-82fc-744847731ef2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:41.883364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f9dcd47c-5705-4508-82fc-744847731ef2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:41.883780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f9dcd47c-5705-4508-82fc-744847731ef2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:42.093067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1926c26e-d432-43c3-814d-4204dbb5fd27 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:42.105474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1926c26e-d432-43c3-814d-4204dbb5fd27 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.250331 Sep 05 17:06:42.110490 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f9dcd47c-5705-4508-82fc-744847731ef2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:42.114047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 314/638] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:41 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:42.118661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f9dcd47c-5705-4508-82fc-744847731ef2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.261515 Sep 05 17:06:42.119397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 325/639] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:41 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:43.133970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-052f766b-83cb-4ab9-bdd3-1f29fe8d5f4f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:43.134928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-052f766b-83cb-4ab9-bdd3-1f29fe8d5f4f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:43.144683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4be14c3e-ba89-4ef2-a268-8a731372b4dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:43.145302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4be14c3e-ba89-4ef2-a268-8a731372b4dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:43.145443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-052f766b-83cb-4ab9-bdd3-1f29fe8d5f4f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:43.145906 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-052f766b-83cb-4ab9-bdd3-1f29fe8d5f4f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:43.146332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-052f766b-83cb-4ab9-bdd3-1f29fe8d5f4f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:43.146994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-052f766b-83cb-4ab9-bdd3-1f29fe8d5f4f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:43.147457 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-052f766b-83cb-4ab9-bdd3-1f29fe8d5f4f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:43.147877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-052f766b-83cb-4ab9-bdd3-1f29fe8d5f4f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:43.154477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4be14c3e-ba89-4ef2-a268-8a731372b4dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:43.154972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4be14c3e-ba89-4ef2-a268-8a731372b4dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:43.155414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4be14c3e-ba89-4ef2-a268-8a731372b4dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:43.156105 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4be14c3e-ba89-4ef2-a268-8a731372b4dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:43.156671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4be14c3e-ba89-4ef2-a268-8a731372b4dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:43.157013 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4be14c3e-ba89-4ef2-a268-8a731372b4dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:43.355117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-052f766b-83cb-4ab9-bdd3-1f29fe8d5f4f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:43.358272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4be14c3e-ba89-4ef2-a268-8a731372b4dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:43.363007 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-052f766b-83cb-4ab9-bdd3-1f29fe8d5f4f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.235475 Sep 05 17:06:43.363580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 315/640] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:43 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:43.366492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4be14c3e-ba89-4ef2-a268-8a731372b4dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.228178 Sep 05 17:06:43.367047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 326/641] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:43 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:06:44.386479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8f2e1f45-f074-4b48-871c-7a0d5d558d20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:44.387171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8f2e1f45-f074-4b48-871c-7a0d5d558d20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:44.389394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9390ddf2-47af-4e01-b55a-56657d2a5b92 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:44.390008 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9390ddf2-47af-4e01-b55a-56657d2a5b92 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:44.394163 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f2e1f45-f074-4b48-871c-7a0d5d558d20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:44.394656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f2e1f45-f074-4b48-871c-7a0d5d558d20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:44.395204 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f2e1f45-f074-4b48-871c-7a0d5d558d20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:44.395809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f2e1f45-f074-4b48-871c-7a0d5d558d20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:44.396288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f2e1f45-f074-4b48-871c-7a0d5d558d20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:44.396708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f2e1f45-f074-4b48-871c-7a0d5d558d20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:44.396986 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9390ddf2-47af-4e01-b55a-56657d2a5b92 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:44.397478 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9390ddf2-47af-4e01-b55a-56657d2a5b92 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:44.397908 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9390ddf2-47af-4e01-b55a-56657d2a5b92 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:44.398600 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9390ddf2-47af-4e01-b55a-56657d2a5b92 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:44.399064 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9390ddf2-47af-4e01-b55a-56657d2a5b92 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:44.399483 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9390ddf2-47af-4e01-b55a-56657d2a5b92 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:44.583935 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8f2e1f45-f074-4b48-871c-7a0d5d558d20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:44.587598 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9390ddf2-47af-4e01-b55a-56657d2a5b92 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:44.591817 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8f2e1f45-f074-4b48-871c-7a0d5d558d20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.209434 Sep 05 17:06:44.592399 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 316/642] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:44 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:44.595559 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9390ddf2-47af-4e01-b55a-56657d2a5b92 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.210116 Sep 05 17:06:44.596124 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 327/643] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:44 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:45.619106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-23beaa57-9f49-4a05-9568-14f065b12d83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:45.620104 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-23beaa57-9f49-4a05-9568-14f065b12d83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:45.621552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6a60b86a-9017-49e2-bc60-65cd3a89e4ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:45.622581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6a60b86a-9017-49e2-bc60-65cd3a89e4ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:45.630968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23beaa57-9f49-4a05-9568-14f065b12d83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:45.631409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23beaa57-9f49-4a05-9568-14f065b12d83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:45.631836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23beaa57-9f49-4a05-9568-14f065b12d83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:45.632038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a60b86a-9017-49e2-bc60-65cd3a89e4ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:45.632568 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a60b86a-9017-49e2-bc60-65cd3a89e4ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:45.632737 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23beaa57-9f49-4a05-9568-14f065b12d83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:45.632992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a60b86a-9017-49e2-bc60-65cd3a89e4ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:45.633147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23beaa57-9f49-4a05-9568-14f065b12d83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:45.633428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23beaa57-9f49-4a05-9568-14f065b12d83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:45.633741 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a60b86a-9017-49e2-bc60-65cd3a89e4ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:45.634164 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a60b86a-9017-49e2-bc60-65cd3a89e4ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:45.634606 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a60b86a-9017-49e2-bc60-65cd3a89e4ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:45.825023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6a60b86a-9017-49e2-bc60-65cd3a89e4ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:45.827885 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-23beaa57-9f49-4a05-9568-14f065b12d83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:45.833225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6a60b86a-9017-49e2-bc60-65cd3a89e4ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.217913 Sep 05 17:06:45.833996 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 328/644] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:45 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:45.836830 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-23beaa57-9f49-4a05-9568-14f065b12d83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.224246 Sep 05 17:06:45.837429 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 317/645] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:45 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:46.862673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b74a8942-fca4-47c4-ad4b-5b92fefbea17 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:46.864002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5d8927bf-cdfc-4929-840d-6580ad95606d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:46.864823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b74a8942-fca4-47c4-ad4b-5b92fefbea17 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:46.864938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5d8927bf-cdfc-4929-840d-6580ad95606d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:46.871498 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b74a8942-fca4-47c4-ad4b-5b92fefbea17 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:46.871681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d8927bf-cdfc-4929-840d-6580ad95606d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:46.871986 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b74a8942-fca4-47c4-ad4b-5b92fefbea17 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:46.872186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d8927bf-cdfc-4929-840d-6580ad95606d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:46.872442 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b74a8942-fca4-47c4-ad4b-5b92fefbea17 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:46.872600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d8927bf-cdfc-4929-840d-6580ad95606d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:46.873139 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b74a8942-fca4-47c4-ad4b-5b92fefbea17 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:46.873283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d8927bf-cdfc-4929-840d-6580ad95606d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:46.873590 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b74a8942-fca4-47c4-ad4b-5b92fefbea17 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:46.873744 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d8927bf-cdfc-4929-840d-6580ad95606d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:46.874007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b74a8942-fca4-47c4-ad4b-5b92fefbea17 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:46.874149 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d8927bf-cdfc-4929-840d-6580ad95606d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:47.073729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5d8927bf-cdfc-4929-840d-6580ad95606d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:47.082088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5d8927bf-cdfc-4929-840d-6580ad95606d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.224458 Sep 05 17:06:47.082669 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 318/646] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:46 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:47.085171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b74a8942-fca4-47c4-ad4b-5b92fefbea17 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:47.088951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:06:47.094030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b74a8942-fca4-47c4-ad4b-5b92fefbea17 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.237975 Sep 05 17:06:47.097140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 329/647] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:46 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:47.747180 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-1b03b219-3a09-4f51-9bf4-b31d6df2d286 req-9a35c108-c69f-445c-bb02-63e7eadc9f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8c420ca-19c4-4f51-8091-e83672ea54ca", "tag": "6e894232-478f-47a6-86f4-399c64bf7399"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:06:47.757534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-1b03b219-3a09-4f51-9bf4-b31d6df2d286 req-9a35c108-c69f-445c-bb02-63e7eadc9f55 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:47.758012 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-1b03b219-3a09-4f51-9bf4-b31d6df2d286 req-9a35c108-c69f-445c-bb02-63e7eadc9f55 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:47.758437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-1b03b219-3a09-4f51-9bf4-b31d6df2d286 req-9a35c108-c69f-445c-bb02-63e7eadc9f55 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:47.772025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-1b03b219-3a09-4f51-9bf4-b31d6df2d286 req-9a35c108-c69f-445c-bb02-63e7eadc9f55 service nova] Creating event network-changed:6e894232-478f-47a6-86f4-399c64bf7399 for instance c8c420ca-19c4-4f51-8091-e83672ea54ca on hv-cinder-85596 Sep 05 17:06:47.777760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-1b03b219-3a09-4f51-9bf4-b31d6df2d286 req-9a35c108-c69f-445c-bb02-63e7eadc9f55 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034328 Sep 05 17:06:47.778529 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 319/648] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:06:48.105687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2b33902f-6f48-4609-bb29-2e071f4a337f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:48.106294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2b33902f-6f48-4609-bb29-2e071f4a337f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:48.113573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b33902f-6f48-4609-bb29-2e071f4a337f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:48.114180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b33902f-6f48-4609-bb29-2e071f4a337f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:48.114480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b33902f-6f48-4609-bb29-2e071f4a337f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:48.115188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b33902f-6f48-4609-bb29-2e071f4a337f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:48.115638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b33902f-6f48-4609-bb29-2e071f4a337f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:48.116054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b33902f-6f48-4609-bb29-2e071f4a337f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:48.120768 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d561a545-40af-41f0-8090-c1d1ac6b4fe6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:48.121490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d561a545-40af-41f0-8090-c1d1ac6b4fe6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:48.127731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d561a545-40af-41f0-8090-c1d1ac6b4fe6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:48.128240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d561a545-40af-41f0-8090-c1d1ac6b4fe6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:48.128682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d561a545-40af-41f0-8090-c1d1ac6b4fe6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:48.129449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d561a545-40af-41f0-8090-c1d1ac6b4fe6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:48.129945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d561a545-40af-41f0-8090-c1d1ac6b4fe6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:48.130366 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d561a545-40af-41f0-8090-c1d1ac6b4fe6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:48.326704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2b33902f-6f48-4609-bb29-2e071f4a337f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:48.329995 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d561a545-40af-41f0-8090-c1d1ac6b4fe6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:48.335218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2b33902f-6f48-4609-bb29-2e071f4a337f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.233909 Sep 05 17:06:48.335810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 330/649] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:48 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:48.338340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d561a545-40af-41f0-8090-c1d1ac6b4fe6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.222268 Sep 05 17:06:48.338904 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 320/650] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:48 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:49.363362 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0ac7ad73-67f1-4dfe-a563-ff0066ee9834 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:49.364116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0ac7ad73-67f1-4dfe-a563-ff0066ee9834 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:49.366172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-86189798-5130-4f75-99f8-080ed13ddd15 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:49.367228 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-86189798-5130-4f75-99f8-080ed13ddd15 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:49.378204 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86189798-5130-4f75-99f8-080ed13ddd15 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:49.379308 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86189798-5130-4f75-99f8-080ed13ddd15 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:49.379663 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ac7ad73-67f1-4dfe-a563-ff0066ee9834 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:49.380700 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86189798-5130-4f75-99f8-080ed13ddd15 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:49.380814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ac7ad73-67f1-4dfe-a563-ff0066ee9834 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:49.380814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ac7ad73-67f1-4dfe-a563-ff0066ee9834 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:49.381113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86189798-5130-4f75-99f8-080ed13ddd15 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:49.381517 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ac7ad73-67f1-4dfe-a563-ff0066ee9834 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:49.381630 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86189798-5130-4f75-99f8-080ed13ddd15 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:49.381976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86189798-5130-4f75-99f8-080ed13ddd15 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:49.382128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ac7ad73-67f1-4dfe-a563-ff0066ee9834 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:49.382561 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ac7ad73-67f1-4dfe-a563-ff0066ee9834 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:49.578157 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0ac7ad73-67f1-4dfe-a563-ff0066ee9834 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:49.581203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-86189798-5130-4f75-99f8-080ed13ddd15 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:49.586617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0ac7ad73-67f1-4dfe-a563-ff0066ee9834 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.230605 Sep 05 17:06:49.587204 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 331/651] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:49 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:49.589441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-86189798-5130-4f75-99f8-080ed13ddd15 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1319 microversion: 2.1 time: 0.230832 Sep 05 17:06:49.590088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 321/652] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:49 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:50.609935 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a633632d-caec-4abf-9c89-6d513723bba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:50.610552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a633632d-caec-4abf-9c89-6d513723bba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:50.612639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7ed2173d-58ab-422e-bbe8-a4fdf10ac965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:50.613679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7ed2173d-58ab-422e-bbe8-a4fdf10ac965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:50.618382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a633632d-caec-4abf-9c89-6d513723bba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:50.618864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a633632d-caec-4abf-9c89-6d513723bba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:50.619296 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a633632d-caec-4abf-9c89-6d513723bba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:50.619961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a633632d-caec-4abf-9c89-6d513723bba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:50.621358 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a633632d-caec-4abf-9c89-6d513723bba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:50.621589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ed2173d-58ab-422e-bbe8-a4fdf10ac965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:50.622030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a633632d-caec-4abf-9c89-6d513723bba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:50.622237 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ed2173d-58ab-422e-bbe8-a4fdf10ac965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:50.622661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ed2173d-58ab-422e-bbe8-a4fdf10ac965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:50.623503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ed2173d-58ab-422e-bbe8-a4fdf10ac965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:50.623928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ed2173d-58ab-422e-bbe8-a4fdf10ac965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:50.624386 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ed2173d-58ab-422e-bbe8-a4fdf10ac965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:51.078250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a633632d-caec-4abf-9c89-6d513723bba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:51.081412 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7ed2173d-58ab-422e-bbe8-a4fdf10ac965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:51.089559 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7ed2173d-58ab-422e-bbe8-a4fdf10ac965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1507 microversion: 2.1 time: 0.480995 Sep 05 17:06:51.090144 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 322/653] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:50 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1507 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:51.090520 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a633632d-caec-4abf-9c89-6d513723bba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.484647 Sep 05 17:06:51.091444 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 332/654] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:50 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:51.118219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-99a52961-7b0a-4ee0-a108-a77d8377e1fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9048c06-9ac3-455a-91d4-52977e0f0748", "device": "/dev/sdb"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:06:51.120743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-99a52961-7b0a-4ee0-a108-a77d8377e1fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:51.126963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99a52961-7b0a-4ee0-a108-a77d8377e1fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:51.127444 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99a52961-7b0a-4ee0-a108-a77d8377e1fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:51.127873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99a52961-7b0a-4ee0-a108-a77d8377e1fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:51.128598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99a52961-7b0a-4ee0-a108-a77d8377e1fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:51.129313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99a52961-7b0a-4ee0-a108-a77d8377e1fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:51.130196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99a52961-7b0a-4ee0-a108-a77d8377e1fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:52.121320 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8aef0d8b-f2ca-49b3-b185-dd4f3ff7efc1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:52.122177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8aef0d8b-f2ca-49b3-b185-dd4f3ff7efc1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:52.131647 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8aef0d8b-f2ca-49b3-b185-dd4f3ff7efc1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:52.132378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8aef0d8b-f2ca-49b3-b185-dd4f3ff7efc1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:52.132989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8aef0d8b-f2ca-49b3-b185-dd4f3ff7efc1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:52.134007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8aef0d8b-f2ca-49b3-b185-dd4f3ff7efc1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:52.134644 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8aef0d8b-f2ca-49b3-b185-dd4f3ff7efc1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:52.135242 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8aef0d8b-f2ca-49b3-b185-dd4f3ff7efc1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:52.281842 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8aef0d8b-f2ca-49b3-b185-dd4f3ff7efc1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:52.290082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8aef0d8b-f2ca-49b3-b185-dd4f3ff7efc1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.174392 Sep 05 17:06:52.290653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 333/655] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:52 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:53.321599 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-030c0f3c-7f14-4057-9624-2b404829d989 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:53.322332 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-030c0f3c-7f14-4057-9624-2b404829d989 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:53.331041 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-030c0f3c-7f14-4057-9624-2b404829d989 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:53.331778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-030c0f3c-7f14-4057-9624-2b404829d989 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:53.332461 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-030c0f3c-7f14-4057-9624-2b404829d989 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:53.333442 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-030c0f3c-7f14-4057-9624-2b404829d989 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:53.334061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-030c0f3c-7f14-4057-9624-2b404829d989 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:53.334693 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-030c0f3c-7f14-4057-9624-2b404829d989 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:53.481314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-030c0f3c-7f14-4057-9624-2b404829d989 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:53.489328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-030c0f3c-7f14-4057-9624-2b404829d989 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.172263 Sep 05 17:06:53.489881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 334/656] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:53 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:54.466204 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-99a52961-7b0a-4ee0-a108-a77d8377e1fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "POST /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.353333 Sep 05 17:06:54.472479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 323/657] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Sep 5 17:06:51 2022] POST /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments => generated 194 bytes in 3355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:06:54.530640 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d2bbc479-dcb5-451a-b017-f036039b1246 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:54.531282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d2bbc479-dcb5-451a-b017-f036039b1246 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:54.538533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2bbc479-dcb5-451a-b017-f036039b1246 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:54.538848 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2bbc479-dcb5-451a-b017-f036039b1246 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:54.539766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2bbc479-dcb5-451a-b017-f036039b1246 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:54.540713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2bbc479-dcb5-451a-b017-f036039b1246 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:54.541158 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2bbc479-dcb5-451a-b017-f036039b1246 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:54.541636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2bbc479-dcb5-451a-b017-f036039b1246 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:54.684974 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d2bbc479-dcb5-451a-b017-f036039b1246 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:54.693877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d2bbc479-dcb5-451a-b017-f036039b1246 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.182193 Sep 05 17:06:54.709673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 335/658] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:54 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:55.721874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c5bdd60f-92e3-4476-b555-c2b89faf1751 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:55.723041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c5bdd60f-92e3-4476-b555-c2b89faf1751 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:55.735845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5bdd60f-92e3-4476-b555-c2b89faf1751 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:55.736697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5bdd60f-92e3-4476-b555-c2b89faf1751 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:55.737416 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5bdd60f-92e3-4476-b555-c2b89faf1751 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:55.738554 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5bdd60f-92e3-4476-b555-c2b89faf1751 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:55.739218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5bdd60f-92e3-4476-b555-c2b89faf1751 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:55.739680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5bdd60f-92e3-4476-b555-c2b89faf1751 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:55.870144 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c5bdd60f-92e3-4476-b555-c2b89faf1751 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:55.882493 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c5bdd60f-92e3-4476-b555-c2b89faf1751 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.167598 Sep 05 17:06:55.883331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 324/659] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:55 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:56.910452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7b028629-35cc-4738-844d-a58bd40c26e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:56.911792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7b028629-35cc-4738-844d-a58bd40c26e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:56.918561 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b028629-35cc-4738-844d-a58bd40c26e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:56.919047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b028629-35cc-4738-844d-a58bd40c26e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:56.919478 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b028629-35cc-4738-844d-a58bd40c26e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:56.920179 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b028629-35cc-4738-844d-a58bd40c26e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:56.920650 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b028629-35cc-4738-844d-a58bd40c26e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:56.921076 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7b028629-35cc-4738-844d-a58bd40c26e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:57.065106 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7b028629-35cc-4738-844d-a58bd40c26e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:57.073873 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7b028629-35cc-4738-844d-a58bd40c26e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.167357 Sep 05 17:06:57.074449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 336/660] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:56 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:58.100496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8b5d92a7-dade-4781-8f02-9a405799033a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:58.101767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8b5d92a7-dade-4781-8f02-9a405799033a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:58.113650 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b5d92a7-dade-4781-8f02-9a405799033a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:58.114425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b5d92a7-dade-4781-8f02-9a405799033a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:58.115022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b5d92a7-dade-4781-8f02-9a405799033a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:58.115731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b5d92a7-dade-4781-8f02-9a405799033a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:58.116181 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b5d92a7-dade-4781-8f02-9a405799033a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:58.116626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b5d92a7-dade-4781-8f02-9a405799033a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:58.135856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:06:58.250266 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8b5d92a7-dade-4781-8f02-9a405799033a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:58.258010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8b5d92a7-dade-4781-8f02-9a405799033a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.164094 Sep 05 17:06:58.258578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 325/661] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:58 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:06:58.744927 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-1f39e97f-0630-47a4-8c4e-84c4b633a016 req-33a1040b-87e6-4860-b049-a62a8cbc8c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c420ca-19c4-4f51-8091-e83672ea54ca", "name": "network-vif-plugged", "status": "completed", "tag": "6e894232-478f-47a6-86f4-399c64bf7399"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:06:58.756123 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-1f39e97f-0630-47a4-8c4e-84c4b633a016 req-33a1040b-87e6-4860-b049-a62a8cbc8c58 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:58.757208 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-1f39e97f-0630-47a4-8c4e-84c4b633a016 req-33a1040b-87e6-4860-b049-a62a8cbc8c58 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:58.758626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-1f39e97f-0630-47a4-8c4e-84c4b633a016 req-33a1040b-87e6-4860-b049-a62a8cbc8c58 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:58.772571 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-1f39e97f-0630-47a4-8c4e-84c4b633a016 req-33a1040b-87e6-4860-b049-a62a8cbc8c58 service nova] Creating event network-vif-plugged:6e894232-478f-47a6-86f4-399c64bf7399 for instance c8c420ca-19c4-4f51-8091-e83672ea54ca on hv-cinder-85596 Sep 05 17:06:58.778225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-1f39e97f-0630-47a4-8c4e-84c4b633a016 req-33a1040b-87e6-4860-b049-a62a8cbc8c58 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037260 Sep 05 17:06:58.779592 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 337/662] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:06:59.287358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-46f0e048-e887-4315-9c10-80554e4d9c91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:06:59.287933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-46f0e048-e887-4315-9c10-80554e4d9c91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:06:59.290692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=46 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:06:59.296580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46f0e048-e887-4315-9c10-80554e4d9c91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:59.297076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46f0e048-e887-4315-9c10-80554e4d9c91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:59.297535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46f0e048-e887-4315-9c10-80554e4d9c91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:59.298317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46f0e048-e887-4315-9c10-80554e4d9c91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:06:59.298818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46f0e048-e887-4315-9c10-80554e4d9c91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:06:59.299510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46f0e048-e887-4315-9c10-80554e4d9c91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:06:59.442598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-46f0e048-e887-4315-9c10-80554e4d9c91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:06:59.451114 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-46f0e048-e887-4315-9c10-80554e4d9c91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.172477 Sep 05 17:06:59.451719 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 326/663] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:06:59 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:07:00.476380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f74920e2-11ac-4206-9234-a0b3b56888cc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:07:00.477026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f74920e2-11ac-4206-9234-a0b3b56888cc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:07:00.484282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f74920e2-11ac-4206-9234-a0b3b56888cc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:00.484769 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f74920e2-11ac-4206-9234-a0b3b56888cc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:00.485197 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f74920e2-11ac-4206-9234-a0b3b56888cc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:00.485885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f74920e2-11ac-4206-9234-a0b3b56888cc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:00.486338 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f74920e2-11ac-4206-9234-a0b3b56888cc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:00.486764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f74920e2-11ac-4206-9234-a0b3b56888cc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:00.626849 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f74920e2-11ac-4206-9234-a0b3b56888cc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:07:00.634919 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f74920e2-11ac-4206-9234-a0b3b56888cc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1357 microversion: 2.1 time: 0.163733 Sep 05 17:07:00.635489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 338/664] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:07:00 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:07:01.659428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ce5a223f-aeb0-4b94-a88f-1195e261786e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:07:01.659956 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ce5a223f-aeb0-4b94-a88f-1195e261786e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:07:01.667132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce5a223f-aeb0-4b94-a88f-1195e261786e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:01.667654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce5a223f-aeb0-4b94-a88f-1195e261786e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:01.668799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce5a223f-aeb0-4b94-a88f-1195e261786e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:01.669520 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce5a223f-aeb0-4b94-a88f-1195e261786e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:01.669975 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce5a223f-aeb0-4b94-a88f-1195e261786e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:01.670379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce5a223f-aeb0-4b94-a88f-1195e261786e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:01.803239 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ce5a223f-aeb0-4b94-a88f-1195e261786e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:07:01.811480 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ce5a223f-aeb0-4b94-a88f-1195e261786e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1547 microversion: 2.1 time: 0.156105 Sep 05 17:07:01.812104 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 327/665] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:07:01 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:07:01.833489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-84ed236c-0034-4ac0-92e4-1af63bce2ff5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:07:01.834048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-84ed236c-0034-4ac0-92e4-1af63bce2ff5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:07:01.841044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84ed236c-0034-4ac0-92e4-1af63bce2ff5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:01.841518 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84ed236c-0034-4ac0-92e4-1af63bce2ff5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:01.841937 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84ed236c-0034-4ac0-92e4-1af63bce2ff5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:01.842614 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84ed236c-0034-4ac0-92e4-1af63bce2ff5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:01.843053 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84ed236c-0034-4ac0-92e4-1af63bce2ff5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:01.843465 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84ed236c-0034-4ac0-92e4-1af63bce2ff5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:01.977344 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-84ed236c-0034-4ac0-92e4-1af63bce2ff5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:07:01.985724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-84ed236c-0034-4ac0-92e4-1af63bce2ff5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1547 microversion: 2.1 time: 0.156041 Sep 05 17:07:01.986289 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 339/666] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:07:01 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:07:02.007562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ad8167f3-42e8-4c16-ab54-568329788bdc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:07:02.012452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ad8167f3-42e8-4c16-ab54-568329788bdc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:07:02.013208 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ad8167f3-42e8-4c16-ab54-568329788bdc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Searching by: {'deleted': False, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5'} {{(pid=120731) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 05 17:07:02.019750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad8167f3-42e8-4c16-ab54-568329788bdc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:02.020258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad8167f3-42e8-4c16-ab54-568329788bdc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:02.020675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad8167f3-42e8-4c16-ab54-568329788bdc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:02.021381 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad8167f3-42e8-4c16-ab54-568329788bdc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:02.021818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad8167f3-42e8-4c16-ab54-568329788bdc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:02.022335 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad8167f3-42e8-4c16-ab54-568329788bdc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:02.112254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.multi_cell_list [None req-ad8167f3-42e8-4c16-ab54-568329788bdc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 05 17:07:02.212777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ad8167f3-42e8-4c16-ab54-568329788bdc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209033 Sep 05 17:07:02.213288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 328/667] 10.222.0.23 () {58 vars in 1125 bytes} [Mon Sep 5 17:07:02 2022] GET /compute/v2.1/servers => generated 342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:07:02.230155 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ded84d80-0430-495b-bb9b-1fb22648378f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:07:02.230772 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ded84d80-0430-495b-bb9b-1fb22648378f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:07:02.237308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ded84d80-0430-495b-bb9b-1fb22648378f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:02.237824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ded84d80-0430-495b-bb9b-1fb22648378f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:02.238258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ded84d80-0430-495b-bb9b-1fb22648378f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:02.238953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ded84d80-0430-495b-bb9b-1fb22648378f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:02.239811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ded84d80-0430-495b-bb9b-1fb22648378f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:02.240309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ded84d80-0430-495b-bb9b-1fb22648378f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:02.378093 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ded84d80-0430-495b-bb9b-1fb22648378f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:07:02.386258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ded84d80-0430-495b-bb9b-1fb22648378f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1547 microversion: 2.1 time: 0.160396 Sep 05 17:07:02.386825 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 340/668] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:07:02 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:07:03.976885 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ada96c04-67f8-4f24-ab43-88e67bca63e6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "845219e9-5e7d-4f7d-97f1-99b468c4eca7"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:07:03.980104 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ada96c04-67f8-4f24-ab43-88e67bca63e6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:07:03.990536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ada96c04-67f8-4f24-ab43-88e67bca63e6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:03.991243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ada96c04-67f8-4f24-ab43-88e67bca63e6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:03.991784 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ada96c04-67f8-4f24-ab43-88e67bca63e6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:03.992514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ada96c04-67f8-4f24-ab43-88e67bca63e6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:03.992970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ada96c04-67f8-4f24-ab43-88e67bca63e6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:03.993411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ada96c04-67f8-4f24-ab43-88e67bca63e6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:04.335702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ada96c04-67f8-4f24-ab43-88e67bca63e6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "POST /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365763 Sep 05 17:07:04.336373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 329/669] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Sep 5 17:07:03 2022] POST /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:07:09.193997 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-35e8d514-aee4-44b7-b6a5-09eba24ce951 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29931552-d352-408d-8b80-693e7d7ec096"}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:07:09.196544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-35e8d514-aee4-44b7-b6a5-09eba24ce951 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:07:09.202569 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35e8d514-aee4-44b7-b6a5-09eba24ce951 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:09.203052 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35e8d514-aee4-44b7-b6a5-09eba24ce951 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:09.203458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35e8d514-aee4-44b7-b6a5-09eba24ce951 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:09.204211 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35e8d514-aee4-44b7-b6a5-09eba24ce951 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:09.204643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35e8d514-aee4-44b7-b6a5-09eba24ce951 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:09.205058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35e8d514-aee4-44b7-b6a5-09eba24ce951 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:09.512800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-35e8d514-aee4-44b7-b6a5-09eba24ce951 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "POST /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.449376 Sep 05 17:07:09.513431 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 341/670] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Sep 5 17:07:09 2022] POST /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d/os-volume_attachments => generated 194 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:07:14.006268 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:07:14.007243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=7 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:07:14.012396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9fa6b6cb-1700-4b76-bb87-95843523de79 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:07:14.012977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9fa6b6cb-1700-4b76-bb87-95843523de79 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:07:14.019932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fa6b6cb-1700-4b76-bb87-95843523de79 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:14.020442 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fa6b6cb-1700-4b76-bb87-95843523de79 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:14.020871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fa6b6cb-1700-4b76-bb87-95843523de79 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:14.021560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fa6b6cb-1700-4b76-bb87-95843523de79 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:14.022010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fa6b6cb-1700-4b76-bb87-95843523de79 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:14.022397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fa6b6cb-1700-4b76-bb87-95843523de79 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:14.046217 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9fa6b6cb-1700-4b76-bb87-95843523de79 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955/ips" status: 200 len: 150 microversion: 2.1 time: 0.041478 Sep 05 17:07:14.046807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 330/671] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Sep 5 17:07:14 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:07:55.638659 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=37 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:07:55.639422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:07:55.640283 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:07:55.640473 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:07:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments/c1de1c19-f726-4715-afc0-12c2b2cd1a68 (ip 10.222.0.23) !!! Sep 05 17:07:55.752108 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-55779956-bd29-4a9d-a927-ec7f1e9f7b11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:07:55.752720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-55779956-bd29-4a9d-a927-ec7f1e9f7b11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:07:55.759155 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55779956-bd29-4a9d-a927-ec7f1e9f7b11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:55.759619 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55779956-bd29-4a9d-a927-ec7f1e9f7b11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:55.760051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55779956-bd29-4a9d-a927-ec7f1e9f7b11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:55.760771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55779956-bd29-4a9d-a927-ec7f1e9f7b11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:55.761225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55779956-bd29-4a9d-a927-ec7f1e9f7b11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:55.761641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55779956-bd29-4a9d-a927-ec7f1e9f7b11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:55.792038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-55779956-bd29-4a9d-a927-ec7f1e9f7b11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments/c1de1c19-f726-4715-afc0-12c2b2cd1a68" status: 200 len: 194 microversion: 2.20 time: 0.158473 Sep 05 17:07:55.792677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 342/672] 10.222.0.23 () {60 vars in 1454 bytes} [Mon Sep 5 17:07:55 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments/c1de1c19-f726-4715-afc0-12c2b2cd1a68 => generated 194 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:07:55.864981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ad2ab929-157c-421f-978e-b3f1490a4a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:07:55.865517 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ad2ab929-157c-421f-978e-b3f1490a4a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:07:55.868530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:07:55.869444 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:07:55.876216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad2ab929-157c-421f-978e-b3f1490a4a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:55.876723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad2ab929-157c-421f-978e-b3f1490a4a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:55.877172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad2ab929-157c-421f-978e-b3f1490a4a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:55.877994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad2ab929-157c-421f-978e-b3f1490a4a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:55.878701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad2ab929-157c-421f-978e-b3f1490a4a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:55.879352 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad2ab929-157c-421f-978e-b3f1490a4a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:56.026425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-ad2ab929-157c-421f-978e-b3f1490a4a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lazy-loading 'services' on Instance uuid 97cc15c7-947d-4daf-80e8-8edc37c01e68 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:07:56.154850 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ad2ab929-157c-421f-978e-b3f1490a4a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments/c1de1c19-f726-4715-afc0-12c2b2cd1a68" status: 202 len: 0 microversion: 2.20 time: 0.295633 Sep 05 17:07:56.155454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 331/673] 10.222.0.23 () {60 vars in 1457 bytes} [Mon Sep 5 17:07:55 2022] DELETE /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments/c1de1c19-f726-4715-afc0-12c2b2cd1a68 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:07:56.164403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-174fe14b-f7ca-43c2-8bee-b5437626daea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:07:56.166655 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-174fe14b-f7ca-43c2-8bee-b5437626daea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:07:56.187558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174fe14b-f7ca-43c2-8bee-b5437626daea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:56.188040 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174fe14b-f7ca-43c2-8bee-b5437626daea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:56.188482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174fe14b-f7ca-43c2-8bee-b5437626daea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:56.189160 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174fe14b-f7ca-43c2-8bee-b5437626daea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:56.189601 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174fe14b-f7ca-43c2-8bee-b5437626daea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:56.190180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174fe14b-f7ca-43c2-8bee-b5437626daea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:56.222722 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-174fe14b-f7ca-43c2-8bee-b5437626daea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062457 Sep 05 17:07:56.223194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 343/674] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:07:56 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:07:57.242487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-65d056c0-ab4f-4113-92de-6872bb84efb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:07:57.246266 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-65d056c0-ab4f-4113-92de-6872bb84efb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:07:57.256094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65d056c0-ab4f-4113-92de-6872bb84efb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:57.256609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65d056c0-ab4f-4113-92de-6872bb84efb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:57.257044 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65d056c0-ab4f-4113-92de-6872bb84efb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:57.257734 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65d056c0-ab4f-4113-92de-6872bb84efb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:57.258185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65d056c0-ab4f-4113-92de-6872bb84efb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:57.258609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65d056c0-ab4f-4113-92de-6872bb84efb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:57.288986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-65d056c0-ab4f-4113-92de-6872bb84efb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055050 Sep 05 17:07:57.289545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 332/675] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:07:57 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:07:58.303183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6b0fbb76-928d-4ecd-a81a-17bb09b4ac10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:07:58.305361 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6b0fbb76-928d-4ecd-a81a-17bb09b4ac10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:07:58.312167 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b0fbb76-928d-4ecd-a81a-17bb09b4ac10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:58.312660 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b0fbb76-928d-4ecd-a81a-17bb09b4ac10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:58.313087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b0fbb76-928d-4ecd-a81a-17bb09b4ac10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:58.313766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b0fbb76-928d-4ecd-a81a-17bb09b4ac10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:58.314245 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b0fbb76-928d-4ecd-a81a-17bb09b4ac10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:58.314661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b0fbb76-928d-4ecd-a81a-17bb09b4ac10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:58.344808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6b0fbb76-928d-4ecd-a81a-17bb09b4ac10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045716 Sep 05 17:07:58.345373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 344/676] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:07:58 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:07:59.360285 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b4671a0e-281b-4e9f-932a-5913ea505428 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:07:59.362378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b4671a0e-281b-4e9f-932a-5913ea505428 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:07:59.369326 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4671a0e-281b-4e9f-932a-5913ea505428 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:59.369805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4671a0e-281b-4e9f-932a-5913ea505428 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:59.370227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4671a0e-281b-4e9f-932a-5913ea505428 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:59.371016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4671a0e-281b-4e9f-932a-5913ea505428 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:07:59.371467 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4671a0e-281b-4e9f-932a-5913ea505428 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:07:59.371880 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4671a0e-281b-4e9f-932a-5913ea505428 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:07:59.405300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b4671a0e-281b-4e9f-932a-5913ea505428 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048964 Sep 05 17:07:59.405979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 333/677] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:07:59 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:00.418590 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d07902be-e393-43c6-8f11-8f0837060823 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:00.420781 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d07902be-e393-43c6-8f11-8f0837060823 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:00.427744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d07902be-e393-43c6-8f11-8f0837060823 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:00.428233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d07902be-e393-43c6-8f11-8f0837060823 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:00.428663 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d07902be-e393-43c6-8f11-8f0837060823 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:00.429411 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d07902be-e393-43c6-8f11-8f0837060823 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:00.429862 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d07902be-e393-43c6-8f11-8f0837060823 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:00.430274 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d07902be-e393-43c6-8f11-8f0837060823 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:00.462868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d07902be-e393-43c6-8f11-8f0837060823 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048270 Sep 05 17:08:00.463453 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 345/678] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:00 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:01.479819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-91527c51-7fa9-494e-8d61-34b1dc59ead7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:01.482981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-91527c51-7fa9-494e-8d61-34b1dc59ead7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:01.492437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91527c51-7fa9-494e-8d61-34b1dc59ead7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:01.493023 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91527c51-7fa9-494e-8d61-34b1dc59ead7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:01.493540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91527c51-7fa9-494e-8d61-34b1dc59ead7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:01.494230 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91527c51-7fa9-494e-8d61-34b1dc59ead7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:01.494671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91527c51-7fa9-494e-8d61-34b1dc59ead7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:01.495055 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91527c51-7fa9-494e-8d61-34b1dc59ead7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:01.525045 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-91527c51-7fa9-494e-8d61-34b1dc59ead7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051786 Sep 05 17:08:01.525590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 334/679] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:01 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:02.540501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a6f7e087-51e8-4e3f-a19e-5c9a2a4e8bc7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:02.542513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a6f7e087-51e8-4e3f-a19e-5c9a2a4e8bc7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:02.549057 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a6f7e087-51e8-4e3f-a19e-5c9a2a4e8bc7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:02.549530 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a6f7e087-51e8-4e3f-a19e-5c9a2a4e8bc7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:02.549950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a6f7e087-51e8-4e3f-a19e-5c9a2a4e8bc7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:02.550629 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a6f7e087-51e8-4e3f-a19e-5c9a2a4e8bc7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:02.551068 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a6f7e087-51e8-4e3f-a19e-5c9a2a4e8bc7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:02.551677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a6f7e087-51e8-4e3f-a19e-5c9a2a4e8bc7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:02.581691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a6f7e087-51e8-4e3f-a19e-5c9a2a4e8bc7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046855 Sep 05 17:08:02.582243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 346/680] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:02 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:03.599084 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-df522410-e362-47eb-ab67-1f01f969a09f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:03.602951 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-df522410-e362-47eb-ab67-1f01f969a09f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:03.613783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df522410-e362-47eb-ab67-1f01f969a09f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:03.614584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df522410-e362-47eb-ab67-1f01f969a09f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:03.615298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df522410-e362-47eb-ab67-1f01f969a09f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:03.616514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df522410-e362-47eb-ab67-1f01f969a09f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:03.617083 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df522410-e362-47eb-ab67-1f01f969a09f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:03.617522 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df522410-e362-47eb-ab67-1f01f969a09f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:03.648938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-df522410-e362-47eb-ab67-1f01f969a09f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056631 Sep 05 17:08:03.649418 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 335/681] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:03 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:04.666890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c8d0a1de-2cc2-4211-9987-c4b4ce97b464 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:04.669003 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c8d0a1de-2cc2-4211-9987-c4b4ce97b464 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:04.675464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8d0a1de-2cc2-4211-9987-c4b4ce97b464 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:04.675945 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8d0a1de-2cc2-4211-9987-c4b4ce97b464 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:04.676410 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8d0a1de-2cc2-4211-9987-c4b4ce97b464 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:04.677091 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8d0a1de-2cc2-4211-9987-c4b4ce97b464 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:04.677541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8d0a1de-2cc2-4211-9987-c4b4ce97b464 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:04.677958 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8d0a1de-2cc2-4211-9987-c4b4ce97b464 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:04.708129 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c8d0a1de-2cc2-4211-9987-c4b4ce97b464 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048629 Sep 05 17:08:04.708717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 347/682] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:04 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:05.726407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bb556a58-1584-475e-a2fb-553967358f2f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:05.729865 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bb556a58-1584-475e-a2fb-553967358f2f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:05.740972 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb556a58-1584-475e-a2fb-553967358f2f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:05.741717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb556a58-1584-475e-a2fb-553967358f2f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:05.742615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb556a58-1584-475e-a2fb-553967358f2f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:05.742979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb556a58-1584-475e-a2fb-553967358f2f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:05.743345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb556a58-1584-475e-a2fb-553967358f2f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:05.743803 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb556a58-1584-475e-a2fb-553967358f2f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:05.774154 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bb556a58-1584-475e-a2fb-553967358f2f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055206 Sep 05 17:08:05.774681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 336/683] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:05 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:06.789400 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4cdf2072-1d86-4971-90fc-a1e6aed5cc60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:06.791966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4cdf2072-1d86-4971-90fc-a1e6aed5cc60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:06.799183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4cdf2072-1d86-4971-90fc-a1e6aed5cc60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:06.799669 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4cdf2072-1d86-4971-90fc-a1e6aed5cc60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:06.800103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4cdf2072-1d86-4971-90fc-a1e6aed5cc60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:06.800825 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4cdf2072-1d86-4971-90fc-a1e6aed5cc60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:06.801279 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4cdf2072-1d86-4971-90fc-a1e6aed5cc60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:06.801718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4cdf2072-1d86-4971-90fc-a1e6aed5cc60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:06.831845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4cdf2072-1d86-4971-90fc-a1e6aed5cc60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048028 Sep 05 17:08:06.832427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 348/684] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:06 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:07.849212 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-913244cb-ff77-49cd-b630-9d3381086f65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:07.853589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-913244cb-ff77-49cd-b630-9d3381086f65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:07.860581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-913244cb-ff77-49cd-b630-9d3381086f65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:07.861059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-913244cb-ff77-49cd-b630-9d3381086f65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:07.861485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-913244cb-ff77-49cd-b630-9d3381086f65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:07.862237 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-913244cb-ff77-49cd-b630-9d3381086f65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:07.862614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-913244cb-ff77-49cd-b630-9d3381086f65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:07.863015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-913244cb-ff77-49cd-b630-9d3381086f65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:07.894397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-913244cb-ff77-49cd-b630-9d3381086f65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051934 Sep 05 17:08:07.894864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 337/685] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:07 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:08.907757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cd7fa67f-3dbc-402a-877b-d6f50e2f9491 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:08.910285 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cd7fa67f-3dbc-402a-877b-d6f50e2f9491 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:08.918362 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd7fa67f-3dbc-402a-877b-d6f50e2f9491 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:08.918887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd7fa67f-3dbc-402a-877b-d6f50e2f9491 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:08.919315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd7fa67f-3dbc-402a-877b-d6f50e2f9491 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:08.920972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd7fa67f-3dbc-402a-877b-d6f50e2f9491 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:08.921441 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd7fa67f-3dbc-402a-877b-d6f50e2f9491 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:08.922009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd7fa67f-3dbc-402a-877b-d6f50e2f9491 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:08.968983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cd7fa67f-3dbc-402a-877b-d6f50e2f9491 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065758 Sep 05 17:08:08.969635 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 349/686] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:08 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:09.982637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-362040d7-a936-4571-b7de-505d060e017b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:09.984982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-362040d7-a936-4571-b7de-505d060e017b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:09.991563 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-362040d7-a936-4571-b7de-505d060e017b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:09.992119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-362040d7-a936-4571-b7de-505d060e017b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:09.992648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-362040d7-a936-4571-b7de-505d060e017b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:09.993507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-362040d7-a936-4571-b7de-505d060e017b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:09.994059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-362040d7-a936-4571-b7de-505d060e017b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:09.994560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-362040d7-a936-4571-b7de-505d060e017b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:10.024738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-362040d7-a936-4571-b7de-505d060e017b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046235 Sep 05 17:08:10.025521 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 338/687] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:09 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:10.759004 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-31bd39cc-0488-4fd4-95f3-fba59317a59e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:10.760008 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-31bd39cc-0488-4fd4-95f3-fba59317a59e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:10.766960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-31bd39cc-0488-4fd4-95f3-fba59317a59e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:10.767682 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-31bd39cc-0488-4fd4-95f3-fba59317a59e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:10.768202 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-31bd39cc-0488-4fd4-95f3-fba59317a59e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:10.768970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-31bd39cc-0488-4fd4-95f3-fba59317a59e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:10.769424 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-31bd39cc-0488-4fd4-95f3-fba59317a59e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:10.769842 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-31bd39cc-0488-4fd4-95f3-fba59317a59e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:10.907145 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-31bd39cc-0488-4fd4-95f3-fba59317a59e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:08:10.916355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-31bd39cc-0488-4fd4-95f3-fba59317a59e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1593 microversion: 2.1 time: 0.160853 Sep 05 17:08:10.917484 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 350/688] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:08:10 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:08:11.037140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-86788d99-1e0e-4306-8078-3fa6a396c649 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:11.039300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-86788d99-1e0e-4306-8078-3fa6a396c649 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:11.045963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86788d99-1e0e-4306-8078-3fa6a396c649 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:11.046442 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86788d99-1e0e-4306-8078-3fa6a396c649 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:11.046866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86788d99-1e0e-4306-8078-3fa6a396c649 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:11.047589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86788d99-1e0e-4306-8078-3fa6a396c649 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:11.048034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86788d99-1e0e-4306-8078-3fa6a396c649 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:11.048485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86788d99-1e0e-4306-8078-3fa6a396c649 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:11.079372 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-86788d99-1e0e-4306-8078-3fa6a396c649 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046201 Sep 05 17:08:11.079933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 339/689] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:11 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:12.091441 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4083cd9e-9997-4011-acc8-a6d284df10f0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:12.093625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4083cd9e-9997-4011-acc8-a6d284df10f0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:12.100102 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4083cd9e-9997-4011-acc8-a6d284df10f0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:12.100931 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4083cd9e-9997-4011-acc8-a6d284df10f0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:12.101366 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4083cd9e-9997-4011-acc8-a6d284df10f0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:12.102077 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4083cd9e-9997-4011-acc8-a6d284df10f0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:12.102468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4083cd9e-9997-4011-acc8-a6d284df10f0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:12.102882 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4083cd9e-9997-4011-acc8-a6d284df10f0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:12.133945 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4083cd9e-9997-4011-acc8-a6d284df10f0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046699 Sep 05 17:08:12.134759 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 351/690] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:12 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:12.739091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-c49ad4c8-c5a6-4167-9a20-7d608034609b req-12501269-36e0-46e5-85d6-288569cbc88c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8c420ca-19c4-4f51-8091-e83672ea54ca", "tag": "6e894232-478f-47a6-86f4-399c64bf7399"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:08:12.748980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-c49ad4c8-c5a6-4167-9a20-7d608034609b req-12501269-36e0-46e5-85d6-288569cbc88c service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:12.749539 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-c49ad4c8-c5a6-4167-9a20-7d608034609b req-12501269-36e0-46e5-85d6-288569cbc88c service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:12.750056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-c49ad4c8-c5a6-4167-9a20-7d608034609b req-12501269-36e0-46e5-85d6-288569cbc88c service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:12.762800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-c49ad4c8-c5a6-4167-9a20-7d608034609b req-12501269-36e0-46e5-85d6-288569cbc88c service nova] Creating event network-changed:6e894232-478f-47a6-86f4-399c64bf7399 for instance c8c420ca-19c4-4f51-8091-e83672ea54ca on hv-cinder-85596 Sep 05 17:08:12.769287 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-c49ad4c8-c5a6-4167-9a20-7d608034609b req-12501269-36e0-46e5-85d6-288569cbc88c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101655 Sep 05 17:08:12.770819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 340/691] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:08:13.150143 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3da88ef8-0210-4d69-88b2-57bd4e192aeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:13.153910 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3da88ef8-0210-4d69-88b2-57bd4e192aeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:13.160608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3da88ef8-0210-4d69-88b2-57bd4e192aeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:13.161229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3da88ef8-0210-4d69-88b2-57bd4e192aeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:13.161753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3da88ef8-0210-4d69-88b2-57bd4e192aeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:13.162547 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3da88ef8-0210-4d69-88b2-57bd4e192aeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:13.163108 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3da88ef8-0210-4d69-88b2-57bd4e192aeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:13.163614 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3da88ef8-0210-4d69-88b2-57bd4e192aeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:13.201552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3da88ef8-0210-4d69-88b2-57bd4e192aeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058500 Sep 05 17:08:13.202846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 352/692] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:13 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:13.875697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e92ad849-f95b-4f06-84df-b307a46f9a47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-168104660"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:08:13.876434 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e92ad849-f95b-4f06-84df-b307a46f9a47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:13.883230 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e92ad849-f95b-4f06-84df-b307a46f9a47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:13.883692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e92ad849-f95b-4f06-84df-b307a46f9a47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:13.884113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e92ad849-f95b-4f06-84df-b307a46f9a47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:13.885096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e92ad849-f95b-4f06-84df-b307a46f9a47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:13.885570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e92ad849-f95b-4f06-84df-b307a46f9a47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:13.886008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e92ad849-f95b-4f06-84df-b307a46f9a47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:14.026231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.network.security_group_api [None req-e92ad849-f95b-4f06-84df-b307a46f9a47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Adding security group 17fa69dc-8629-4fab-ab0f-2a5f9e8fb719 to port 6e894232-478f-47a6-86f4-399c64bf7399 Sep 05 17:08:14.215141 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d2421a53-9b6b-4564-9535-93a4ab0579b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:14.217243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d2421a53-9b6b-4564-9535-93a4ab0579b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:14.224125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2421a53-9b6b-4564-9535-93a4ab0579b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:14.224638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2421a53-9b6b-4564-9535-93a4ab0579b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:14.225031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2421a53-9b6b-4564-9535-93a4ab0579b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:14.226079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2421a53-9b6b-4564-9535-93a4ab0579b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:14.226542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2421a53-9b6b-4564-9535-93a4ab0579b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:14.227260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2421a53-9b6b-4564-9535-93a4ab0579b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:14.260171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d2421a53-9b6b-4564-9535-93a4ab0579b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049179 Sep 05 17:08:14.260748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 353/693] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:14 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:14.396129 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e92ad849-f95b-4f06-84df-b307a46f9a47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "POST /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/action" status: 202 len: 0 microversion: 2.1 time: 0.525032 Sep 05 17:08:14.396968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 341/694] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Sep 5 17:08:13 2022] POST /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:08:14.410832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b8877bef-2cb2-40bd-86cd-efa523273c52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:14.411246 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b8877bef-2cb2-40bd-86cd-efa523273c52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:14.417683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b8877bef-2cb2-40bd-86cd-efa523273c52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:14.418405 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b8877bef-2cb2-40bd-86cd-efa523273c52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:14.418982 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b8877bef-2cb2-40bd-86cd-efa523273c52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:14.420882 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b8877bef-2cb2-40bd-86cd-efa523273c52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:14.421557 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b8877bef-2cb2-40bd-86cd-efa523273c52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:14.422126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b8877bef-2cb2-40bd-86cd-efa523273c52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:14.497296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-81e1a607-12dc-4ce7-8bf5-ab36446fb7bb req-edcc73e2-17f0-41b5-af6f-b14f17d5b95b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8c420ca-19c4-4f51-8091-e83672ea54ca", "tag": "6e894232-478f-47a6-86f4-399c64bf7399"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:08:14.510196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-81e1a607-12dc-4ce7-8bf5-ab36446fb7bb req-edcc73e2-17f0-41b5-af6f-b14f17d5b95b service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:14.510907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-81e1a607-12dc-4ce7-8bf5-ab36446fb7bb req-edcc73e2-17f0-41b5-af6f-b14f17d5b95b service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:14.511515 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-81e1a607-12dc-4ce7-8bf5-ab36446fb7bb req-edcc73e2-17f0-41b5-af6f-b14f17d5b95b service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:14.524078 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-81e1a607-12dc-4ce7-8bf5-ab36446fb7bb req-edcc73e2-17f0-41b5-af6f-b14f17d5b95b service nova] Creating event network-changed:6e894232-478f-47a6-86f4-399c64bf7399 for instance c8c420ca-19c4-4f51-8091-e83672ea54ca on hv-cinder-85596 Sep 05 17:08:14.533462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-81e1a607-12dc-4ce7-8bf5-ab36446fb7bb req-edcc73e2-17f0-41b5-af6f-b14f17d5b95b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128181 Sep 05 17:08:14.534223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 342/695] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:08:14.594719 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b8877bef-2cb2-40bd-86cd-efa523273c52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:08:14.604211 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b8877bef-2cb2-40bd-86cd-efa523273c52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1757 microversion: 2.1 time: 0.202790 Sep 05 17:08:14.605057 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 354/696] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:08:14 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1757 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:08:15.279078 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-37105b5d-4303-47f4-99e0-2bc3286b1e4c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:15.282543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-37105b5d-4303-47f4-99e0-2bc3286b1e4c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:15.292953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37105b5d-4303-47f4-99e0-2bc3286b1e4c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:15.293619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37105b5d-4303-47f4-99e0-2bc3286b1e4c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:15.294207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37105b5d-4303-47f4-99e0-2bc3286b1e4c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:15.295234 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37105b5d-4303-47f4-99e0-2bc3286b1e4c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:15.295779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37105b5d-4303-47f4-99e0-2bc3286b1e4c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:15.296291 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37105b5d-4303-47f4-99e0-2bc3286b1e4c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:15.334437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-37105b5d-4303-47f4-99e0-2bc3286b1e4c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063753 Sep 05 17:08:15.334985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 343/697] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:15 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:16.351745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-869fe43d-8638-4582-8fdc-5d14c56d78b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:16.355779 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-869fe43d-8638-4582-8fdc-5d14c56d78b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:16.366614 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-869fe43d-8638-4582-8fdc-5d14c56d78b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:16.367409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-869fe43d-8638-4582-8fdc-5d14c56d78b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:16.368125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-869fe43d-8638-4582-8fdc-5d14c56d78b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:16.369853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-869fe43d-8638-4582-8fdc-5d14c56d78b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:16.370013 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-869fe43d-8638-4582-8fdc-5d14c56d78b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:16.370382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-869fe43d-8638-4582-8fdc-5d14c56d78b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:16.401418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-869fe43d-8638-4582-8fdc-5d14c56d78b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056717 Sep 05 17:08:16.401976 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 355/698] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:16 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:17.417221 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-666c5c40-6f79-4a62-acc6-d1054dcb22ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:17.419507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-666c5c40-6f79-4a62-acc6-d1054dcb22ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:17.426880 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-666c5c40-6f79-4a62-acc6-d1054dcb22ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:17.427412 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-666c5c40-6f79-4a62-acc6-d1054dcb22ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:17.427894 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-666c5c40-6f79-4a62-acc6-d1054dcb22ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:17.428714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-666c5c40-6f79-4a62-acc6-d1054dcb22ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:17.429211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-666c5c40-6f79-4a62-acc6-d1054dcb22ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:17.429689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-666c5c40-6f79-4a62-acc6-d1054dcb22ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:17.460864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-666c5c40-6f79-4a62-acc6-d1054dcb22ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049365 Sep 05 17:08:17.461345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 344/699] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:17 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:18.478759 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cc83a427-ca4d-45ce-a12e-bb7cbf91c3e3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:18.482381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cc83a427-ca4d-45ce-a12e-bb7cbf91c3e3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:18.493333 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc83a427-ca4d-45ce-a12e-bb7cbf91c3e3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:18.494127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc83a427-ca4d-45ce-a12e-bb7cbf91c3e3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:18.494705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc83a427-ca4d-45ce-a12e-bb7cbf91c3e3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:18.495413 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc83a427-ca4d-45ce-a12e-bb7cbf91c3e3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:18.495990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc83a427-ca4d-45ce-a12e-bb7cbf91c3e3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:18.496433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc83a427-ca4d-45ce-a12e-bb7cbf91c3e3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:18.526756 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cc83a427-ca4d-45ce-a12e-bb7cbf91c3e3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055406 Sep 05 17:08:18.527283 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 356/700] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:18 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:19.542627 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c4d45308-5afd-40cf-a865-014cd0c08e1e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:19.544693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c4d45308-5afd-40cf-a865-014cd0c08e1e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:19.551159 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4d45308-5afd-40cf-a865-014cd0c08e1e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:19.551636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4d45308-5afd-40cf-a865-014cd0c08e1e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:19.552057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4d45308-5afd-40cf-a865-014cd0c08e1e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:19.552775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4d45308-5afd-40cf-a865-014cd0c08e1e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:19.553210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4d45308-5afd-40cf-a865-014cd0c08e1e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:19.553628 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4d45308-5afd-40cf-a865-014cd0c08e1e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:19.583426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c4d45308-5afd-40cf-a865-014cd0c08e1e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047429 Sep 05 17:08:19.583952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 345/701] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:19 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:20.600200 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f0034c22-4c63-4778-84a0-75f6e4a15595 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:20.603951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f0034c22-4c63-4778-84a0-75f6e4a15595 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:20.611584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0034c22-4c63-4778-84a0-75f6e4a15595 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:20.612062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0034c22-4c63-4778-84a0-75f6e4a15595 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:20.612524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0034c22-4c63-4778-84a0-75f6e4a15595 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:20.613198 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0034c22-4c63-4778-84a0-75f6e4a15595 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:20.613640 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0034c22-4c63-4778-84a0-75f6e4a15595 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:20.614077 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0034c22-4c63-4778-84a0-75f6e4a15595 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:20.644031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f0034c22-4c63-4778-84a0-75f6e4a15595 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050662 Sep 05 17:08:20.644623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 357/702] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:20 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:21.657220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e96e59b8-fd88-4622-94b2-8200f26ce1aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:21.659399 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e96e59b8-fd88-4622-94b2-8200f26ce1aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:21.666235 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e96e59b8-fd88-4622-94b2-8200f26ce1aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:21.666772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e96e59b8-fd88-4622-94b2-8200f26ce1aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:21.667213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e96e59b8-fd88-4622-94b2-8200f26ce1aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:21.668138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e96e59b8-fd88-4622-94b2-8200f26ce1aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:21.668606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e96e59b8-fd88-4622-94b2-8200f26ce1aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:21.669022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e96e59b8-fd88-4622-94b2-8200f26ce1aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:21.699221 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e96e59b8-fd88-4622-94b2-8200f26ce1aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046031 Sep 05 17:08:21.699776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 346/703] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:21 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:22.716411 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-015edb3c-5ab4-4066-aff7-8ee8cf370af8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:22.719876 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-015edb3c-5ab4-4066-aff7-8ee8cf370af8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:22.730437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-015edb3c-5ab4-4066-aff7-8ee8cf370af8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:22.730912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-015edb3c-5ab4-4066-aff7-8ee8cf370af8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:22.731389 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-015edb3c-5ab4-4066-aff7-8ee8cf370af8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:22.732180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-015edb3c-5ab4-4066-aff7-8ee8cf370af8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:22.732637 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-015edb3c-5ab4-4066-aff7-8ee8cf370af8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:22.733052 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-015edb3c-5ab4-4066-aff7-8ee8cf370af8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:22.751174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:08:22.764478 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-015edb3c-5ab4-4066-aff7-8ee8cf370af8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054825 Sep 05 17:08:22.765040 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 358/704] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:22 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:23.780998 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-71310603-16db-4838-9cb0-e17a17cee903 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:23.783749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-71310603-16db-4838-9cb0-e17a17cee903 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:23.786628 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:08:23.786867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:08:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments (ip 10.222.0.23) !!! Sep 05 17:08:23.795987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71310603-16db-4838-9cb0-e17a17cee903 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:23.796623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71310603-16db-4838-9cb0-e17a17cee903 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:23.797160 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71310603-16db-4838-9cb0-e17a17cee903 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:23.797994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71310603-16db-4838-9cb0-e17a17cee903 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:23.798559 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71310603-16db-4838-9cb0-e17a17cee903 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:23.799075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71310603-16db-4838-9cb0-e17a17cee903 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:23.830831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-71310603-16db-4838-9cb0-e17a17cee903 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055708 Sep 05 17:08:23.831399 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 347/705] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:23 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:24.847934 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-58f96370-2961-4f59-bc4e-57f2bc150be5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:24.851656 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-58f96370-2961-4f59-bc4e-57f2bc150be5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:24.859794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58f96370-2961-4f59-bc4e-57f2bc150be5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:24.860311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58f96370-2961-4f59-bc4e-57f2bc150be5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:24.860742 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58f96370-2961-4f59-bc4e-57f2bc150be5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:24.861432 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58f96370-2961-4f59-bc4e-57f2bc150be5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:24.861879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58f96370-2961-4f59-bc4e-57f2bc150be5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:24.862298 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58f96370-2961-4f59-bc4e-57f2bc150be5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:24.891549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-58f96370-2961-4f59-bc4e-57f2bc150be5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050466 Sep 05 17:08:24.892101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 359/706] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:24 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:25.910279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6e6324f5-310e-41ed-b330-7a749ab7d989 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:25.913757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6e6324f5-310e-41ed-b330-7a749ab7d989 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:25.917424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=35 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:08:25.929401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e6324f5-310e-41ed-b330-7a749ab7d989 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:25.930201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e6324f5-310e-41ed-b330-7a749ab7d989 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:25.930925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e6324f5-310e-41ed-b330-7a749ab7d989 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:25.932073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e6324f5-310e-41ed-b330-7a749ab7d989 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:25.932877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e6324f5-310e-41ed-b330-7a749ab7d989 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:25.934173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e6324f5-310e-41ed-b330-7a749ab7d989 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:25.938100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:08:25.966422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6e6324f5-310e-41ed-b330-7a749ab7d989 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064360 Sep 05 17:08:25.967020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 348/707] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:25 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:26.987015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-49af97a0-3fc7-42d8-9edb-9dbc7d8f2d9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:26.990404 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-49af97a0-3fc7-42d8-9edb-9dbc7d8f2d9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:26.994230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=37 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:08:27.001691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49af97a0-3fc7-42d8-9edb-9dbc7d8f2d9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:27.002325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49af97a0-3fc7-42d8-9edb-9dbc7d8f2d9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:27.002898 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49af97a0-3fc7-42d8-9edb-9dbc7d8f2d9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:27.003810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49af97a0-3fc7-42d8-9edb-9dbc7d8f2d9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:27.004480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49af97a0-3fc7-42d8-9edb-9dbc7d8f2d9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:27.005042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49af97a0-3fc7-42d8-9edb-9dbc7d8f2d9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:27.037295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-49af97a0-3fc7-42d8-9edb-9dbc7d8f2d9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057414 Sep 05 17:08:27.038250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 360/708] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:26 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:28.057248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a2bb7fa5-1697-4dde-8f46-4a732bf2d69d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:28.061350 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a2bb7fa5-1697-4dde-8f46-4a732bf2d69d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:28.071466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2bb7fa5-1697-4dde-8f46-4a732bf2d69d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:28.072303 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2bb7fa5-1697-4dde-8f46-4a732bf2d69d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:28.073019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2bb7fa5-1697-4dde-8f46-4a732bf2d69d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:28.074257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2bb7fa5-1697-4dde-8f46-4a732bf2d69d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:28.075008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2bb7fa5-1697-4dde-8f46-4a732bf2d69d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:28.075412 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2bb7fa5-1697-4dde-8f46-4a732bf2d69d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:28.107056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a2bb7fa5-1697-4dde-8f46-4a732bf2d69d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057046 Sep 05 17:08:28.107617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 349/709] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:28 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 17:08:29.123268 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a26f1f7b-0205-4f71-9af1-c4d35805d277 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:29.125620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a26f1f7b-0205-4f71-9af1-c4d35805d277 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:29.132899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a26f1f7b-0205-4f71-9af1-c4d35805d277 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:29.133445 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a26f1f7b-0205-4f71-9af1-c4d35805d277 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:29.133899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a26f1f7b-0205-4f71-9af1-c4d35805d277 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:29.134630 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a26f1f7b-0205-4f71-9af1-c4d35805d277 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:29.135108 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a26f1f7b-0205-4f71-9af1-c4d35805d277 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:29.135549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a26f1f7b-0205-4f71-9af1-c4d35805d277 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:29.167078 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a26f1f7b-0205-4f71-9af1-c4d35805d277 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049605 Sep 05 17:08:29.168137 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 361/710] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:29 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:30.184553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-795bf731-9266-4092-962f-b0f4a6b20f49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:30.188221 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-795bf731-9266-4092-962f-b0f4a6b20f49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:30.199324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-795bf731-9266-4092-962f-b0f4a6b20f49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:30.199902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-795bf731-9266-4092-962f-b0f4a6b20f49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:30.200388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-795bf731-9266-4092-962f-b0f4a6b20f49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:30.201068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-795bf731-9266-4092-962f-b0f4a6b20f49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:30.201536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-795bf731-9266-4092-962f-b0f4a6b20f49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:30.201948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-795bf731-9266-4092-962f-b0f4a6b20f49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:30.233616 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-795bf731-9266-4092-962f-b0f4a6b20f49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056255 Sep 05 17:08:30.234159 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 350/711] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:30 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:31.249607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-bbe560c3-b3f1-4895-ae85-8beb742a2db7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:31.252045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-bbe560c3-b3f1-4895-ae85-8beb742a2db7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:31.259512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bbe560c3-b3f1-4895-ae85-8beb742a2db7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:31.260045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bbe560c3-b3f1-4895-ae85-8beb742a2db7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:31.260560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bbe560c3-b3f1-4895-ae85-8beb742a2db7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:31.261319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bbe560c3-b3f1-4895-ae85-8beb742a2db7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:31.261813 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bbe560c3-b3f1-4895-ae85-8beb742a2db7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:31.262255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bbe560c3-b3f1-4895-ae85-8beb742a2db7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:31.294675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-bbe560c3-b3f1-4895-ae85-8beb742a2db7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051143 Sep 05 17:08:31.295259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 362/712] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:31 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:32.307367 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c495abf8-a840-486a-b1d2-b0c98de66571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:32.309537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c495abf8-a840-486a-b1d2-b0c98de66571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:32.316205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c495abf8-a840-486a-b1d2-b0c98de66571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:32.316714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c495abf8-a840-486a-b1d2-b0c98de66571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:32.317143 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c495abf8-a840-486a-b1d2-b0c98de66571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:32.317833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c495abf8-a840-486a-b1d2-b0c98de66571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:32.318285 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c495abf8-a840-486a-b1d2-b0c98de66571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:32.318707 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c495abf8-a840-486a-b1d2-b0c98de66571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:32.347607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c495abf8-a840-486a-b1d2-b0c98de66571 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044345 Sep 05 17:08:32.348171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 351/713] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:32 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:33.365886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3373725b-2d11-4e4b-a1b4-875e5b0368dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:33.370020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3373725b-2d11-4e4b-a1b4-875e5b0368dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:33.378232 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3373725b-2d11-4e4b-a1b4-875e5b0368dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:33.378743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3373725b-2d11-4e4b-a1b4-875e5b0368dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:33.379168 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3373725b-2d11-4e4b-a1b4-875e5b0368dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:33.379844 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3373725b-2d11-4e4b-a1b4-875e5b0368dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:33.380323 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3373725b-2d11-4e4b-a1b4-875e5b0368dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:33.380767 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3373725b-2d11-4e4b-a1b4-875e5b0368dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:33.410588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3373725b-2d11-4e4b-a1b4-875e5b0368dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051566 Sep 05 17:08:33.411154 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 363/714] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:33 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:34.424578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e38c31ee-a6a5-4a5c-91f5-7f1d8030f689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:34.426713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e38c31ee-a6a5-4a5c-91f5-7f1d8030f689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:34.433607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e38c31ee-a6a5-4a5c-91f5-7f1d8030f689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:34.434089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e38c31ee-a6a5-4a5c-91f5-7f1d8030f689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:34.434525 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e38c31ee-a6a5-4a5c-91f5-7f1d8030f689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:34.435222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e38c31ee-a6a5-4a5c-91f5-7f1d8030f689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:34.435672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e38c31ee-a6a5-4a5c-91f5-7f1d8030f689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:34.436093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e38c31ee-a6a5-4a5c-91f5-7f1d8030f689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:34.466312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e38c31ee-a6a5-4a5c-91f5-7f1d8030f689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045913 Sep 05 17:08:34.467075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 352/715] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:34 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:35.483518 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-71622009-c8e9-4259-97e5-70cdfbabe0a6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:35.485694 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-71622009-c8e9-4259-97e5-70cdfbabe0a6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:35.492583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71622009-c8e9-4259-97e5-70cdfbabe0a6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:35.493068 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71622009-c8e9-4259-97e5-70cdfbabe0a6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:35.493527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71622009-c8e9-4259-97e5-70cdfbabe0a6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:35.494216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71622009-c8e9-4259-97e5-70cdfbabe0a6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:35.494667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71622009-c8e9-4259-97e5-70cdfbabe0a6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:35.495083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71622009-c8e9-4259-97e5-70cdfbabe0a6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:35.529051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-71622009-c8e9-4259-97e5-70cdfbabe0a6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051458 Sep 05 17:08:35.529614 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 364/716] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:35 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:36.542209 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7c725a00-de15-441e-a556-2c7b0082e945 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:36.544510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7c725a00-de15-441e-a556-2c7b0082e945 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:36.551232 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c725a00-de15-441e-a556-2c7b0082e945 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:36.551718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c725a00-de15-441e-a556-2c7b0082e945 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:36.552165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c725a00-de15-441e-a556-2c7b0082e945 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:36.552874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c725a00-de15-441e-a556-2c7b0082e945 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:36.553424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c725a00-de15-441e-a556-2c7b0082e945 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:36.553851 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c725a00-de15-441e-a556-2c7b0082e945 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:36.584998 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7c725a00-de15-441e-a556-2c7b0082e945 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047026 Sep 05 17:08:36.585569 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 353/717] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:36 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:37.602754 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4e952a86-e73e-40db-81c5-63a72b3eb8d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:37.606140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4e952a86-e73e-40db-81c5-63a72b3eb8d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:37.614179 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e952a86-e73e-40db-81c5-63a72b3eb8d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:37.614662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e952a86-e73e-40db-81c5-63a72b3eb8d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:37.615090 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e952a86-e73e-40db-81c5-63a72b3eb8d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:37.615780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e952a86-e73e-40db-81c5-63a72b3eb8d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:37.616262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e952a86-e73e-40db-81c5-63a72b3eb8d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:37.616681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e952a86-e73e-40db-81c5-63a72b3eb8d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:37.646147 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4e952a86-e73e-40db-81c5-63a72b3eb8d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050673 Sep 05 17:08:37.646704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 365/718] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:37 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:38.660751 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7a54e4f5-5b6b-4ffa-801e-eca86da2372c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:38.662900 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7a54e4f5-5b6b-4ffa-801e-eca86da2372c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:38.669840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a54e4f5-5b6b-4ffa-801e-eca86da2372c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:38.670293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a54e4f5-5b6b-4ffa-801e-eca86da2372c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:38.670719 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a54e4f5-5b6b-4ffa-801e-eca86da2372c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:38.671413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a54e4f5-5b6b-4ffa-801e-eca86da2372c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:38.671852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a54e4f5-5b6b-4ffa-801e-eca86da2372c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:38.672303 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a54e4f5-5b6b-4ffa-801e-eca86da2372c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:38.674078 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7ee65b0d-0ed9-43be-9f03-38f39687f216 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:08:38.676336 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7ee65b0d-0ed9-43be-9f03-38f39687f216 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:38.683246 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ee65b0d-0ed9-43be-9f03-38f39687f216 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:38.683725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ee65b0d-0ed9-43be-9f03-38f39687f216 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:38.684172 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ee65b0d-0ed9-43be-9f03-38f39687f216 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:38.684877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ee65b0d-0ed9-43be-9f03-38f39687f216 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:38.685328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ee65b0d-0ed9-43be-9f03-38f39687f216 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:38.685747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ee65b0d-0ed9-43be-9f03-38f39687f216 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:38.703690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7a54e4f5-5b6b-4ffa-801e-eca86da2372c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048049 Sep 05 17:08:38.704479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 354/719] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:38 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:38.765783 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7ee65b0d-0ed9-43be-9f03-38f39687f216 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "POST /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/action" status: 202 len: 0 microversion: 2.1 time: 0.095577 Sep 05 17:08:38.766399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 366/720] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Sep 5 17:08:38 2022] POST /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:08:38.775965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ea38c639-4b69-4dca-bf32-33f9039233f6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:38.776708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ea38c639-4b69-4dca-bf32-33f9039233f6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:38.783704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea38c639-4b69-4dca-bf32-33f9039233f6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:38.784376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea38c639-4b69-4dca-bf32-33f9039233f6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:38.784858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea38c639-4b69-4dca-bf32-33f9039233f6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:38.785673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea38c639-4b69-4dca-bf32-33f9039233f6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:38.786127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea38c639-4b69-4dca-bf32-33f9039233f6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:38.786541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea38c639-4b69-4dca-bf32-33f9039233f6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:38.939194 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ea38c639-4b69-4dca-bf32-33f9039233f6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:08:38.948019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ea38c639-4b69-4dca-bf32-33f9039233f6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1749 microversion: 2.1 time: 0.175917 Sep 05 17:08:38.948889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 355/721] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:08:38 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:08:39.721782 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a5d4a95c-85ed-4d88-9b48-5cad3a5b6d06 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:39.725856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a5d4a95c-85ed-4d88-9b48-5cad3a5b6d06 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:39.737118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5d4a95c-85ed-4d88-9b48-5cad3a5b6d06 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:39.737597 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5d4a95c-85ed-4d88-9b48-5cad3a5b6d06 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:39.738016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5d4a95c-85ed-4d88-9b48-5cad3a5b6d06 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:39.738675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5d4a95c-85ed-4d88-9b48-5cad3a5b6d06 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:39.739148 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5d4a95c-85ed-4d88-9b48-5cad3a5b6d06 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:39.739556 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5d4a95c-85ed-4d88-9b48-5cad3a5b6d06 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:39.774466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a5d4a95c-85ed-4d88-9b48-5cad3a5b6d06 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060072 Sep 05 17:08:39.775036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 367/722] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:39 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:39.973398 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a4207aab-8433-4418-ad75-f1fd4dd235a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:39.973957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a4207aab-8433-4418-ad75-f1fd4dd235a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:39.981135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4207aab-8433-4418-ad75-f1fd4dd235a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:39.981891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4207aab-8433-4418-ad75-f1fd4dd235a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:39.982323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4207aab-8433-4418-ad75-f1fd4dd235a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:39.983045 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4207aab-8433-4418-ad75-f1fd4dd235a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:39.983483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4207aab-8433-4418-ad75-f1fd4dd235a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:39.983901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4207aab-8433-4418-ad75-f1fd4dd235a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:40.134157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a4207aab-8433-4418-ad75-f1fd4dd235a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:08:40.142854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a4207aab-8433-4418-ad75-f1fd4dd235a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1754 microversion: 2.1 time: 0.173836 Sep 05 17:08:40.143647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 356/723] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:08:39 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:08:40.788550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-04e75d13-e1cb-46d4-a085-651c4fcada58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:40.790705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-04e75d13-e1cb-46d4-a085-651c4fcada58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:40.797295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04e75d13-e1cb-46d4-a085-651c4fcada58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:40.797773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04e75d13-e1cb-46d4-a085-651c4fcada58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:40.798204 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04e75d13-e1cb-46d4-a085-651c4fcada58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:40.798883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04e75d13-e1cb-46d4-a085-651c4fcada58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:40.799327 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04e75d13-e1cb-46d4-a085-651c4fcada58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:40.799758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04e75d13-e1cb-46d4-a085-651c4fcada58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:40.829173 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-04e75d13-e1cb-46d4-a085-651c4fcada58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045544 Sep 05 17:08:40.829725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 368/724] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:40 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:41.171062 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6d847964-05c0-4f91-9917-ff86f875cb61 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:41.171947 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6d847964-05c0-4f91-9917-ff86f875cb61 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:41.180706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d847964-05c0-4f91-9917-ff86f875cb61 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:41.181192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d847964-05c0-4f91-9917-ff86f875cb61 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:41.181622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d847964-05c0-4f91-9917-ff86f875cb61 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:41.182315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d847964-05c0-4f91-9917-ff86f875cb61 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:41.182765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d847964-05c0-4f91-9917-ff86f875cb61 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:41.183187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d847964-05c0-4f91-9917-ff86f875cb61 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:41.351805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6d847964-05c0-4f91-9917-ff86f875cb61 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:08:41.360198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6d847964-05c0-4f91-9917-ff86f875cb61 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1754 microversion: 2.1 time: 0.196023 Sep 05 17:08:41.360798 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 357/725] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:08:41 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1754 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:08:41.846703 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-60ccac17-f6f1-4186-a946-80eed001325e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:41.850316 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-60ccac17-f6f1-4186-a946-80eed001325e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:41.861722 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60ccac17-f6f1-4186-a946-80eed001325e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:41.862488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60ccac17-f6f1-4186-a946-80eed001325e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:41.863228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60ccac17-f6f1-4186-a946-80eed001325e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:41.864452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60ccac17-f6f1-4186-a946-80eed001325e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:41.864928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60ccac17-f6f1-4186-a946-80eed001325e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:41.865370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60ccac17-f6f1-4186-a946-80eed001325e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:41.896551 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-60ccac17-f6f1-4186-a946-80eed001325e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056795 Sep 05 17:08:41.897103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 369/726] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:41 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:42.385481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-acfde758-a183-45f6-b89a-6721711cec86 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:42.386124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-acfde758-a183-45f6-b89a-6721711cec86 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:42.393010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acfde758-a183-45f6-b89a-6721711cec86 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:42.393493 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acfde758-a183-45f6-b89a-6721711cec86 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:42.393925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acfde758-a183-45f6-b89a-6721711cec86 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:42.394613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acfde758-a183-45f6-b89a-6721711cec86 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:42.395059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acfde758-a183-45f6-b89a-6721711cec86 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:42.395526 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acfde758-a183-45f6-b89a-6721711cec86 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:42.551432 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-acfde758-a183-45f6-b89a-6721711cec86 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:08:42.559666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-acfde758-a183-45f6-b89a-6721711cec86 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1754 microversion: 2.1 time: 0.178212 Sep 05 17:08:42.560423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 358/727] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:08:42 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:08:42.912754 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f97a3dbf-485d-446d-ae94-82ecc479ac59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:42.915081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f97a3dbf-485d-446d-ae94-82ecc479ac59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:42.921805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97a3dbf-485d-446d-ae94-82ecc479ac59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:42.922306 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97a3dbf-485d-446d-ae94-82ecc479ac59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:42.922753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97a3dbf-485d-446d-ae94-82ecc479ac59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:42.923465 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97a3dbf-485d-446d-ae94-82ecc479ac59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:42.923934 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97a3dbf-485d-446d-ae94-82ecc479ac59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:42.924391 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f97a3dbf-485d-446d-ae94-82ecc479ac59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:42.955294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f97a3dbf-485d-446d-ae94-82ecc479ac59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048591 Sep 05 17:08:42.955861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 370/728] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:42 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:43.585516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d3b08317-4134-4d58-b8fb-2700b59f1f1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:43.586162 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d3b08317-4134-4d58-b8fb-2700b59f1f1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:43.593095 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3b08317-4134-4d58-b8fb-2700b59f1f1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:43.593613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3b08317-4134-4d58-b8fb-2700b59f1f1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:43.594012 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3b08317-4134-4d58-b8fb-2700b59f1f1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:43.594735 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3b08317-4134-4d58-b8fb-2700b59f1f1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:43.595186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3b08317-4134-4d58-b8fb-2700b59f1f1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:43.595599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3b08317-4134-4d58-b8fb-2700b59f1f1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:43.751336 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d3b08317-4134-4d58-b8fb-2700b59f1f1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:08:43.760914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d3b08317-4134-4d58-b8fb-2700b59f1f1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1754 microversion: 2.1 time: 0.180532 Sep 05 17:08:43.761492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 359/729] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:08:43 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:08:43.971677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ff38d5e8-2fbd-4b81-b6eb-18c4ab384740 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:43.974796 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ff38d5e8-2fbd-4b81-b6eb-18c4ab384740 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:43.982029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff38d5e8-2fbd-4b81-b6eb-18c4ab384740 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:43.982513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff38d5e8-2fbd-4b81-b6eb-18c4ab384740 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:43.982948 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff38d5e8-2fbd-4b81-b6eb-18c4ab384740 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:43.983635 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff38d5e8-2fbd-4b81-b6eb-18c4ab384740 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:43.984088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff38d5e8-2fbd-4b81-b6eb-18c4ab384740 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:43.984550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff38d5e8-2fbd-4b81-b6eb-18c4ab384740 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:44.016802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ff38d5e8-2fbd-4b81-b6eb-18c4ab384740 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051757 Sep 05 17:08:44.017380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 371/730] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:43 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:44.784508 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-22c38251-58eb-40d5-9d4c-b349ac29e12e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:44.785122 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-22c38251-58eb-40d5-9d4c-b349ac29e12e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:44.792273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22c38251-58eb-40d5-9d4c-b349ac29e12e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:44.792758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22c38251-58eb-40d5-9d4c-b349ac29e12e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:44.793189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22c38251-58eb-40d5-9d4c-b349ac29e12e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:44.793889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22c38251-58eb-40d5-9d4c-b349ac29e12e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:44.794338 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22c38251-58eb-40d5-9d4c-b349ac29e12e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:44.794757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22c38251-58eb-40d5-9d4c-b349ac29e12e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:44.954097 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-22c38251-58eb-40d5-9d4c-b349ac29e12e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:08:44.964093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-22c38251-58eb-40d5-9d4c-b349ac29e12e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1754 microversion: 2.1 time: 0.183435 Sep 05 17:08:44.964720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 360/731] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:08:44 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1754 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:08:45.034564 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9dbed9f7-2791-4263-aa94-208ae5951743 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:45.037987 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9dbed9f7-2791-4263-aa94-208ae5951743 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:45.049354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9dbed9f7-2791-4263-aa94-208ae5951743 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:45.050172 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9dbed9f7-2791-4263-aa94-208ae5951743 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:45.050907 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9dbed9f7-2791-4263-aa94-208ae5951743 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:45.052002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9dbed9f7-2791-4263-aa94-208ae5951743 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:45.052594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9dbed9f7-2791-4263-aa94-208ae5951743 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:45.053012 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9dbed9f7-2791-4263-aa94-208ae5951743 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:45.083475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9dbed9f7-2791-4263-aa94-208ae5951743 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055878 Sep 05 17:08:45.084027 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 372/732] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:45 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:45.989848 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-85000265-cc08-4f73-929d-3444c187efde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:45.990401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-85000265-cc08-4f73-929d-3444c187efde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:45.997732 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85000265-cc08-4f73-929d-3444c187efde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:45.998212 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85000265-cc08-4f73-929d-3444c187efde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:45.998644 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85000265-cc08-4f73-929d-3444c187efde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:45.999338 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85000265-cc08-4f73-929d-3444c187efde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:45.999784 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85000265-cc08-4f73-929d-3444c187efde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:46.000202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85000265-cc08-4f73-929d-3444c187efde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:46.098050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0a90a9bf-f7c6-4c84-8ee8-93926745ab0f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:46.100918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0a90a9bf-f7c6-4c84-8ee8-93926745ab0f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:46.107475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a90a9bf-f7c6-4c84-8ee8-93926745ab0f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:46.107962 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a90a9bf-f7c6-4c84-8ee8-93926745ab0f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:46.108433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a90a9bf-f7c6-4c84-8ee8-93926745ab0f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:46.109133 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a90a9bf-f7c6-4c84-8ee8-93926745ab0f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:46.109584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a90a9bf-f7c6-4c84-8ee8-93926745ab0f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:46.110006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a90a9bf-f7c6-4c84-8ee8-93926745ab0f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:46.140919 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0a90a9bf-f7c6-4c84-8ee8-93926745ab0f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046992 Sep 05 17:08:46.141764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 373/733] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:46 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:46.154760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-85000265-cc08-4f73-929d-3444c187efde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:08:46.163398 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-85000265-cc08-4f73-929d-3444c187efde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1754 microversion: 2.1 time: 0.177772 Sep 05 17:08:46.163961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 361/734] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:08:45 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:08:47.158344 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8256ddf0-1699-49c2-ad24-ba9720c7babb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:47.162171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8256ddf0-1699-49c2-ad24-ba9720c7babb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:47.173141 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8256ddf0-1699-49c2-ad24-ba9720c7babb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:47.173936 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8256ddf0-1699-49c2-ad24-ba9720c7babb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:47.174636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8256ddf0-1699-49c2-ad24-ba9720c7babb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:47.175799 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8256ddf0-1699-49c2-ad24-ba9720c7babb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:47.176723 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8256ddf0-1699-49c2-ad24-ba9720c7babb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:47.177135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8256ddf0-1699-49c2-ad24-ba9720c7babb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:47.181585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:08:47.187241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-eca139f9-cb27-4c8b-ac8a-dcbe1103fc4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:47.187849 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-eca139f9-cb27-4c8b-ac8a-dcbe1103fc4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:47.194770 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eca139f9-cb27-4c8b-ac8a-dcbe1103fc4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:47.195658 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eca139f9-cb27-4c8b-ac8a-dcbe1103fc4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:47.195658 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eca139f9-cb27-4c8b-ac8a-dcbe1103fc4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:47.196540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eca139f9-cb27-4c8b-ac8a-dcbe1103fc4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:47.197006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eca139f9-cb27-4c8b-ac8a-dcbe1103fc4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:47.197533 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eca139f9-cb27-4c8b-ac8a-dcbe1103fc4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:47.209038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8256ddf0-1699-49c2-ad24-ba9720c7babb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057378 Sep 05 17:08:47.209613 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 374/735] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:47 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:47.354454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eca139f9-cb27-4c8b-ac8a-dcbe1103fc4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:08:47.367024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-eca139f9-cb27-4c8b-ac8a-dcbe1103fc4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1754 microversion: 2.1 time: 0.183527 Sep 05 17:08:47.367916 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 362/736] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:08:47 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1754 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:08:48.226403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-edc4d47b-71de-4553-8c82-c98bd12e4f93 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:48.229079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-edc4d47b-71de-4553-8c82-c98bd12e4f93 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:48.237335 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-edc4d47b-71de-4553-8c82-c98bd12e4f93 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:48.237932 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-edc4d47b-71de-4553-8c82-c98bd12e4f93 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:48.238463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-edc4d47b-71de-4553-8c82-c98bd12e4f93 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:48.239378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-edc4d47b-71de-4553-8c82-c98bd12e4f93 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:48.240000 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-edc4d47b-71de-4553-8c82-c98bd12e4f93 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:48.240557 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-edc4d47b-71de-4553-8c82-c98bd12e4f93 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:48.273747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-edc4d47b-71de-4553-8c82-c98bd12e4f93 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054426 Sep 05 17:08:48.274298 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 375/737] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:48 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:48.391140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-69d3472e-cfe5-4cbb-9f0e-9ca93f0ec77f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:48.391747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-69d3472e-cfe5-4cbb-9f0e-9ca93f0ec77f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:48.398632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69d3472e-cfe5-4cbb-9f0e-9ca93f0ec77f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:48.399148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69d3472e-cfe5-4cbb-9f0e-9ca93f0ec77f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:48.399577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69d3472e-cfe5-4cbb-9f0e-9ca93f0ec77f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:48.400303 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69d3472e-cfe5-4cbb-9f0e-9ca93f0ec77f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:48.400757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69d3472e-cfe5-4cbb-9f0e-9ca93f0ec77f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:48.401170 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69d3472e-cfe5-4cbb-9f0e-9ca93f0ec77f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:48.557865 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-69d3472e-cfe5-4cbb-9f0e-9ca93f0ec77f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:08:48.567742 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-69d3472e-cfe5-4cbb-9f0e-9ca93f0ec77f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1754 microversion: 2.1 time: 0.180569 Sep 05 17:08:48.568417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 363/738] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:08:48 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:08:49.290922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b17fd998-32c0-4c63-ab4e-31fa642d46ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:49.294054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b17fd998-32c0-4c63-ab4e-31fa642d46ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:49.302592 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b17fd998-32c0-4c63-ab4e-31fa642d46ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:49.303073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b17fd998-32c0-4c63-ab4e-31fa642d46ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:49.303924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b17fd998-32c0-4c63-ab4e-31fa642d46ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:49.304662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b17fd998-32c0-4c63-ab4e-31fa642d46ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:49.305106 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b17fd998-32c0-4c63-ab4e-31fa642d46ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:49.305540 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b17fd998-32c0-4c63-ab4e-31fa642d46ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:49.336836 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b17fd998-32c0-4c63-ab4e-31fa642d46ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052615 Sep 05 17:08:49.337400 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 376/739] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:49 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:49.598723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f123fbf5-71bf-4baa-8d9d-e2ab2a079f26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:49.599330 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f123fbf5-71bf-4baa-8d9d-e2ab2a079f26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:49.606574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f123fbf5-71bf-4baa-8d9d-e2ab2a079f26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:49.607058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f123fbf5-71bf-4baa-8d9d-e2ab2a079f26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:49.607486 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f123fbf5-71bf-4baa-8d9d-e2ab2a079f26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:49.608191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f123fbf5-71bf-4baa-8d9d-e2ab2a079f26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:49.608651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f123fbf5-71bf-4baa-8d9d-e2ab2a079f26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:49.609072 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f123fbf5-71bf-4baa-8d9d-e2ab2a079f26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:49.759009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f123fbf5-71bf-4baa-8d9d-e2ab2a079f26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:08:49.761227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:08:49.768831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f123fbf5-71bf-4baa-8d9d-e2ab2a079f26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1754 microversion: 2.1 time: 0.177022 Sep 05 17:08:49.769446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 364/740] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:08:49 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:08:50.351965 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-98b51626-d034-467e-980c-4c5ed89d8bb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:50.354190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-98b51626-d034-467e-980c-4c5ed89d8bb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:50.361309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-98b51626-d034-467e-980c-4c5ed89d8bb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:50.361793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-98b51626-d034-467e-980c-4c5ed89d8bb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:50.362227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-98b51626-d034-467e-980c-4c5ed89d8bb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:50.362957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-98b51626-d034-467e-980c-4c5ed89d8bb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:50.363410 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-98b51626-d034-467e-980c-4c5ed89d8bb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:50.363846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-98b51626-d034-467e-980c-4c5ed89d8bb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:50.400744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-98b51626-d034-467e-980c-4c5ed89d8bb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054014 Sep 05 17:08:50.401314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 377/741] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:50 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:50.797208 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-38df2614-702f-46c2-b1dc-48a2587aad3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:50.798309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-38df2614-702f-46c2-b1dc-48a2587aad3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:50.806614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38df2614-702f-46c2-b1dc-48a2587aad3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:50.807031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38df2614-702f-46c2-b1dc-48a2587aad3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:50.807466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38df2614-702f-46c2-b1dc-48a2587aad3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:50.808169 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38df2614-702f-46c2-b1dc-48a2587aad3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:50.808635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38df2614-702f-46c2-b1dc-48a2587aad3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:50.809060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38df2614-702f-46c2-b1dc-48a2587aad3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:50.953555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-38df2614-702f-46c2-b1dc-48a2587aad3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:08:50.962435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-38df2614-702f-46c2-b1dc-48a2587aad3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1754 microversion: 2.1 time: 0.172268 Sep 05 17:08:50.963013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 365/742] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:08:50 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:08:51.413969 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c4b0d763-e180-442b-82f9-069578afc086 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:51.416346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c4b0d763-e180-442b-82f9-069578afc086 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:51.423143 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4b0d763-e180-442b-82f9-069578afc086 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:51.423618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4b0d763-e180-442b-82f9-069578afc086 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:51.424039 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4b0d763-e180-442b-82f9-069578afc086 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:51.424828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4b0d763-e180-442b-82f9-069578afc086 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:51.425277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4b0d763-e180-442b-82f9-069578afc086 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:51.425705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4b0d763-e180-442b-82f9-069578afc086 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:51.456357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c4b0d763-e180-442b-82f9-069578afc086 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046402 Sep 05 17:08:51.456905 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 378/743] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:51 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:51.990947 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f42ddb3c-e482-488b-a0e4-0f350ba44c1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:51.991934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f42ddb3c-e482-488b-a0e4-0f350ba44c1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:52.003074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f42ddb3c-e482-488b-a0e4-0f350ba44c1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:52.003866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f42ddb3c-e482-488b-a0e4-0f350ba44c1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:52.004730 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f42ddb3c-e482-488b-a0e4-0f350ba44c1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:52.005471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f42ddb3c-e482-488b-a0e4-0f350ba44c1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:52.005923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f42ddb3c-e482-488b-a0e4-0f350ba44c1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:52.006348 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f42ddb3c-e482-488b-a0e4-0f350ba44c1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:52.166987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f42ddb3c-e482-488b-a0e4-0f350ba44c1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:08:52.175486 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f42ddb3c-e482-488b-a0e4-0f350ba44c1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1757 microversion: 2.1 time: 0.191478 Sep 05 17:08:52.176044 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 366/744] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:08:51 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:08:52.473319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a5e8cb1e-40f0-4433-b40d-4d2c3d9fc34a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:52.477030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a5e8cb1e-40f0-4433-b40d-4d2c3d9fc34a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:52.485305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5e8cb1e-40f0-4433-b40d-4d2c3d9fc34a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:52.485862 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5e8cb1e-40f0-4433-b40d-4d2c3d9fc34a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:52.486387 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5e8cb1e-40f0-4433-b40d-4d2c3d9fc34a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:52.487178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5e8cb1e-40f0-4433-b40d-4d2c3d9fc34a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:52.490613 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5e8cb1e-40f0-4433-b40d-4d2c3d9fc34a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:52.491070 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5e8cb1e-40f0-4433-b40d-4d2c3d9fc34a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:52.525788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a5e8cb1e-40f0-4433-b40d-4d2c3d9fc34a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057729 Sep 05 17:08:52.526363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 379/745] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:52 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:53.540639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8d8540e1-d6ca-444a-b0c2-231497ed44b1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:53.542863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8d8540e1-d6ca-444a-b0c2-231497ed44b1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:53.550013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d8540e1-d6ca-444a-b0c2-231497ed44b1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:53.550490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d8540e1-d6ca-444a-b0c2-231497ed44b1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:53.550915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d8540e1-d6ca-444a-b0c2-231497ed44b1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:53.551887 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d8540e1-d6ca-444a-b0c2-231497ed44b1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:53.552370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d8540e1-d6ca-444a-b0c2-231497ed44b1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:53.552784 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d8540e1-d6ca-444a-b0c2-231497ed44b1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:53.583403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8d8540e1-d6ca-444a-b0c2-231497ed44b1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048404 Sep 05 17:08:53.583966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 367/746] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:53 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:54.601661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1e2f1927-46f5-480b-9e88-63a432babcb3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:54.605917 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1e2f1927-46f5-480b-9e88-63a432babcb3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:54.616917 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e2f1927-46f5-480b-9e88-63a432babcb3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:54.617402 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e2f1927-46f5-480b-9e88-63a432babcb3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:54.617818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e2f1927-46f5-480b-9e88-63a432babcb3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:54.618498 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e2f1927-46f5-480b-9e88-63a432babcb3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:54.618937 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e2f1927-46f5-480b-9e88-63a432babcb3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:54.619348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e2f1927-46f5-480b-9e88-63a432babcb3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:54.649938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1e2f1927-46f5-480b-9e88-63a432babcb3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056080 Sep 05 17:08:54.650498 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 380/747] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:54 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:55.667321 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-49e9bff1-1aa4-4e68-9163-7b0e7b589b63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:55.670828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-49e9bff1-1aa4-4e68-9163-7b0e7b589b63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:55.682635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49e9bff1-1aa4-4e68-9163-7b0e7b589b63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:55.683422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49e9bff1-1aa4-4e68-9163-7b0e7b589b63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:55.684122 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49e9bff1-1aa4-4e68-9163-7b0e7b589b63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:55.685293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49e9bff1-1aa4-4e68-9163-7b0e7b589b63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:55.686039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49e9bff1-1aa4-4e68-9163-7b0e7b589b63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:55.686725 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49e9bff1-1aa4-4e68-9163-7b0e7b589b63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:55.720620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-49e9bff1-1aa4-4e68-9163-7b0e7b589b63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060353 Sep 05 17:08:55.721177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 368/748] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:55 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:56.738609 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-72343955-631c-4801-aa4f-a848995ba255 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:56.741178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-72343955-631c-4801-aa4f-a848995ba255 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:56.748278 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72343955-631c-4801-aa4f-a848995ba255 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:56.748759 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72343955-631c-4801-aa4f-a848995ba255 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:56.749181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72343955-631c-4801-aa4f-a848995ba255 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:56.749856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72343955-631c-4801-aa4f-a848995ba255 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:56.750299 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72343955-631c-4801-aa4f-a848995ba255 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:56.750706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72343955-631c-4801-aa4f-a848995ba255 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:56.781997 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-72343955-631c-4801-aa4f-a848995ba255 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050179 Sep 05 17:08:56.782547 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 381/749] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:56 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:57.800490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a8024362-0fdd-4d47-bd25-54c3a095c569 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:57.802770 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a8024362-0fdd-4d47-bd25-54c3a095c569 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:57.804694 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=42 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:08:57.810286 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8024362-0fdd-4d47-bd25-54c3a095c569 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:57.810744 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8024362-0fdd-4d47-bd25-54c3a095c569 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:57.811173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8024362-0fdd-4d47-bd25-54c3a095c569 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:57.811854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8024362-0fdd-4d47-bd25-54c3a095c569 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:57.812334 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8024362-0fdd-4d47-bd25-54c3a095c569 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:57.812753 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8024362-0fdd-4d47-bd25-54c3a095c569 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:57.843156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a8024362-0fdd-4d47-bd25-54c3a095c569 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048994 Sep 05 17:08:57.843691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 369/750] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:57 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:58.860520 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d9a451d2-5920-4d44-bdce-af6d611ef311 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:58.863924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d9a451d2-5920-4d44-bdce-af6d611ef311 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:58.867305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=44 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:08:58.872821 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d9a451d2-5920-4d44-bdce-af6d611ef311 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:58.873300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d9a451d2-5920-4d44-bdce-af6d611ef311 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:58.873727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d9a451d2-5920-4d44-bdce-af6d611ef311 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:58.874409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d9a451d2-5920-4d44-bdce-af6d611ef311 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:58.874853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d9a451d2-5920-4d44-bdce-af6d611ef311 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:58.875267 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d9a451d2-5920-4d44-bdce-af6d611ef311 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:58.905910 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d9a451d2-5920-4d44-bdce-af6d611ef311 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052062 Sep 05 17:08:58.906462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 382/751] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:58 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:08:59.923337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-feb77705-8cac-4533-8366-ca9f096f4401 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:08:59.926479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-feb77705-8cac-4533-8366-ca9f096f4401 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:08:59.937352 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-feb77705-8cac-4533-8366-ca9f096f4401 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:59.938088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-feb77705-8cac-4533-8366-ca9f096f4401 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:59.938745 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-feb77705-8cac-4533-8366-ca9f096f4401 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:59.939746 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-feb77705-8cac-4533-8366-ca9f096f4401 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:08:59.940532 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-feb77705-8cac-4533-8366-ca9f096f4401 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:08:59.941184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-feb77705-8cac-4533-8366-ca9f096f4401 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:08:59.972470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-feb77705-8cac-4533-8366-ca9f096f4401 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055602 Sep 05 17:08:59.973021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 370/752] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:08:59 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:00.991674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8ca1efd9-3552-4b8b-b427-a5527b56755e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:00.993931 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8ca1efd9-3552-4b8b-b427-a5527b56755e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:01.000959 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ca1efd9-3552-4b8b-b427-a5527b56755e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:01.001475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ca1efd9-3552-4b8b-b427-a5527b56755e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:01.001902 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ca1efd9-3552-4b8b-b427-a5527b56755e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:01.002597 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ca1efd9-3552-4b8b-b427-a5527b56755e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:01.003080 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ca1efd9-3552-4b8b-b427-a5527b56755e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:01.003499 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ca1efd9-3552-4b8b-b427-a5527b56755e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:01.033788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8ca1efd9-3552-4b8b-b427-a5527b56755e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049963 Sep 05 17:09:01.034331 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 383/753] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:00 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:01.605872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6e52a91c-a615-47c9-a15e-92b522ed77ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:01.606799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6e52a91c-a615-47c9-a15e-92b522ed77ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:01.616697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e52a91c-a615-47c9-a15e-92b522ed77ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:01.617169 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e52a91c-a615-47c9-a15e-92b522ed77ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:01.617590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e52a91c-a615-47c9-a15e-92b522ed77ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:01.618270 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e52a91c-a615-47c9-a15e-92b522ed77ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:01.618713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e52a91c-a615-47c9-a15e-92b522ed77ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:01.619126 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e52a91c-a615-47c9-a15e-92b522ed77ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:01.645038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6e52a91c-a615-47c9-a15e-92b522ed77ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:09:01.732866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6e52a91c-a615-47c9-a15e-92b522ed77ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 204 len: 0 microversion: 2.1 time: 0.133617 Sep 05 17:09:01.733458 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 371/754] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:09:01 2022] DELETE /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:09:01.744765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8762c4d2-e7a4-4a7c-a130-4e2db9684fa1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:01.745522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8762c4d2-e7a4-4a7c-a130-4e2db9684fa1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:01.751723 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8762c4d2-e7a4-4a7c-a130-4e2db9684fa1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:01.752323 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8762c4d2-e7a4-4a7c-a130-4e2db9684fa1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:01.752848 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8762c4d2-e7a4-4a7c-a130-4e2db9684fa1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:01.753614 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8762c4d2-e7a4-4a7c-a130-4e2db9684fa1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:01.754138 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8762c4d2-e7a4-4a7c-a130-4e2db9684fa1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:01.754630 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8762c4d2-e7a4-4a7c-a130-4e2db9684fa1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:01.887111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8762c4d2-e7a4-4a7c-a130-4e2db9684fa1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:01.896029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8762c4d2-e7a4-4a7c-a130-4e2db9684fa1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1579 microversion: 2.1 time: 0.157894 Sep 05 17:09:01.896966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 384/755] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:01 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:02.055644 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f3653eaf-5a68-489a-a8c6-df915d946775 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:02.059240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f3653eaf-5a68-489a-a8c6-df915d946775 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:02.069574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3653eaf-5a68-489a-a8c6-df915d946775 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:02.070156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3653eaf-5a68-489a-a8c6-df915d946775 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:02.070577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3653eaf-5a68-489a-a8c6-df915d946775 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:02.071247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3653eaf-5a68-489a-a8c6-df915d946775 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:02.071689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3653eaf-5a68-489a-a8c6-df915d946775 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:02.072103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3653eaf-5a68-489a-a8c6-df915d946775 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:02.103313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f3653eaf-5a68-489a-a8c6-df915d946775 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055487 Sep 05 17:09:02.103871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 372/756] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:02 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:02.919218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-112a61a4-a74b-49b0-826e-458d87e05ad9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:02.919861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-112a61a4-a74b-49b0-826e-458d87e05ad9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:02.926109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-112a61a4-a74b-49b0-826e-458d87e05ad9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:02.926594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-112a61a4-a74b-49b0-826e-458d87e05ad9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:02.927020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-112a61a4-a74b-49b0-826e-458d87e05ad9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:02.927713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-112a61a4-a74b-49b0-826e-458d87e05ad9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:02.928247 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-112a61a4-a74b-49b0-826e-458d87e05ad9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:02.928613 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-112a61a4-a74b-49b0-826e-458d87e05ad9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:03.067301 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-112a61a4-a74b-49b0-826e-458d87e05ad9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:03.075805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-112a61a4-a74b-49b0-826e-458d87e05ad9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1579 microversion: 2.1 time: 0.160519 Sep 05 17:09:03.076437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 385/757] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:02 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:03.115335 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-777ecc57-4433-4702-9bd5-53a56a7f0071 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:03.117594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-777ecc57-4433-4702-9bd5-53a56a7f0071 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:03.124529 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-777ecc57-4433-4702-9bd5-53a56a7f0071 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:03.125005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-777ecc57-4433-4702-9bd5-53a56a7f0071 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:03.125430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-777ecc57-4433-4702-9bd5-53a56a7f0071 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:03.126147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-777ecc57-4433-4702-9bd5-53a56a7f0071 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:03.126562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-777ecc57-4433-4702-9bd5-53a56a7f0071 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:03.126977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-777ecc57-4433-4702-9bd5-53a56a7f0071 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:03.158064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-777ecc57-4433-4702-9bd5-53a56a7f0071 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046710 Sep 05 17:09:03.158604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 373/758] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:03 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 17:09:04.106536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f6065a6d-5e61-4113-bda0-8d384180d189 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:04.107526 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f6065a6d-5e61-4113-bda0-8d384180d189 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:04.117814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6065a6d-5e61-4113-bda0-8d384180d189 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:04.118228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6065a6d-5e61-4113-bda0-8d384180d189 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:04.118774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6065a6d-5e61-4113-bda0-8d384180d189 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:04.119473 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6065a6d-5e61-4113-bda0-8d384180d189 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:04.119955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6065a6d-5e61-4113-bda0-8d384180d189 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:04.120403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6065a6d-5e61-4113-bda0-8d384180d189 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:04.171187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-48243aa9-1a30-48c9-88f9-060fcea548c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:04.173635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-48243aa9-1a30-48c9-88f9-060fcea548c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:04.180430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48243aa9-1a30-48c9-88f9-060fcea548c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:04.180917 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48243aa9-1a30-48c9-88f9-060fcea548c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:04.181543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48243aa9-1a30-48c9-88f9-060fcea548c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:04.182245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48243aa9-1a30-48c9-88f9-060fcea548c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:04.182696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48243aa9-1a30-48c9-88f9-060fcea548c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:04.183114 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48243aa9-1a30-48c9-88f9-060fcea548c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:04.214133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-48243aa9-1a30-48c9-88f9-060fcea548c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047050 Sep 05 17:09:04.214702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 374/759] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:04 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:04.253011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f6065a6d-5e61-4113-bda0-8d384180d189 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:04.261246 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f6065a6d-5e61-4113-bda0-8d384180d189 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1579 microversion: 2.1 time: 0.161613 Sep 05 17:09:04.261828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 386/760] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:04 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:04.955510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-fe7c3697-9510-44df-a2b6-0c5a11bf2fd7 req-e8403b28-0c51-4757-a62d-530f8847a1dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3820bb09-911a-4093-952b-3487f165122f", "name": "network-vif-deleted", "tag": "b8d3b025-c734-4edc-9914-e4b7d38eb338"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:09:04.968703 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-fe7c3697-9510-44df-a2b6-0c5a11bf2fd7 req-e8403b28-0c51-4757-a62d-530f8847a1dd service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:04.969303 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-fe7c3697-9510-44df-a2b6-0c5a11bf2fd7 req-e8403b28-0c51-4757-a62d-530f8847a1dd service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:04.969738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-fe7c3697-9510-44df-a2b6-0c5a11bf2fd7 req-e8403b28-0c51-4757-a62d-530f8847a1dd service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:04.995025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-fe7c3697-9510-44df-a2b6-0c5a11bf2fd7 req-e8403b28-0c51-4757-a62d-530f8847a1dd service nova] Creating event network-vif-deleted:b8d3b025-c734-4edc-9914-e4b7d38eb338 for instance 3820bb09-911a-4093-952b-3487f165122f on hv-cinder-85596 Sep 05 17:09:04.999868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-fe7c3697-9510-44df-a2b6-0c5a11bf2fd7 req-e8403b28-0c51-4757-a62d-530f8847a1dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050407 Sep 05 17:09:05.000503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 375/761] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:09:05.228645 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-715b2b9a-98ea-4a6b-910f-fa385aaae500 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:05.231007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-715b2b9a-98ea-4a6b-910f-fa385aaae500 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:05.237807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-715b2b9a-98ea-4a6b-910f-fa385aaae500 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:05.238294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-715b2b9a-98ea-4a6b-910f-fa385aaae500 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:05.238760 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-715b2b9a-98ea-4a6b-910f-fa385aaae500 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:05.239452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-715b2b9a-98ea-4a6b-910f-fa385aaae500 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:05.239901 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-715b2b9a-98ea-4a6b-910f-fa385aaae500 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:05.240385 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-715b2b9a-98ea-4a6b-910f-fa385aaae500 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:05.272939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-715b2b9a-98ea-4a6b-910f-fa385aaae500 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049565 Sep 05 17:09:05.274106 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 387/762] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:05 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:05.285702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-25873637-89d4-4cb2-a2b9-d09e5350dd1e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:05.286361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-25873637-89d4-4cb2-a2b9-d09e5350dd1e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:05.294014 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25873637-89d4-4cb2-a2b9-d09e5350dd1e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:05.294740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25873637-89d4-4cb2-a2b9-d09e5350dd1e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:05.295175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25873637-89d4-4cb2-a2b9-d09e5350dd1e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:05.296137 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25873637-89d4-4cb2-a2b9-d09e5350dd1e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:05.296613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25873637-89d4-4cb2-a2b9-d09e5350dd1e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:05.297044 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25873637-89d4-4cb2-a2b9-d09e5350dd1e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:05.361042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-25873637-89d4-4cb2-a2b9-d09e5350dd1e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:05.369873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-25873637-89d4-4cb2-a2b9-d09e5350dd1e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.088390 Sep 05 17:09:05.374651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 376/763] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:05 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:06.286692 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c10f3f9b-bb53-416c-aa27-951cc68dd477 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:06.288879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c10f3f9b-bb53-416c-aa27-951cc68dd477 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:06.297069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c10f3f9b-bb53-416c-aa27-951cc68dd477 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:06.297550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c10f3f9b-bb53-416c-aa27-951cc68dd477 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:06.297970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c10f3f9b-bb53-416c-aa27-951cc68dd477 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:06.298654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c10f3f9b-bb53-416c-aa27-951cc68dd477 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:06.299258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c10f3f9b-bb53-416c-aa27-951cc68dd477 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:06.299895 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c10f3f9b-bb53-416c-aa27-951cc68dd477 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:06.333730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c10f3f9b-bb53-416c-aa27-951cc68dd477 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051037 Sep 05 17:09:06.334292 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 388/764] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:06 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:06.392907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b3dafb11-651e-4266-b90a-2457dec14242 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:06.393617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b3dafb11-651e-4266-b90a-2457dec14242 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:06.400598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3dafb11-651e-4266-b90a-2457dec14242 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:06.401073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3dafb11-651e-4266-b90a-2457dec14242 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:06.401487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3dafb11-651e-4266-b90a-2457dec14242 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:06.402175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3dafb11-651e-4266-b90a-2457dec14242 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:06.402620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3dafb11-651e-4266-b90a-2457dec14242 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:06.403031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3dafb11-651e-4266-b90a-2457dec14242 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:06.470686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b3dafb11-651e-4266-b90a-2457dec14242 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:06.481401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b3dafb11-651e-4266-b90a-2457dec14242 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092475 Sep 05 17:09:06.481946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 377/765] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:06 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:07.352530 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4ed0aba0-d7a4-4f69-96f1-659073e6973b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:07.354350 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4ed0aba0-d7a4-4f69-96f1-659073e6973b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:07.361784 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ed0aba0-d7a4-4f69-96f1-659073e6973b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:07.362312 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ed0aba0-d7a4-4f69-96f1-659073e6973b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:07.362783 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ed0aba0-d7a4-4f69-96f1-659073e6973b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:07.363536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ed0aba0-d7a4-4f69-96f1-659073e6973b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:07.364026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ed0aba0-d7a4-4f69-96f1-659073e6973b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:07.364526 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ed0aba0-d7a4-4f69-96f1-659073e6973b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:07.400307 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4ed0aba0-d7a4-4f69-96f1-659073e6973b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055292 Sep 05 17:09:07.401143 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 389/766] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:07 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:07.503568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-07979a51-e4f9-4479-94ce-2c1778177a17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:07.504209 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-07979a51-e4f9-4479-94ce-2c1778177a17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:07.512034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-07979a51-e4f9-4479-94ce-2c1778177a17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:07.512572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-07979a51-e4f9-4479-94ce-2c1778177a17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:07.513037 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-07979a51-e4f9-4479-94ce-2c1778177a17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:07.513762 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-07979a51-e4f9-4479-94ce-2c1778177a17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:07.514412 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-07979a51-e4f9-4479-94ce-2c1778177a17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:07.515043 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-07979a51-e4f9-4479-94ce-2c1778177a17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:07.580078 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-07979a51-e4f9-4479-94ce-2c1778177a17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:07.588676 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-07979a51-e4f9-4479-94ce-2c1778177a17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089029 Sep 05 17:09:07.589241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 378/767] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:07 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:08.413537 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d453a094-e0fe-4d78-8131-4b6ef058a86a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:08.415691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d453a094-e0fe-4d78-8131-4b6ef058a86a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:08.422486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d453a094-e0fe-4d78-8131-4b6ef058a86a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:08.422962 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d453a094-e0fe-4d78-8131-4b6ef058a86a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:08.423380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d453a094-e0fe-4d78-8131-4b6ef058a86a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:08.424061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d453a094-e0fe-4d78-8131-4b6ef058a86a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:08.424551 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d453a094-e0fe-4d78-8131-4b6ef058a86a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:08.424969 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d453a094-e0fe-4d78-8131-4b6ef058a86a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:08.450473 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:09:08.455463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d453a094-e0fe-4d78-8131-4b6ef058a86a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046025 Sep 05 17:09:08.456013 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 390/768] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:08 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:08.616424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d4b7419f-0ae1-4f66-b8e3-b55b355b067d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:08.617506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d4b7419f-0ae1-4f66-b8e3-b55b355b067d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:08.624884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b7419f-0ae1-4f66-b8e3-b55b355b067d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:08.625369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b7419f-0ae1-4f66-b8e3-b55b355b067d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:08.625808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b7419f-0ae1-4f66-b8e3-b55b355b067d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:08.626495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b7419f-0ae1-4f66-b8e3-b55b355b067d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:08.627005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b7419f-0ae1-4f66-b8e3-b55b355b067d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:08.627461 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b7419f-0ae1-4f66-b8e3-b55b355b067d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:08.688775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d4b7419f-0ae1-4f66-b8e3-b55b355b067d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:08.697107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d4b7419f-0ae1-4f66-b8e3-b55b355b067d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087127 Sep 05 17:09:08.697689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 379/769] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:08 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:09.472837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-00e9ee30-7b33-4851-a786-64c6cef3d2a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:09.476716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-00e9ee30-7b33-4851-a786-64c6cef3d2a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:09.483743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00e9ee30-7b33-4851-a786-64c6cef3d2a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:09.484264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00e9ee30-7b33-4851-a786-64c6cef3d2a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:09.484694 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00e9ee30-7b33-4851-a786-64c6cef3d2a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:09.485381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00e9ee30-7b33-4851-a786-64c6cef3d2a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:09.485858 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00e9ee30-7b33-4851-a786-64c6cef3d2a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:09.486302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00e9ee30-7b33-4851-a786-64c6cef3d2a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:09.516505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-00e9ee30-7b33-4851-a786-64c6cef3d2a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050457 Sep 05 17:09:09.517074 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 391/770] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:09 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:09.730639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b2a3406a-1a24-43f9-8909-4a2b451a9833 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:09.731354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b2a3406a-1a24-43f9-8909-4a2b451a9833 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:09.739226 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2a3406a-1a24-43f9-8909-4a2b451a9833 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:09.739792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2a3406a-1a24-43f9-8909-4a2b451a9833 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:09.740372 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2a3406a-1a24-43f9-8909-4a2b451a9833 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:09.741186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2a3406a-1a24-43f9-8909-4a2b451a9833 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:09.741713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2a3406a-1a24-43f9-8909-4a2b451a9833 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:09.742215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2a3406a-1a24-43f9-8909-4a2b451a9833 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:09.759483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:09:09.808494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b2a3406a-1a24-43f9-8909-4a2b451a9833 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:09.820434 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b2a3406a-1a24-43f9-8909-4a2b451a9833 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095314 Sep 05 17:09:09.821470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 380/771] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:09 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:10.530819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-50f3a3e2-c8cb-47fa-917d-324112c46dee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:10.533475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-50f3a3e2-c8cb-47fa-917d-324112c46dee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:10.541621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50f3a3e2-c8cb-47fa-917d-324112c46dee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:10.542220 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50f3a3e2-c8cb-47fa-917d-324112c46dee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:10.542743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50f3a3e2-c8cb-47fa-917d-324112c46dee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:10.543595 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50f3a3e2-c8cb-47fa-917d-324112c46dee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:10.544284 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50f3a3e2-c8cb-47fa-917d-324112c46dee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:10.544790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50f3a3e2-c8cb-47fa-917d-324112c46dee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:10.576618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-50f3a3e2-c8cb-47fa-917d-324112c46dee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050683 Sep 05 17:09:10.577178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 392/772] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:10 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:10.851996 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d0aec838-a82b-45fa-9c18-ee795b1a5159 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:10.852740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d0aec838-a82b-45fa-9c18-ee795b1a5159 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:10.861347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0aec838-a82b-45fa-9c18-ee795b1a5159 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:10.861981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0aec838-a82b-45fa-9c18-ee795b1a5159 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:10.862543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0aec838-a82b-45fa-9c18-ee795b1a5159 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:10.863445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0aec838-a82b-45fa-9c18-ee795b1a5159 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:10.864037 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0aec838-a82b-45fa-9c18-ee795b1a5159 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:10.864637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0aec838-a82b-45fa-9c18-ee795b1a5159 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:10.928992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d0aec838-a82b-45fa-9c18-ee795b1a5159 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:10.937244 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d0aec838-a82b-45fa-9c18-ee795b1a5159 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091148 Sep 05 17:09:10.937811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 381/773] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:10 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:11.594224 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8d8e84d2-ea8a-408d-a87a-bdce5ec351ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:11.597698 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8d8e84d2-ea8a-408d-a87a-bdce5ec351ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:11.609150 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d8e84d2-ea8a-408d-a87a-bdce5ec351ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:11.609959 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d8e84d2-ea8a-408d-a87a-bdce5ec351ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:11.610668 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d8e84d2-ea8a-408d-a87a-bdce5ec351ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:11.611799 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d8e84d2-ea8a-408d-a87a-bdce5ec351ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:11.612602 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d8e84d2-ea8a-408d-a87a-bdce5ec351ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:11.613300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d8e84d2-ea8a-408d-a87a-bdce5ec351ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:11.645498 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8d8e84d2-ea8a-408d-a87a-bdce5ec351ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058328 Sep 05 17:09:11.646005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 393/774] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:11 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:11.963489 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-66f662a9-302b-4ede-aaf8-dd7869a57c78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:11.964411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-66f662a9-302b-4ede-aaf8-dd7869a57c78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:11.975235 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66f662a9-302b-4ede-aaf8-dd7869a57c78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:11.976452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66f662a9-302b-4ede-aaf8-dd7869a57c78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:11.977123 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66f662a9-302b-4ede-aaf8-dd7869a57c78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:11.978480 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66f662a9-302b-4ede-aaf8-dd7869a57c78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:11.978739 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66f662a9-302b-4ede-aaf8-dd7869a57c78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:11.979148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66f662a9-302b-4ede-aaf8-dd7869a57c78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:12.046136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-66f662a9-302b-4ede-aaf8-dd7869a57c78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:12.055331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-66f662a9-302b-4ede-aaf8-dd7869a57c78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098860 Sep 05 17:09:12.055896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 382/775] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:11 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:12.662914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9a397f5b-6eef-4e2b-b473-2695ad1fb0a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:12.666171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9a397f5b-6eef-4e2b-b473-2695ad1fb0a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:12.673184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a397f5b-6eef-4e2b-b473-2695ad1fb0a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:12.673667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a397f5b-6eef-4e2b-b473-2695ad1fb0a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:12.674096 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a397f5b-6eef-4e2b-b473-2695ad1fb0a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:12.674782 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a397f5b-6eef-4e2b-b473-2695ad1fb0a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:12.675229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a397f5b-6eef-4e2b-b473-2695ad1fb0a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:12.675645 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a397f5b-6eef-4e2b-b473-2695ad1fb0a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:12.709049 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9a397f5b-6eef-4e2b-b473-2695ad1fb0a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052537 Sep 05 17:09:12.709801 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 394/776] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:12 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:13.082214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ad050c1b-7fcf-4be8-b4e2-277f2dc083a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:13.082862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ad050c1b-7fcf-4be8-b4e2-277f2dc083a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:13.091690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad050c1b-7fcf-4be8-b4e2-277f2dc083a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:13.092194 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad050c1b-7fcf-4be8-b4e2-277f2dc083a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:13.092613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad050c1b-7fcf-4be8-b4e2-277f2dc083a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:13.093293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad050c1b-7fcf-4be8-b4e2-277f2dc083a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:13.093737 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad050c1b-7fcf-4be8-b4e2-277f2dc083a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:13.094154 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad050c1b-7fcf-4be8-b4e2-277f2dc083a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:13.156901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ad050c1b-7fcf-4be8-b4e2-277f2dc083a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:13.164962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ad050c1b-7fcf-4be8-b4e2-277f2dc083a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089094 Sep 05 17:09:13.165661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 383/777] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:13 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:13.726016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a5d53ee2-a3a4-4570-a2e8-89657e7093d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:13.728740 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a5d53ee2-a3a4-4570-a2e8-89657e7093d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:13.736818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5d53ee2-a3a4-4570-a2e8-89657e7093d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:13.737449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5d53ee2-a3a4-4570-a2e8-89657e7093d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:13.738012 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5d53ee2-a3a4-4570-a2e8-89657e7093d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:13.738921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5d53ee2-a3a4-4570-a2e8-89657e7093d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:13.739513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5d53ee2-a3a4-4570-a2e8-89657e7093d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:13.740301 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5d53ee2-a3a4-4570-a2e8-89657e7093d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:13.771301 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a5d53ee2-a3a4-4570-a2e8-89657e7093d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051433 Sep 05 17:09:13.771889 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 395/778] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:13 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:14.192220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9653125b-3461-4859-b7c2-7f98ff8334f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:14.193424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9653125b-3461-4859-b7c2-7f98ff8334f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:14.201516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9653125b-3461-4859-b7c2-7f98ff8334f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:14.201994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9653125b-3461-4859-b7c2-7f98ff8334f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:14.202413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9653125b-3461-4859-b7c2-7f98ff8334f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:14.203093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9653125b-3461-4859-b7c2-7f98ff8334f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:14.203532 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9653125b-3461-4859-b7c2-7f98ff8334f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:14.203946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9653125b-3461-4859-b7c2-7f98ff8334f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:14.270695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9653125b-3461-4859-b7c2-7f98ff8334f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:14.279006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9653125b-3461-4859-b7c2-7f98ff8334f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093341 Sep 05 17:09:14.279562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 384/779] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:14 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:14.784125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e49024d4-c6ae-41a6-a93a-35fe2859a7e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:14.786338 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e49024d4-c6ae-41a6-a93a-35fe2859a7e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:14.793220 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e49024d4-c6ae-41a6-a93a-35fe2859a7e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:14.793692 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e49024d4-c6ae-41a6-a93a-35fe2859a7e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:14.794109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e49024d4-c6ae-41a6-a93a-35fe2859a7e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:14.794843 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e49024d4-c6ae-41a6-a93a-35fe2859a7e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:14.795296 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e49024d4-c6ae-41a6-a93a-35fe2859a7e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:14.795714 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e49024d4-c6ae-41a6-a93a-35fe2859a7e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:14.825818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e49024d4-c6ae-41a6-a93a-35fe2859a7e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045774 Sep 05 17:09:14.826378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 396/780] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:14 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:15.305450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-03163c9a-e2b9-4ab0-ad47-703413f64b00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:15.306490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-03163c9a-e2b9-4ab0-ad47-703413f64b00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:15.313828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03163c9a-e2b9-4ab0-ad47-703413f64b00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:15.314307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03163c9a-e2b9-4ab0-ad47-703413f64b00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:15.314737 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03163c9a-e2b9-4ab0-ad47-703413f64b00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:15.315427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03163c9a-e2b9-4ab0-ad47-703413f64b00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:15.315875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03163c9a-e2b9-4ab0-ad47-703413f64b00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:15.316325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03163c9a-e2b9-4ab0-ad47-703413f64b00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:15.386125 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-03163c9a-e2b9-4ab0-ad47-703413f64b00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:15.394550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-03163c9a-e2b9-4ab0-ad47-703413f64b00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095637 Sep 05 17:09:15.395133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 385/781] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:15 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:15.843221 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-99be376a-ae6a-40cc-984f-b4a29464e4c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:15.846742 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-99be376a-ae6a-40cc-984f-b4a29464e4c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:15.858060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99be376a-ae6a-40cc-984f-b4a29464e4c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:15.858861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99be376a-ae6a-40cc-984f-b4a29464e4c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:15.859573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99be376a-ae6a-40cc-984f-b4a29464e4c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:15.860771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99be376a-ae6a-40cc-984f-b4a29464e4c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:15.861518 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99be376a-ae6a-40cc-984f-b4a29464e4c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:15.862219 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99be376a-ae6a-40cc-984f-b4a29464e4c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:15.905689 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-99be376a-ae6a-40cc-984f-b4a29464e4c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069817 Sep 05 17:09:15.906245 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 397/782] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:15 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:16.419624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bf9f4ce6-c367-4af6-b794-260ec95205e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:16.420279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bf9f4ce6-c367-4af6-b794-260ec95205e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:16.427913 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf9f4ce6-c367-4af6-b794-260ec95205e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:16.428467 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf9f4ce6-c367-4af6-b794-260ec95205e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:16.428889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf9f4ce6-c367-4af6-b794-260ec95205e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:16.429694 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf9f4ce6-c367-4af6-b794-260ec95205e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:16.430171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf9f4ce6-c367-4af6-b794-260ec95205e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:16.430671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf9f4ce6-c367-4af6-b794-260ec95205e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:16.493896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bf9f4ce6-c367-4af6-b794-260ec95205e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:16.502210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bf9f4ce6-c367-4af6-b794-260ec95205e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087934 Sep 05 17:09:16.502793 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 386/783] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:16 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:16.923027 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7de9274e-de1e-4b3a-96d0-f85a26d7c083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:16.926474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7de9274e-de1e-4b3a-96d0-f85a26d7c083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:16.937456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7de9274e-de1e-4b3a-96d0-f85a26d7c083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:16.938250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7de9274e-de1e-4b3a-96d0-f85a26d7c083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:16.938967 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7de9274e-de1e-4b3a-96d0-f85a26d7c083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:16.940092 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7de9274e-de1e-4b3a-96d0-f85a26d7c083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:16.940885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7de9274e-de1e-4b3a-96d0-f85a26d7c083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:16.941590 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7de9274e-de1e-4b3a-96d0-f85a26d7c083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:16.973835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7de9274e-de1e-4b3a-96d0-f85a26d7c083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057782 Sep 05 17:09:16.974387 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 398/784] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:16 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:17.527957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e7083278-46e0-4805-b016-07573a981eb7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:17.529058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e7083278-46e0-4805-b016-07573a981eb7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:17.537203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7083278-46e0-4805-b016-07573a981eb7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:17.537690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7083278-46e0-4805-b016-07573a981eb7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:17.538120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7083278-46e0-4805-b016-07573a981eb7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:17.538820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7083278-46e0-4805-b016-07573a981eb7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:17.539273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7083278-46e0-4805-b016-07573a981eb7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:17.539723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7083278-46e0-4805-b016-07573a981eb7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:17.603000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e7083278-46e0-4805-b016-07573a981eb7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:17.611256 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e7083278-46e0-4805-b016-07573a981eb7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089638 Sep 05 17:09:17.611823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 387/785] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:17 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:17.991150 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c596ed48-93b3-489c-a1ff-3c51c9961dda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:17.994681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c596ed48-93b3-489c-a1ff-3c51c9961dda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:18.001854 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c596ed48-93b3-489c-a1ff-3c51c9961dda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:18.002374 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c596ed48-93b3-489c-a1ff-3c51c9961dda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:18.002809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c596ed48-93b3-489c-a1ff-3c51c9961dda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:18.003501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c596ed48-93b3-489c-a1ff-3c51c9961dda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:18.003957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c596ed48-93b3-489c-a1ff-3c51c9961dda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:18.004423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c596ed48-93b3-489c-a1ff-3c51c9961dda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:18.034043 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c596ed48-93b3-489c-a1ff-3c51c9961dda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049804 Sep 05 17:09:18.034596 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 399/786] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:17 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:18.638253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e8d22258-d88b-4077-a924-727722882f52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:18.638932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e8d22258-d88b-4077-a924-727722882f52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:18.646873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8d22258-d88b-4077-a924-727722882f52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:18.647438 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8d22258-d88b-4077-a924-727722882f52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:18.647946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8d22258-d88b-4077-a924-727722882f52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:18.648789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8d22258-d88b-4077-a924-727722882f52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:18.649322 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8d22258-d88b-4077-a924-727722882f52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:18.649811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8d22258-d88b-4077-a924-727722882f52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:18.714758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e8d22258-d88b-4077-a924-727722882f52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:18.723064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e8d22258-d88b-4077-a924-727722882f52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091698 Sep 05 17:09:18.723643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 388/787] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:18 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:19.054165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-451174af-9cb8-47a5-8149-b1bafcaf8b60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:19.058609 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-451174af-9cb8-47a5-8149-b1bafcaf8b60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:19.065557 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-451174af-9cb8-47a5-8149-b1bafcaf8b60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:19.066013 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-451174af-9cb8-47a5-8149-b1bafcaf8b60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:19.066500 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-451174af-9cb8-47a5-8149-b1bafcaf8b60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:19.067184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-451174af-9cb8-47a5-8149-b1bafcaf8b60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:19.067667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-451174af-9cb8-47a5-8149-b1bafcaf8b60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:19.068080 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-451174af-9cb8-47a5-8149-b1bafcaf8b60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:19.100210 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-451174af-9cb8-47a5-8149-b1bafcaf8b60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055336 Sep 05 17:09:19.101153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 400/788] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:19 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:19.749259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7cc52f36-5676-43ea-a10c-7d75654337e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:19.749879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7cc52f36-5676-43ea-a10c-7d75654337e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:19.757355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cc52f36-5676-43ea-a10c-7d75654337e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:19.757914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cc52f36-5676-43ea-a10c-7d75654337e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:19.758404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cc52f36-5676-43ea-a10c-7d75654337e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:19.759168 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cc52f36-5676-43ea-a10c-7d75654337e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:19.759668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cc52f36-5676-43ea-a10c-7d75654337e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:19.760137 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cc52f36-5676-43ea-a10c-7d75654337e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:19.828241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7cc52f36-5676-43ea-a10c-7d75654337e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:19.840470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7cc52f36-5676-43ea-a10c-7d75654337e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.096014 Sep 05 17:09:19.841376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 389/789] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:19 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:20.118241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1f6e34e7-1546-4bf8-8e63-9e6f00f5db23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:20.122469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1f6e34e7-1546-4bf8-8e63-9e6f00f5db23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:20.133333 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f6e34e7-1546-4bf8-8e63-9e6f00f5db23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:20.134144 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f6e34e7-1546-4bf8-8e63-9e6f00f5db23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:20.134850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f6e34e7-1546-4bf8-8e63-9e6f00f5db23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:20.136132 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f6e34e7-1546-4bf8-8e63-9e6f00f5db23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:20.137051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f6e34e7-1546-4bf8-8e63-9e6f00f5db23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:20.137475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f6e34e7-1546-4bf8-8e63-9e6f00f5db23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:20.168474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1f6e34e7-1546-4bf8-8e63-9e6f00f5db23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057289 Sep 05 17:09:20.169029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 401/790] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:20 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:20.866273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a1dbe952-63f0-4e3e-9924-d3bb61fec6cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:20.867157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a1dbe952-63f0-4e3e-9924-d3bb61fec6cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:20.877089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1dbe952-63f0-4e3e-9924-d3bb61fec6cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:20.877771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1dbe952-63f0-4e3e-9924-d3bb61fec6cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:20.878377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1dbe952-63f0-4e3e-9924-d3bb61fec6cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:20.879346 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1dbe952-63f0-4e3e-9924-d3bb61fec6cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:20.879954 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1dbe952-63f0-4e3e-9924-d3bb61fec6cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:20.880614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1dbe952-63f0-4e3e-9924-d3bb61fec6cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:20.946135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a1dbe952-63f0-4e3e-9924-d3bb61fec6cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:20.954482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a1dbe952-63f0-4e3e-9924-d3bb61fec6cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.094109 Sep 05 17:09:20.955051 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 390/791] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:20 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:21.185949 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-08b6e39d-1035-417b-bbc5-9cfe1e8a15c8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:21.188505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-08b6e39d-1035-417b-bbc5-9cfe1e8a15c8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:21.196817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-08b6e39d-1035-417b-bbc5-9cfe1e8a15c8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:21.197417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-08b6e39d-1035-417b-bbc5-9cfe1e8a15c8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:21.197954 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-08b6e39d-1035-417b-bbc5-9cfe1e8a15c8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:21.199048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-08b6e39d-1035-417b-bbc5-9cfe1e8a15c8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:21.199654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-08b6e39d-1035-417b-bbc5-9cfe1e8a15c8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:21.200182 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-08b6e39d-1035-417b-bbc5-9cfe1e8a15c8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:21.234049 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-08b6e39d-1035-417b-bbc5-9cfe1e8a15c8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055029 Sep 05 17:09:21.234600 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 402/792] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:21 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:21.982681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6b1791ec-b518-4957-be0c-f5f9a08236c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:21.984803 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6b1791ec-b518-4957-be0c-f5f9a08236c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:21.995605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b1791ec-b518-4957-be0c-f5f9a08236c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:21.996867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b1791ec-b518-4957-be0c-f5f9a08236c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:21.997309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b1791ec-b518-4957-be0c-f5f9a08236c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:21.998001 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b1791ec-b518-4957-be0c-f5f9a08236c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:21.998453 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b1791ec-b518-4957-be0c-f5f9a08236c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:21.998874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b1791ec-b518-4957-be0c-f5f9a08236c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:22.062945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6b1791ec-b518-4957-be0c-f5f9a08236c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:22.074571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6b1791ec-b518-4957-be0c-f5f9a08236c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098918 Sep 05 17:09:22.075120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 391/793] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:21 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:22.251764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3bb4c534-e8ea-415a-ac4e-fc15e1fe53aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:22.255116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3bb4c534-e8ea-415a-ac4e-fc15e1fe53aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:22.264828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bb4c534-e8ea-415a-ac4e-fc15e1fe53aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:22.265300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bb4c534-e8ea-415a-ac4e-fc15e1fe53aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:22.265725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bb4c534-e8ea-415a-ac4e-fc15e1fe53aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:22.266431 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bb4c534-e8ea-415a-ac4e-fc15e1fe53aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:22.266850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bb4c534-e8ea-415a-ac4e-fc15e1fe53aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:22.267259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bb4c534-e8ea-415a-ac4e-fc15e1fe53aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:22.296973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3bb4c534-e8ea-415a-ac4e-fc15e1fe53aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052560 Sep 05 17:09:22.297877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 403/794] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:22 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:23.098891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-834d2506-1ed5-4b6a-8b12-7deed89276f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:23.099633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-834d2506-1ed5-4b6a-8b12-7deed89276f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:23.108008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-834d2506-1ed5-4b6a-8b12-7deed89276f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:23.108510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-834d2506-1ed5-4b6a-8b12-7deed89276f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:23.108937 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-834d2506-1ed5-4b6a-8b12-7deed89276f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:23.109617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-834d2506-1ed5-4b6a-8b12-7deed89276f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:23.110061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-834d2506-1ed5-4b6a-8b12-7deed89276f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:23.110476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-834d2506-1ed5-4b6a-8b12-7deed89276f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:23.172566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-834d2506-1ed5-4b6a-8b12-7deed89276f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:23.180624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-834d2506-1ed5-4b6a-8b12-7deed89276f5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086620 Sep 05 17:09:23.181193 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 392/795] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:23 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:23.313349 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8ec20f3a-c6f5-46ee-a36b-2a6b24040c7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:23.315476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8ec20f3a-c6f5-46ee-a36b-2a6b24040c7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:23.322335 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ec20f3a-c6f5-46ee-a36b-2a6b24040c7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:23.322812 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ec20f3a-c6f5-46ee-a36b-2a6b24040c7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:23.323244 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ec20f3a-c6f5-46ee-a36b-2a6b24040c7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:23.323927 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ec20f3a-c6f5-46ee-a36b-2a6b24040c7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:23.324423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ec20f3a-c6f5-46ee-a36b-2a6b24040c7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:23.324842 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8ec20f3a-c6f5-46ee-a36b-2a6b24040c7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:23.356660 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8ec20f3a-c6f5-46ee-a36b-2a6b24040c7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047515 Sep 05 17:09:23.357153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 404/796] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:23 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:24.207743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ab74f107-bfcd-4a98-92fc-dfc29cd9a0ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:24.208798 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ab74f107-bfcd-4a98-92fc-dfc29cd9a0ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:24.218247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab74f107-bfcd-4a98-92fc-dfc29cd9a0ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:24.218741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab74f107-bfcd-4a98-92fc-dfc29cd9a0ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:24.219174 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab74f107-bfcd-4a98-92fc-dfc29cd9a0ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:24.219868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab74f107-bfcd-4a98-92fc-dfc29cd9a0ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:24.220365 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab74f107-bfcd-4a98-92fc-dfc29cd9a0ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:24.220788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab74f107-bfcd-4a98-92fc-dfc29cd9a0ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:24.285050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ab74f107-bfcd-4a98-92fc-dfc29cd9a0ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:24.292946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ab74f107-bfcd-4a98-92fc-dfc29cd9a0ad tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091792 Sep 05 17:09:24.293701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 393/797] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:24 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:24.373249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ce2bf924-6401-438f-bddc-543891b2f849 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:24.376419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ce2bf924-6401-438f-bddc-543891b2f849 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:24.386174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce2bf924-6401-438f-bddc-543891b2f849 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:24.387118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce2bf924-6401-438f-bddc-543891b2f849 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:24.387567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce2bf924-6401-438f-bddc-543891b2f849 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:24.388483 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce2bf924-6401-438f-bddc-543891b2f849 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:24.388927 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce2bf924-6401-438f-bddc-543891b2f849 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:24.389336 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce2bf924-6401-438f-bddc-543891b2f849 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:24.420308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ce2bf924-6401-438f-bddc-543891b2f849 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053068 Sep 05 17:09:24.420864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 405/798] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:24 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:25.320392 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ae917fca-3b82-486c-b885-719d10422f9f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:25.321469 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ae917fca-3b82-486c-b885-719d10422f9f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:25.329446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae917fca-3b82-486c-b885-719d10422f9f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:25.329921 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae917fca-3b82-486c-b885-719d10422f9f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:25.330343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae917fca-3b82-486c-b885-719d10422f9f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:25.331024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae917fca-3b82-486c-b885-719d10422f9f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:25.331469 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae917fca-3b82-486c-b885-719d10422f9f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:25.331884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae917fca-3b82-486c-b885-719d10422f9f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:25.400585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ae917fca-3b82-486c-b885-719d10422f9f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:25.408779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ae917fca-3b82-486c-b885-719d10422f9f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.094898 Sep 05 17:09:25.409347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 394/799] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:25 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:25.434950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2f27e5a3-06a4-4f78-855d-6279ab26ecad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:25.437166 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2f27e5a3-06a4-4f78-855d-6279ab26ecad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:25.444294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f27e5a3-06a4-4f78-855d-6279ab26ecad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:25.444770 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f27e5a3-06a4-4f78-855d-6279ab26ecad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:25.445192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f27e5a3-06a4-4f78-855d-6279ab26ecad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:25.445877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f27e5a3-06a4-4f78-855d-6279ab26ecad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:25.446315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f27e5a3-06a4-4f78-855d-6279ab26ecad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:25.446724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f27e5a3-06a4-4f78-855d-6279ab26ecad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:25.478463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2f27e5a3-06a4-4f78-855d-6279ab26ecad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048758 Sep 05 17:09:25.478992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 406/800] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:25 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:26.431208 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-925facd5-43d0-4450-b3c3-d77a9649f406 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:26.431795 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-925facd5-43d0-4450-b3c3-d77a9649f406 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:26.439018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925facd5-43d0-4450-b3c3-d77a9649f406 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:26.439525 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925facd5-43d0-4450-b3c3-d77a9649f406 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:26.439950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925facd5-43d0-4450-b3c3-d77a9649f406 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:26.440662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925facd5-43d0-4450-b3c3-d77a9649f406 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:26.441102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925facd5-43d0-4450-b3c3-d77a9649f406 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:26.441514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925facd5-43d0-4450-b3c3-d77a9649f406 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:26.491573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4e2c1844-744d-4b8f-ba14-aaae22caaee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:26.494026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4e2c1844-744d-4b8f-ba14-aaae22caaee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:26.501185 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e2c1844-744d-4b8f-ba14-aaae22caaee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:26.502052 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e2c1844-744d-4b8f-ba14-aaae22caaee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:26.502315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e2c1844-744d-4b8f-ba14-aaae22caaee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:26.503109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e2c1844-744d-4b8f-ba14-aaae22caaee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:26.503634 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e2c1844-744d-4b8f-ba14-aaae22caaee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:26.504051 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-925facd5-43d0-4450-b3c3-d77a9649f406 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:26.504199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e2c1844-744d-4b8f-ba14-aaae22caaee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:26.512014 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-925facd5-43d0-4450-b3c3-d77a9649f406 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.084675 Sep 05 17:09:26.513047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 395/801] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:26 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:26.522489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:09:26.535495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4e2c1844-744d-4b8f-ba14-aaae22caaee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048141 Sep 05 17:09:26.536081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 407/802] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:26 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:27.539841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1d0e76f0-f59a-4186-8f90-ad411f63f1ac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:27.541002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1d0e76f0-f59a-4186-8f90-ad411f63f1ac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:27.548672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d0e76f0-f59a-4186-8f90-ad411f63f1ac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:27.549207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d0e76f0-f59a-4186-8f90-ad411f63f1ac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:27.549357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6aaedc36-7345-4815-b6a4-5f8e73d0a07d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:27.549928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d0e76f0-f59a-4186-8f90-ad411f63f1ac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:27.550669 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d0e76f0-f59a-4186-8f90-ad411f63f1ac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:27.551186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d0e76f0-f59a-4186-8f90-ad411f63f1ac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:27.551337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6aaedc36-7345-4815-b6a4-5f8e73d0a07d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:27.551589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d0e76f0-f59a-4186-8f90-ad411f63f1ac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:27.557777 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6aaedc36-7345-4815-b6a4-5f8e73d0a07d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:27.558255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6aaedc36-7345-4815-b6a4-5f8e73d0a07d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:27.558681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6aaedc36-7345-4815-b6a4-5f8e73d0a07d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:27.559405 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6aaedc36-7345-4815-b6a4-5f8e73d0a07d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:27.559867 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6aaedc36-7345-4815-b6a4-5f8e73d0a07d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:27.560312 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6aaedc36-7345-4815-b6a4-5f8e73d0a07d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:27.590067 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6aaedc36-7345-4815-b6a4-5f8e73d0a07d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044869 Sep 05 17:09:27.595025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 408/803] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:27 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:27.618419 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1d0e76f0-f59a-4186-8f90-ad411f63f1ac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:27.630200 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1d0e76f0-f59a-4186-8f90-ad411f63f1ac tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.096613 Sep 05 17:09:27.630828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 396/804] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:27 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:28.607208 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a98de628-4656-453a-8563-f82ea4d9df24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:28.610251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a98de628-4656-453a-8563-f82ea4d9df24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:28.619896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a98de628-4656-453a-8563-f82ea4d9df24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:28.620600 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a98de628-4656-453a-8563-f82ea4d9df24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:28.621240 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a98de628-4656-453a-8563-f82ea4d9df24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:28.621944 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a98de628-4656-453a-8563-f82ea4d9df24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:28.622395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a98de628-4656-453a-8563-f82ea4d9df24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:28.622816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a98de628-4656-453a-8563-f82ea4d9df24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:28.654341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a98de628-4656-453a-8563-f82ea4d9df24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054036 Sep 05 17:09:28.654900 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 409/805] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:28 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:28.773905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bf791c2e-3358-48dd-a209-d60f17633c9a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:28.774523 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bf791c2e-3358-48dd-a209-d60f17633c9a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:28.776406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:09:28.781682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf791c2e-3358-48dd-a209-d60f17633c9a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:28.782160 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf791c2e-3358-48dd-a209-d60f17633c9a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:28.782585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf791c2e-3358-48dd-a209-d60f17633c9a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:28.783269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf791c2e-3358-48dd-a209-d60f17633c9a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:28.783715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf791c2e-3358-48dd-a209-d60f17633c9a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:28.784128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf791c2e-3358-48dd-a209-d60f17633c9a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:28.787471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:09:28.852524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bf791c2e-3358-48dd-a209-d60f17633c9a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:28.861966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bf791c2e-3358-48dd-a209-d60f17633c9a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.212782 Sep 05 17:09:28.862452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 397/806] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:28 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:29.670222 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c9a35813-aee7-4d99-92d1-5ded792c0b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:29.672597 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c9a35813-aee7-4d99-92d1-5ded792c0b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:29.675165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=56 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:09:29.681156 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9a35813-aee7-4d99-92d1-5ded792c0b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:29.681701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9a35813-aee7-4d99-92d1-5ded792c0b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:29.682162 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9a35813-aee7-4d99-92d1-5ded792c0b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:29.682914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9a35813-aee7-4d99-92d1-5ded792c0b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:29.683410 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9a35813-aee7-4d99-92d1-5ded792c0b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:29.683928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9a35813-aee7-4d99-92d1-5ded792c0b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:29.717991 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c9a35813-aee7-4d99-92d1-5ded792c0b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053633 Sep 05 17:09:29.718774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 410/807] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:29 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:29.888492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ff8e694c-886c-4fc0-a31e-7ba7d08692a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:29.889073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ff8e694c-886c-4fc0-a31e-7ba7d08692a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:29.896031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff8e694c-886c-4fc0-a31e-7ba7d08692a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:29.896552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff8e694c-886c-4fc0-a31e-7ba7d08692a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:29.896987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff8e694c-886c-4fc0-a31e-7ba7d08692a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:29.897690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff8e694c-886c-4fc0-a31e-7ba7d08692a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:29.898145 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff8e694c-886c-4fc0-a31e-7ba7d08692a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:29.898584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff8e694c-886c-4fc0-a31e-7ba7d08692a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:29.960474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ff8e694c-886c-4fc0-a31e-7ba7d08692a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:29.968481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ff8e694c-886c-4fc0-a31e-7ba7d08692a0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.085709 Sep 05 17:09:29.969056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 398/808] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:29 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:30.736497 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-373f7462-33ea-47ff-863c-7f74edd7a0c3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:30.739879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-373f7462-33ea-47ff-863c-7f74edd7a0c3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:30.749478 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-373f7462-33ea-47ff-863c-7f74edd7a0c3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:30.749966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-373f7462-33ea-47ff-863c-7f74edd7a0c3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:30.750399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-373f7462-33ea-47ff-863c-7f74edd7a0c3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:30.751097 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-373f7462-33ea-47ff-863c-7f74edd7a0c3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:30.751549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-373f7462-33ea-47ff-863c-7f74edd7a0c3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:30.751970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-373f7462-33ea-47ff-863c-7f74edd7a0c3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:30.782467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-373f7462-33ea-47ff-863c-7f74edd7a0c3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053078 Sep 05 17:09:30.783036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 411/809] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:30 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:30.992086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-30f85f83-cb82-4240-8983-5b77b83fd3b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:30.992733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-30f85f83-cb82-4240-8983-5b77b83fd3b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:30.999875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30f85f83-cb82-4240-8983-5b77b83fd3b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:31.000405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30f85f83-cb82-4240-8983-5b77b83fd3b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:31.000840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30f85f83-cb82-4240-8983-5b77b83fd3b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:31.001528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30f85f83-cb82-4240-8983-5b77b83fd3b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:31.001979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30f85f83-cb82-4240-8983-5b77b83fd3b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:31.002402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30f85f83-cb82-4240-8983-5b77b83fd3b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:31.070634 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-30f85f83-cb82-4240-8983-5b77b83fd3b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:31.079247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-30f85f83-cb82-4240-8983-5b77b83fd3b7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091280 Sep 05 17:09:31.079790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 399/810] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:30 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:31.796433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-42946c27-52f4-44fb-ae18-4381c71c07cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:31.798466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-42946c27-52f4-44fb-ae18-4381c71c07cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:31.805325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42946c27-52f4-44fb-ae18-4381c71c07cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:31.805838 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42946c27-52f4-44fb-ae18-4381c71c07cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:31.806262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42946c27-52f4-44fb-ae18-4381c71c07cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:31.806941 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42946c27-52f4-44fb-ae18-4381c71c07cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:31.807391 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42946c27-52f4-44fb-ae18-4381c71c07cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:31.807802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42946c27-52f4-44fb-ae18-4381c71c07cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:31.838247 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-42946c27-52f4-44fb-ae18-4381c71c07cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046396 Sep 05 17:09:31.838803 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 412/811] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:31 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:32.103916 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7dc8417d-6cda-48f3-9ca2-6d8eda4d5f66 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:32.104624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7dc8417d-6cda-48f3-9ca2-6d8eda4d5f66 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:32.111816 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7dc8417d-6cda-48f3-9ca2-6d8eda4d5f66 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:32.112469 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7dc8417d-6cda-48f3-9ca2-6d8eda4d5f66 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:32.112903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7dc8417d-6cda-48f3-9ca2-6d8eda4d5f66 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:32.113595 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7dc8417d-6cda-48f3-9ca2-6d8eda4d5f66 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:32.114042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7dc8417d-6cda-48f3-9ca2-6d8eda4d5f66 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:32.114460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7dc8417d-6cda-48f3-9ca2-6d8eda4d5f66 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:32.178435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7dc8417d-6cda-48f3-9ca2-6d8eda4d5f66 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:32.188719 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7dc8417d-6cda-48f3-9ca2-6d8eda4d5f66 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089846 Sep 05 17:09:32.189307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 400/812] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:32 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:32.858722 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7db39c84-0329-49d5-b73f-f855a1095f60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:32.861567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7db39c84-0329-49d5-b73f-f855a1095f60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:32.870666 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7db39c84-0329-49d5-b73f-f855a1095f60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:32.871303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7db39c84-0329-49d5-b73f-f855a1095f60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:32.872250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7db39c84-0329-49d5-b73f-f855a1095f60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:32.873337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7db39c84-0329-49d5-b73f-f855a1095f60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:32.873933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7db39c84-0329-49d5-b73f-f855a1095f60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:32.874488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7db39c84-0329-49d5-b73f-f855a1095f60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:32.908626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7db39c84-0329-49d5-b73f-f855a1095f60 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057082 Sep 05 17:09:32.909177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 413/813] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:32 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:33.213720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f0e99039-5a7e-43c7-8458-56f380c550b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:33.214473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f0e99039-5a7e-43c7-8458-56f380c550b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:33.222260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0e99039-5a7e-43c7-8458-56f380c550b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:33.222744 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0e99039-5a7e-43c7-8458-56f380c550b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:33.223168 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0e99039-5a7e-43c7-8458-56f380c550b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:33.223856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0e99039-5a7e-43c7-8458-56f380c550b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:33.224335 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0e99039-5a7e-43c7-8458-56f380c550b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:33.224752 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0e99039-5a7e-43c7-8458-56f380c550b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:33.292516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f0e99039-5a7e-43c7-8458-56f380c550b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:33.302128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f0e99039-5a7e-43c7-8458-56f380c550b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093799 Sep 05 17:09:33.302696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 401/814] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:33 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:33.926163 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7e164d92-0695-461f-9776-a46b8e1d396d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:33.929704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7e164d92-0695-461f-9776-a46b8e1d396d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:33.938750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e164d92-0695-461f-9776-a46b8e1d396d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:33.939224 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e164d92-0695-461f-9776-a46b8e1d396d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:33.939646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e164d92-0695-461f-9776-a46b8e1d396d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:33.940373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e164d92-0695-461f-9776-a46b8e1d396d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:33.940823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e164d92-0695-461f-9776-a46b8e1d396d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:33.941235 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e164d92-0695-461f-9776-a46b8e1d396d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:33.970717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7e164d92-0695-461f-9776-a46b8e1d396d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051552 Sep 05 17:09:33.971269 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 414/815] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:33 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:34.328850 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-64605a88-ab9d-4698-ad22-362124330f0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:34.329578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-64605a88-ab9d-4698-ad22-362124330f0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:34.337478 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64605a88-ab9d-4698-ad22-362124330f0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:34.338044 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64605a88-ab9d-4698-ad22-362124330f0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:34.338551 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64605a88-ab9d-4698-ad22-362124330f0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:34.339381 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64605a88-ab9d-4698-ad22-362124330f0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:34.339911 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64605a88-ab9d-4698-ad22-362124330f0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:34.340448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64605a88-ab9d-4698-ad22-362124330f0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:34.407974 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-64605a88-ab9d-4698-ad22-362124330f0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:34.415914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-64605a88-ab9d-4698-ad22-362124330f0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093276 Sep 05 17:09:34.416592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 402/816] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:34 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:34.986568 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-86aa70c0-016d-4076-a7d1-14f2677bda69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:34.989198 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-86aa70c0-016d-4076-a7d1-14f2677bda69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:34.997705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-86aa70c0-016d-4076-a7d1-14f2677bda69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:34.998293 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-86aa70c0-016d-4076-a7d1-14f2677bda69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:34.998847 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-86aa70c0-016d-4076-a7d1-14f2677bda69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:34.999684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-86aa70c0-016d-4076-a7d1-14f2677bda69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:35.000265 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-86aa70c0-016d-4076-a7d1-14f2677bda69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:35.000779 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-86aa70c0-016d-4076-a7d1-14f2677bda69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:35.034172 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-86aa70c0-016d-4076-a7d1-14f2677bda69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053329 Sep 05 17:09:35.034750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 415/817] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:34 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:35.440920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d45a8674-872b-4420-843f-5f5d4b1da60d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:35.441789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d45a8674-872b-4420-843f-5f5d4b1da60d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:35.451726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d45a8674-872b-4420-843f-5f5d4b1da60d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:35.452585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d45a8674-872b-4420-843f-5f5d4b1da60d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:35.453260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d45a8674-872b-4420-843f-5f5d4b1da60d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:35.454253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d45a8674-872b-4420-843f-5f5d4b1da60d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:35.454899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d45a8674-872b-4420-843f-5f5d4b1da60d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:35.455518 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d45a8674-872b-4420-843f-5f5d4b1da60d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:35.523038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d45a8674-872b-4420-843f-5f5d4b1da60d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:35.534746 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d45a8674-872b-4420-843f-5f5d4b1da60d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.099420 Sep 05 17:09:35.535325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 403/818] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:35 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:36.047219 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-584d56bc-dba2-4cc6-9005-f5447bd303ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:36.049446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-584d56bc-dba2-4cc6-9005-f5447bd303ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:36.056384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-584d56bc-dba2-4cc6-9005-f5447bd303ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:36.056858 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-584d56bc-dba2-4cc6-9005-f5447bd303ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:36.057290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-584d56bc-dba2-4cc6-9005-f5447bd303ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:36.058005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-584d56bc-dba2-4cc6-9005-f5447bd303ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:36.058491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-584d56bc-dba2-4cc6-9005-f5447bd303ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:36.058909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-584d56bc-dba2-4cc6-9005-f5447bd303ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:36.088587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-584d56bc-dba2-4cc6-9005-f5447bd303ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045530 Sep 05 17:09:36.089149 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 416/819] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:36 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:36.561938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a0ed3303-a4ca-417c-89b7-5392af2d62cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:36.563035 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a0ed3303-a4ca-417c-89b7-5392af2d62cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:36.573854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ed3303-a4ca-417c-89b7-5392af2d62cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:36.574646 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ed3303-a4ca-417c-89b7-5392af2d62cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:36.575358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ed3303-a4ca-417c-89b7-5392af2d62cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:36.576508 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ed3303-a4ca-417c-89b7-5392af2d62cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:36.577017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ed3303-a4ca-417c-89b7-5392af2d62cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:36.577377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ed3303-a4ca-417c-89b7-5392af2d62cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:36.642404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a0ed3303-a4ca-417c-89b7-5392af2d62cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:36.654638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a0ed3303-a4ca-417c-89b7-5392af2d62cc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.099571 Sep 05 17:09:36.655211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 404/820] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:36 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:37.102608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b1514a56-6c90-418e-a6b4-ee61c8a2f82d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:37.104787 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b1514a56-6c90-418e-a6b4-ee61c8a2f82d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:37.112054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1514a56-6c90-418e-a6b4-ee61c8a2f82d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:37.112572 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1514a56-6c90-418e-a6b4-ee61c8a2f82d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:37.112996 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1514a56-6c90-418e-a6b4-ee61c8a2f82d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:37.113681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1514a56-6c90-418e-a6b4-ee61c8a2f82d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:37.114125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1514a56-6c90-418e-a6b4-ee61c8a2f82d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:37.114537 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1514a56-6c90-418e-a6b4-ee61c8a2f82d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:37.144623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b1514a56-6c90-418e-a6b4-ee61c8a2f82d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046423 Sep 05 17:09:37.145196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 417/821] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:37 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:37.681706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f66e0964-5796-4576-b958-fee44b4329f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:37.682601 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f66e0964-5796-4576-b958-fee44b4329f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:37.690638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f66e0964-5796-4576-b958-fee44b4329f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:37.691120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f66e0964-5796-4576-b958-fee44b4329f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:37.691546 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f66e0964-5796-4576-b958-fee44b4329f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:37.692277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f66e0964-5796-4576-b958-fee44b4329f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:37.692728 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f66e0964-5796-4576-b958-fee44b4329f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:37.693120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f66e0964-5796-4576-b958-fee44b4329f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:37.758563 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f66e0964-5796-4576-b958-fee44b4329f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:37.767214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f66e0964-5796-4576-b958-fee44b4329f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092383 Sep 05 17:09:37.767870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 405/822] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:37 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:38.161588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0161687e-8620-4383-bf3f-ff637228dabf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:38.165036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0161687e-8620-4383-bf3f-ff637228dabf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:38.176729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0161687e-8620-4383-bf3f-ff637228dabf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:38.177519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0161687e-8620-4383-bf3f-ff637228dabf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:38.178218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0161687e-8620-4383-bf3f-ff637228dabf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:38.179336 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0161687e-8620-4383-bf3f-ff637228dabf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:38.180076 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0161687e-8620-4383-bf3f-ff637228dabf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:38.180816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0161687e-8620-4383-bf3f-ff637228dabf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:38.213687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0161687e-8620-4383-bf3f-ff637228dabf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059234 Sep 05 17:09:38.214454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 418/823] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:38 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:38.793273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-17457bd9-ee1f-4d8e-836b-44338766188f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:38.794333 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-17457bd9-ee1f-4d8e-836b-44338766188f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:38.801743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17457bd9-ee1f-4d8e-836b-44338766188f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:38.802225 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17457bd9-ee1f-4d8e-836b-44338766188f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:38.802662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17457bd9-ee1f-4d8e-836b-44338766188f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:38.803352 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17457bd9-ee1f-4d8e-836b-44338766188f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:38.803806 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17457bd9-ee1f-4d8e-836b-44338766188f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:38.804330 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17457bd9-ee1f-4d8e-836b-44338766188f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:38.864864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-17457bd9-ee1f-4d8e-836b-44338766188f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:38.872664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-17457bd9-ee1f-4d8e-836b-44338766188f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086037 Sep 05 17:09:38.873242 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 406/824] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:38 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:39.231485 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-17fab6d4-0e3e-44b6-ba04-5cbedeaffe6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:39.234341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-17fab6d4-0e3e-44b6-ba04-5cbedeaffe6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:39.241131 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17fab6d4-0e3e-44b6-ba04-5cbedeaffe6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:39.241609 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17fab6d4-0e3e-44b6-ba04-5cbedeaffe6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:39.242027 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17fab6d4-0e3e-44b6-ba04-5cbedeaffe6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:39.242711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17fab6d4-0e3e-44b6-ba04-5cbedeaffe6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:39.243148 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17fab6d4-0e3e-44b6-ba04-5cbedeaffe6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:39.243560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17fab6d4-0e3e-44b6-ba04-5cbedeaffe6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:39.273388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-17fab6d4-0e3e-44b6-ba04-5cbedeaffe6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049099 Sep 05 17:09:39.273932 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 419/825] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:39 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:39.900062 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6c1650b0-077e-44d7-8844-1bc67005239a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:39.901076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6c1650b0-077e-44d7-8844-1bc67005239a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:39.909559 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c1650b0-077e-44d7-8844-1bc67005239a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:39.910017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c1650b0-077e-44d7-8844-1bc67005239a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:39.910467 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c1650b0-077e-44d7-8844-1bc67005239a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:39.911144 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c1650b0-077e-44d7-8844-1bc67005239a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:39.911586 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c1650b0-077e-44d7-8844-1bc67005239a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:39.912000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c1650b0-077e-44d7-8844-1bc67005239a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:39.979074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6c1650b0-077e-44d7-8844-1bc67005239a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:39.987516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6c1650b0-077e-44d7-8844-1bc67005239a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.094085 Sep 05 17:09:39.988117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 407/826] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:39 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:40.290592 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-412aa1fc-42cd-49f4-b627-330b7fc4a309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:40.293919 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-412aa1fc-42cd-49f4-b627-330b7fc4a309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:40.301482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-412aa1fc-42cd-49f4-b627-330b7fc4a309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:40.301951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-412aa1fc-42cd-49f4-b627-330b7fc4a309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:40.302393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-412aa1fc-42cd-49f4-b627-330b7fc4a309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:40.303079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-412aa1fc-42cd-49f4-b627-330b7fc4a309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:40.303528 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-412aa1fc-42cd-49f4-b627-330b7fc4a309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:40.303950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-412aa1fc-42cd-49f4-b627-330b7fc4a309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:40.333810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-412aa1fc-42cd-49f4-b627-330b7fc4a309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050095 Sep 05 17:09:40.334369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 420/827] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:40 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:41.010402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e923ef5e-ed20-48b2-8da0-613148800d39 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:41.011161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e923ef5e-ed20-48b2-8da0-613148800d39 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:41.017920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e923ef5e-ed20-48b2-8da0-613148800d39 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:41.018428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e923ef5e-ed20-48b2-8da0-613148800d39 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:41.018858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e923ef5e-ed20-48b2-8da0-613148800d39 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:41.019551 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e923ef5e-ed20-48b2-8da0-613148800d39 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:41.019995 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e923ef5e-ed20-48b2-8da0-613148800d39 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:41.020427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e923ef5e-ed20-48b2-8da0-613148800d39 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:41.081514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e923ef5e-ed20-48b2-8da0-613148800d39 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:41.089494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e923ef5e-ed20-48b2-8da0-613148800d39 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.083157 Sep 05 17:09:41.090038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 408/828] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:41 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:41.353615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8e22e515-168a-4fc7-aa29-f19014afddc4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:41.357160 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8e22e515-168a-4fc7-aa29-f19014afddc4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:41.367861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e22e515-168a-4fc7-aa29-f19014afddc4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:41.368804 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e22e515-168a-4fc7-aa29-f19014afddc4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:41.369482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e22e515-168a-4fc7-aa29-f19014afddc4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:41.370636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e22e515-168a-4fc7-aa29-f19014afddc4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:41.371866 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e22e515-168a-4fc7-aa29-f19014afddc4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:41.372610 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e22e515-168a-4fc7-aa29-f19014afddc4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:41.404449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8e22e515-168a-4fc7-aa29-f19014afddc4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057941 Sep 05 17:09:41.405009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 421/829] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:41 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:42.112838 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-12159811-35da-45af-80f8-2ea2e959e0be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:42.113476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-12159811-35da-45af-80f8-2ea2e959e0be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:42.120091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12159811-35da-45af-80f8-2ea2e959e0be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:42.120604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12159811-35da-45af-80f8-2ea2e959e0be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:42.121081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12159811-35da-45af-80f8-2ea2e959e0be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:42.121711 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12159811-35da-45af-80f8-2ea2e959e0be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:42.122159 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12159811-35da-45af-80f8-2ea2e959e0be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:42.122608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12159811-35da-45af-80f8-2ea2e959e0be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:42.188986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-12159811-35da-45af-80f8-2ea2e959e0be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:42.197736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-12159811-35da-45af-80f8-2ea2e959e0be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089476 Sep 05 17:09:42.198306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 409/830] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:42 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:42.418081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-19a4875f-cbde-4411-8064-fa377b77c622 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:42.420276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-19a4875f-cbde-4411-8064-fa377b77c622 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:42.427484 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-19a4875f-cbde-4411-8064-fa377b77c622 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:42.427957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-19a4875f-cbde-4411-8064-fa377b77c622 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:42.428417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-19a4875f-cbde-4411-8064-fa377b77c622 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:42.429098 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-19a4875f-cbde-4411-8064-fa377b77c622 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:42.429546 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-19a4875f-cbde-4411-8064-fa377b77c622 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:42.429956 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-19a4875f-cbde-4411-8064-fa377b77c622 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:42.460583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-19a4875f-cbde-4411-8064-fa377b77c622 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046425 Sep 05 17:09:42.461281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 422/831] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:42 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:43.224446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d86dfca3-646f-4300-a79c-56d23dc3cc75 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:43.225819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d86dfca3-646f-4300-a79c-56d23dc3cc75 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:43.236344 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d86dfca3-646f-4300-a79c-56d23dc3cc75 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:43.236849 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d86dfca3-646f-4300-a79c-56d23dc3cc75 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:43.237257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d86dfca3-646f-4300-a79c-56d23dc3cc75 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:43.237943 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d86dfca3-646f-4300-a79c-56d23dc3cc75 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:43.238395 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d86dfca3-646f-4300-a79c-56d23dc3cc75 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:43.238813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d86dfca3-646f-4300-a79c-56d23dc3cc75 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:43.310216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d86dfca3-646f-4300-a79c-56d23dc3cc75 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:43.318941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d86dfca3-646f-4300-a79c-56d23dc3cc75 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.101195 Sep 05 17:09:43.319509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 410/832] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:43 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:43.478356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-96985802-f42f-4816-b833-62617b55ad00 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:43.481525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-96985802-f42f-4816-b833-62617b55ad00 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:43.491654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96985802-f42f-4816-b833-62617b55ad00 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:43.492456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96985802-f42f-4816-b833-62617b55ad00 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:43.493057 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96985802-f42f-4816-b833-62617b55ad00 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:43.494157 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96985802-f42f-4816-b833-62617b55ad00 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:43.494849 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96985802-f42f-4816-b833-62617b55ad00 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:43.495523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96985802-f42f-4816-b833-62617b55ad00 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:43.528526 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-96985802-f42f-4816-b833-62617b55ad00 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057313 Sep 05 17:09:43.529102 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 423/833] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:43 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:44.352190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fa19acd1-7c9c-4d6d-a310-b8d77f448680 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:44.352941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fa19acd1-7c9c-4d6d-a310-b8d77f448680 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:44.361534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa19acd1-7c9c-4d6d-a310-b8d77f448680 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:44.362119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa19acd1-7c9c-4d6d-a310-b8d77f448680 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:44.362649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa19acd1-7c9c-4d6d-a310-b8d77f448680 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:44.363496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa19acd1-7c9c-4d6d-a310-b8d77f448680 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:44.364041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa19acd1-7c9c-4d6d-a310-b8d77f448680 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:44.364592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa19acd1-7c9c-4d6d-a310-b8d77f448680 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:44.429914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fa19acd1-7c9c-4d6d-a310-b8d77f448680 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:44.437964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fa19acd1-7c9c-4d6d-a310-b8d77f448680 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.090887 Sep 05 17:09:44.438659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 411/834] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:44 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:44.545605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c5a01ceb-b2e5-48b8-ae7c-7ab4feb9b64f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:44.548376 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c5a01ceb-b2e5-48b8-ae7c-7ab4feb9b64f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:44.555280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c5a01ceb-b2e5-48b8-ae7c-7ab4feb9b64f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:44.555762 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c5a01ceb-b2e5-48b8-ae7c-7ab4feb9b64f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:44.556190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c5a01ceb-b2e5-48b8-ae7c-7ab4feb9b64f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:44.556910 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c5a01ceb-b2e5-48b8-ae7c-7ab4feb9b64f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:44.557361 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c5a01ceb-b2e5-48b8-ae7c-7ab4feb9b64f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:44.557776 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c5a01ceb-b2e5-48b8-ae7c-7ab4feb9b64f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:44.561415 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:09:44.588850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c5a01ceb-b2e5-48b8-ae7c-7ab4feb9b64f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049499 Sep 05 17:09:44.589329 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 424/835] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:44 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:45.466893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1db7d923-a3c6-4090-87cb-fff0b67ab1d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:45.467893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1db7d923-a3c6-4090-87cb-fff0b67ab1d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:45.479582 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1db7d923-a3c6-4090-87cb-fff0b67ab1d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:45.480428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1db7d923-a3c6-4090-87cb-fff0b67ab1d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:45.481134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1db7d923-a3c6-4090-87cb-fff0b67ab1d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:45.482257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1db7d923-a3c6-4090-87cb-fff0b67ab1d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:45.482997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1db7d923-a3c6-4090-87cb-fff0b67ab1d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:45.483683 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1db7d923-a3c6-4090-87cb-fff0b67ab1d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:45.556505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1db7d923-a3c6-4090-87cb-fff0b67ab1d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:45.566669 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1db7d923-a3c6-4090-87cb-fff0b67ab1d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.106395 Sep 05 17:09:45.567229 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 412/836] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:45 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:45.602415 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c90eb5d8-70b6-455c-9300-0e5e00f9c43c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:45.604595 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c90eb5d8-70b6-455c-9300-0e5e00f9c43c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:45.614968 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c90eb5d8-70b6-455c-9300-0e5e00f9c43c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:45.615454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c90eb5d8-70b6-455c-9300-0e5e00f9c43c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:45.615881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c90eb5d8-70b6-455c-9300-0e5e00f9c43c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:45.616632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c90eb5d8-70b6-455c-9300-0e5e00f9c43c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:45.617084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c90eb5d8-70b6-455c-9300-0e5e00f9c43c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:45.617504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c90eb5d8-70b6-455c-9300-0e5e00f9c43c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:45.650628 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c90eb5d8-70b6-455c-9300-0e5e00f9c43c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052476 Sep 05 17:09:45.651109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 425/837] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:45 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:46.589433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e123dede-8f23-4f9f-8488-89a2ec4bfdd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:46.590023 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e123dede-8f23-4f9f-8488-89a2ec4bfdd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:46.598173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e123dede-8f23-4f9f-8488-89a2ec4bfdd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:46.598638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e123dede-8f23-4f9f-8488-89a2ec4bfdd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:46.599057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e123dede-8f23-4f9f-8488-89a2ec4bfdd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:46.599744 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e123dede-8f23-4f9f-8488-89a2ec4bfdd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:46.600551 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e123dede-8f23-4f9f-8488-89a2ec4bfdd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:46.600961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e123dede-8f23-4f9f-8488-89a2ec4bfdd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:46.663703 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-28965a24-2a04-40bd-9dee-88f047ef7457 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:46.665987 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-28965a24-2a04-40bd-9dee-88f047ef7457 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:46.672930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-28965a24-2a04-40bd-9dee-88f047ef7457 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:46.673422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-28965a24-2a04-40bd-9dee-88f047ef7457 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:46.673564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e123dede-8f23-4f9f-8488-89a2ec4bfdd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:46.673852 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-28965a24-2a04-40bd-9dee-88f047ef7457 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:46.674553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-28965a24-2a04-40bd-9dee-88f047ef7457 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:46.675009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-28965a24-2a04-40bd-9dee-88f047ef7457 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:46.675427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-28965a24-2a04-40bd-9dee-88f047ef7457 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:46.676072 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:09:46.683089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e123dede-8f23-4f9f-8488-89a2ec4bfdd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.097570 Sep 05 17:09:46.683798 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 413/838] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:46 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:46.706087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-28965a24-2a04-40bd-9dee-88f047ef7457 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046514 Sep 05 17:09:46.706648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 426/839] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:46 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:47.711984 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-806b3768-0f7e-493d-9f81-a0b131f5fd5e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:47.713110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-806b3768-0f7e-493d-9f81-a0b131f5fd5e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:47.722481 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e5ed495b-2232-4962-97b5-d17f97c64f16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:47.725688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-806b3768-0f7e-493d-9f81-a0b131f5fd5e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:47.726493 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-806b3768-0f7e-493d-9f81-a0b131f5fd5e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:47.726745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e5ed495b-2232-4962-97b5-d17f97c64f16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:47.727198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-806b3768-0f7e-493d-9f81-a0b131f5fd5e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:47.728408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-806b3768-0f7e-493d-9f81-a0b131f5fd5e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:47.729152 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-806b3768-0f7e-493d-9f81-a0b131f5fd5e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:47.729830 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-806b3768-0f7e-493d-9f81-a0b131f5fd5e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:47.736527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e5ed495b-2232-4962-97b5-d17f97c64f16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:47.737012 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e5ed495b-2232-4962-97b5-d17f97c64f16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:47.737492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e5ed495b-2232-4962-97b5-d17f97c64f16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:47.738188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e5ed495b-2232-4962-97b5-d17f97c64f16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:47.738619 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e5ed495b-2232-4962-97b5-d17f97c64f16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:47.739039 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e5ed495b-2232-4962-97b5-d17f97c64f16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:47.769966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e5ed495b-2232-4962-97b5-d17f97c64f16 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054437 Sep 05 17:09:47.770554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 427/840] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:47 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:47.794147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-806b3768-0f7e-493d-9f81-a0b131f5fd5e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:47.802724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-806b3768-0f7e-493d-9f81-a0b131f5fd5e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.097479 Sep 05 17:09:47.803290 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 414/841] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:47 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:48.787440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7c37d822-f492-41a3-9e44-95c0723727ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:48.790920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7c37d822-f492-41a3-9e44-95c0723727ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:48.802182 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7c37d822-f492-41a3-9e44-95c0723727ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:48.802965 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7c37d822-f492-41a3-9e44-95c0723727ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:48.803670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7c37d822-f492-41a3-9e44-95c0723727ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:48.804998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7c37d822-f492-41a3-9e44-95c0723727ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:48.805740 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7c37d822-f492-41a3-9e44-95c0723727ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:48.806429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7c37d822-f492-41a3-9e44-95c0723727ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:48.826192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-91f93730-58a0-4721-9305-59b2c750da29 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:48.826800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-91f93730-58a0-4721-9305-59b2c750da29 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:48.833759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f93730-58a0-4721-9305-59b2c750da29 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:48.834485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f93730-58a0-4721-9305-59b2c750da29 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:48.834919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f93730-58a0-4721-9305-59b2c750da29 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:48.835626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f93730-58a0-4721-9305-59b2c750da29 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:48.836080 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f93730-58a0-4721-9305-59b2c750da29 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:48.836526 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f93730-58a0-4721-9305-59b2c750da29 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:48.838758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7c37d822-f492-41a3-9e44-95c0723727ee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058567 Sep 05 17:09:48.839330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 428/842] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:48 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:48.901948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-91f93730-58a0-4721-9305-59b2c750da29 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:48.909978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-91f93730-58a0-4721-9305-59b2c750da29 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087692 Sep 05 17:09:48.910537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 415/843] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:48 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:49.856470 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-26d3457c-9267-4ffa-ab34-f453618b2230 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:49.860002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-26d3457c-9267-4ffa-ab34-f453618b2230 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:49.866840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26d3457c-9267-4ffa-ab34-f453618b2230 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:49.867325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26d3457c-9267-4ffa-ab34-f453618b2230 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:49.867754 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26d3457c-9267-4ffa-ab34-f453618b2230 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:49.868489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26d3457c-9267-4ffa-ab34-f453618b2230 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:49.868940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26d3457c-9267-4ffa-ab34-f453618b2230 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:49.869361 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26d3457c-9267-4ffa-ab34-f453618b2230 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:49.899856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-26d3457c-9267-4ffa-ab34-f453618b2230 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050648 Sep 05 17:09:49.900461 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 429/844] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:49 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:49.944236 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d3b4713e-c8c5-40e1-93db-af714ad37d53 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:49.944871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d3b4713e-c8c5-40e1-93db-af714ad37d53 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:49.955047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3b4713e-c8c5-40e1-93db-af714ad37d53 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:49.955525 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3b4713e-c8c5-40e1-93db-af714ad37d53 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:49.955956 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3b4713e-c8c5-40e1-93db-af714ad37d53 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:49.956668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3b4713e-c8c5-40e1-93db-af714ad37d53 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:49.957119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3b4713e-c8c5-40e1-93db-af714ad37d53 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:49.957537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3b4713e-c8c5-40e1-93db-af714ad37d53 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:50.028322 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d3b4713e-c8c5-40e1-93db-af714ad37d53 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:50.036485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d3b4713e-c8c5-40e1-93db-af714ad37d53 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098997 Sep 05 17:09:50.037056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 416/845] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:49 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:50.914047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-430407b3-5668-45c0-b1fe-22bcd69c86cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:50.916181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-430407b3-5668-45c0-b1fe-22bcd69c86cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:50.923104 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-430407b3-5668-45c0-b1fe-22bcd69c86cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:50.923585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-430407b3-5668-45c0-b1fe-22bcd69c86cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:50.924011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-430407b3-5668-45c0-b1fe-22bcd69c86cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:50.924734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-430407b3-5668-45c0-b1fe-22bcd69c86cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:50.925181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-430407b3-5668-45c0-b1fe-22bcd69c86cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:50.925600 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-430407b3-5668-45c0-b1fe-22bcd69c86cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:50.955466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-430407b3-5668-45c0-b1fe-22bcd69c86cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045545 Sep 05 17:09:50.956036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 430/846] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:50 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:51.063005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fde1b86b-eadf-4f31-aaad-448e273ac773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:51.063599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fde1b86b-eadf-4f31-aaad-448e273ac773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:51.070675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fde1b86b-eadf-4f31-aaad-448e273ac773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:51.071156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fde1b86b-eadf-4f31-aaad-448e273ac773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:51.071586 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fde1b86b-eadf-4f31-aaad-448e273ac773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:51.072319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fde1b86b-eadf-4f31-aaad-448e273ac773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:51.072753 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fde1b86b-eadf-4f31-aaad-448e273ac773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:51.073186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fde1b86b-eadf-4f31-aaad-448e273ac773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:51.145059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fde1b86b-eadf-4f31-aaad-448e273ac773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:51.153291 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fde1b86b-eadf-4f31-aaad-448e273ac773 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.096779 Sep 05 17:09:51.153858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 417/847] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:51 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:51.434649 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-22d53193-7aca-4423-a1ad-289671ea0999 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-168104660"}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:09:51.435644 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-22d53193-7aca-4423-a1ad-289671ea0999 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:51.445715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22d53193-7aca-4423-a1ad-289671ea0999 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:51.446500 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22d53193-7aca-4423-a1ad-289671ea0999 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:51.447202 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22d53193-7aca-4423-a1ad-289671ea0999 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:51.448372 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22d53193-7aca-4423-a1ad-289671ea0999 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:51.449134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22d53193-7aca-4423-a1ad-289671ea0999 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:51.449810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22d53193-7aca-4423-a1ad-289671ea0999 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:51.588512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.network.security_group_api [None req-22d53193-7aca-4423-a1ad-289671ea0999 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Removing security group 17fa69dc-8629-4fab-ab0f-2a5f9e8fb719 from port 6e894232-478f-47a6-86f4-399c64bf7399 Sep 05 17:09:51.931506 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-22d53193-7aca-4423-a1ad-289671ea0999 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "POST /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/action" status: 202 len: 0 microversion: 2.1 time: 0.503180 Sep 05 17:09:51.932972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 431/848] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Sep 5 17:09:51 2022] POST /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:09:51.943892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-23fcbcd9-dbb1-4f45-88d3-5ffc32135628 req-2dc67eb7-ae76-44a0-a166-f8fce8a3b2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8c420ca-19c4-4f51-8091-e83672ea54ca", "tag": "6e894232-478f-47a6-86f4-399c64bf7399"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:09:51.956136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-23fcbcd9-dbb1-4f45-88d3-5ffc32135628 req-2dc67eb7-ae76-44a0-a166-f8fce8a3b2d9 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:51.956136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-23fcbcd9-dbb1-4f45-88d3-5ffc32135628 req-2dc67eb7-ae76-44a0-a166-f8fce8a3b2d9 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:51.956693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-23fcbcd9-dbb1-4f45-88d3-5ffc32135628 req-2dc67eb7-ae76-44a0-a166-f8fce8a3b2d9 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:51.968517 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-23fcbcd9-dbb1-4f45-88d3-5ffc32135628 req-2dc67eb7-ae76-44a0-a166-f8fce8a3b2d9 service nova] Creating event network-changed:6e894232-478f-47a6-86f4-399c64bf7399 for instance c8c420ca-19c4-4f51-8091-e83672ea54ca on hv-cinder-85596 Sep 05 17:09:51.968828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8639b51e-d20e-450b-868f-d2a1fea38b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:51.971122 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8639b51e-d20e-450b-868f-d2a1fea38b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:51.974619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-23fcbcd9-dbb1-4f45-88d3-5ffc32135628 req-2dc67eb7-ae76-44a0-a166-f8fce8a3b2d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034359 Sep 05 17:09:51.976474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 418/849] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:09:51.980611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8639b51e-d20e-450b-868f-d2a1fea38b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:51.981197 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8639b51e-d20e-450b-868f-d2a1fea38b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:51.981623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8639b51e-d20e-450b-868f-d2a1fea38b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:51.982317 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8639b51e-d20e-450b-868f-d2a1fea38b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:51.982761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8639b51e-d20e-450b-868f-d2a1fea38b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:51.983169 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8639b51e-d20e-450b-868f-d2a1fea38b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:52.025276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8639b51e-d20e-450b-868f-d2a1fea38b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060611 Sep 05 17:09:52.025872 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 432/850] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:51 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 17:09:52.176874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-29a294ab-e202-49a5-a5eb-188b88a41559 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:52.178240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-29a294ab-e202-49a5-a5eb-188b88a41559 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:52.186486 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29a294ab-e202-49a5-a5eb-188b88a41559 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:52.186985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29a294ab-e202-49a5-a5eb-188b88a41559 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:52.187425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29a294ab-e202-49a5-a5eb-188b88a41559 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:52.188952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29a294ab-e202-49a5-a5eb-188b88a41559 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:52.189543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29a294ab-e202-49a5-a5eb-188b88a41559 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:52.190007 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29a294ab-e202-49a5-a5eb-188b88a41559 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:52.280262 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-29a294ab-e202-49a5-a5eb-188b88a41559 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:52.290239 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-29a294ab-e202-49a5-a5eb-188b88a41559 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.117626 Sep 05 17:09:52.291156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 419/851] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:52 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:53.038640 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6bffcb54-ff28-45eb-8b6a-d6bd5c193ac3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:53.040732 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6bffcb54-ff28-45eb-8b6a-d6bd5c193ac3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:53.047738 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bffcb54-ff28-45eb-8b6a-d6bd5c193ac3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:53.048257 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bffcb54-ff28-45eb-8b6a-d6bd5c193ac3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:53.048707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bffcb54-ff28-45eb-8b6a-d6bd5c193ac3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:53.049379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bffcb54-ff28-45eb-8b6a-d6bd5c193ac3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:53.049853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bffcb54-ff28-45eb-8b6a-d6bd5c193ac3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:53.050292 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bffcb54-ff28-45eb-8b6a-d6bd5c193ac3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:53.081853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6bffcb54-ff28-45eb-8b6a-d6bd5c193ac3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047429 Sep 05 17:09:53.082739 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 433/852] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:53 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:53.317474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-faca1d80-97e3-419f-9767-8d6df14a500b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:53.318045 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-faca1d80-97e3-419f-9767-8d6df14a500b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:53.324682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-faca1d80-97e3-419f-9767-8d6df14a500b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:53.325162 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-faca1d80-97e3-419f-9767-8d6df14a500b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:53.325627 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-faca1d80-97e3-419f-9767-8d6df14a500b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:53.326309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-faca1d80-97e3-419f-9767-8d6df14a500b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:53.326749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-faca1d80-97e3-419f-9767-8d6df14a500b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:53.327163 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-faca1d80-97e3-419f-9767-8d6df14a500b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:53.404242 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-faca1d80-97e3-419f-9767-8d6df14a500b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:53.412267 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-faca1d80-97e3-419f-9767-8d6df14a500b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.099118 Sep 05 17:09:53.413667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 420/853] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:53 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:53.454935 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9c9e1c69-dc32-4f43-ab42-8f7f687e8251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:53.455533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9c9e1c69-dc32-4f43-ab42-8f7f687e8251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:53.461714 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c9e1c69-dc32-4f43-ab42-8f7f687e8251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:53.462274 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c9e1c69-dc32-4f43-ab42-8f7f687e8251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:53.462774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c9e1c69-dc32-4f43-ab42-8f7f687e8251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:53.463467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c9e1c69-dc32-4f43-ab42-8f7f687e8251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:53.463925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c9e1c69-dc32-4f43-ab42-8f7f687e8251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:53.464359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c9e1c69-dc32-4f43-ab42-8f7f687e8251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:54.003762 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-012f1b7a-5ae9-40f8-8090-994adc1d89e8 req-62259525-c465-4793-8a7c-265f0fba8dca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8c420ca-19c4-4f51-8091-e83672ea54ca", "tag": "6e894232-478f-47a6-86f4-399c64bf7399"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:09:54.014103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-012f1b7a-5ae9-40f8-8090-994adc1d89e8 req-62259525-c465-4793-8a7c-265f0fba8dca service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:54.014578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-012f1b7a-5ae9-40f8-8090-994adc1d89e8 req-62259525-c465-4793-8a7c-265f0fba8dca service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:54.015002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-012f1b7a-5ae9-40f8-8090-994adc1d89e8 req-62259525-c465-4793-8a7c-265f0fba8dca service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:54.026376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-012f1b7a-5ae9-40f8-8090-994adc1d89e8 req-62259525-c465-4793-8a7c-265f0fba8dca service nova] Creating event network-changed:6e894232-478f-47a6-86f4-399c64bf7399 for instance c8c420ca-19c4-4f51-8091-e83672ea54ca on hv-cinder-85596 Sep 05 17:09:54.031547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-012f1b7a-5ae9-40f8-8090-994adc1d89e8 req-62259525-c465-4793-8a7c-265f0fba8dca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031731 Sep 05 17:09:54.032433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 421/854] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:09:54.095355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bd6017c5-9e55-4351-bce3-f9e5f1dd5ab9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:54.097650 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bd6017c5-9e55-4351-bce3-f9e5f1dd5ab9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:54.111090 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd6017c5-9e55-4351-bce3-f9e5f1dd5ab9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:54.111591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd6017c5-9e55-4351-bce3-f9e5f1dd5ab9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:54.111987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd6017c5-9e55-4351-bce3-f9e5f1dd5ab9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:54.112934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd6017c5-9e55-4351-bce3-f9e5f1dd5ab9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:54.113378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd6017c5-9e55-4351-bce3-f9e5f1dd5ab9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:54.113755 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd6017c5-9e55-4351-bce3-f9e5f1dd5ab9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:54.147911 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bd6017c5-9e55-4351-bce3-f9e5f1dd5ab9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057125 Sep 05 17:09:54.148865 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 422/855] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:54 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 17:09:54.434853 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bc31a9dd-a246-46bd-a923-5d1f21509fb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:54.436237 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bc31a9dd-a246-46bd-a923-5d1f21509fb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:54.443407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc31a9dd-a246-46bd-a923-5d1f21509fb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:54.443673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc31a9dd-a246-46bd-a923-5d1f21509fb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:54.444105 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc31a9dd-a246-46bd-a923-5d1f21509fb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:54.445217 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc31a9dd-a246-46bd-a923-5d1f21509fb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:54.445388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc31a9dd-a246-46bd-a923-5d1f21509fb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:54.445928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc31a9dd-a246-46bd-a923-5d1f21509fb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:54.522615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bc31a9dd-a246-46bd-a923-5d1f21509fb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:54.531749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bc31a9dd-a246-46bd-a923-5d1f21509fb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.100257 Sep 05 17:09:54.532878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 423/856] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:54 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:09:55.163071 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cadc6863-b6f7-475a-b567-6ad4bc354c59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:55.166119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cadc6863-b6f7-475a-b567-6ad4bc354c59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:55.174038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cadc6863-b6f7-475a-b567-6ad4bc354c59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:55.174470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cadc6863-b6f7-475a-b567-6ad4bc354c59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:55.175089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cadc6863-b6f7-475a-b567-6ad4bc354c59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:55.175794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cadc6863-b6f7-475a-b567-6ad4bc354c59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:55.176250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cadc6863-b6f7-475a-b567-6ad4bc354c59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:55.176677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cadc6863-b6f7-475a-b567-6ad4bc354c59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:55.208067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cadc6863-b6f7-475a-b567-6ad4bc354c59 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050642 Sep 05 17:09:55.208665 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 424/857] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:55 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:55.555463 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-276e72aa-e841-485b-b05a-4aed12ddf1a4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:55.556202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-276e72aa-e841-485b-b05a-4aed12ddf1a4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:55.562894 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-276e72aa-e841-485b-b05a-4aed12ddf1a4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:55.563341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-276e72aa-e841-485b-b05a-4aed12ddf1a4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:55.563766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-276e72aa-e841-485b-b05a-4aed12ddf1a4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:55.564513 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-276e72aa-e841-485b-b05a-4aed12ddf1a4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:55.565204 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-276e72aa-e841-485b-b05a-4aed12ddf1a4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:55.565658 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-276e72aa-e841-485b-b05a-4aed12ddf1a4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:55.637699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-276e72aa-e841-485b-b05a-4aed12ddf1a4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:55.645750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-276e72aa-e841-485b-b05a-4aed12ddf1a4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.094370 Sep 05 17:09:55.646303 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 425/858] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:55 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:56.228435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-87bb896f-03b2-49fd-9b67-40cffe5278db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:56.231896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-87bb896f-03b2-49fd-9b67-40cffe5278db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:56.242364 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87bb896f-03b2-49fd-9b67-40cffe5278db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:56.243164 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87bb896f-03b2-49fd-9b67-40cffe5278db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:56.243878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87bb896f-03b2-49fd-9b67-40cffe5278db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:56.245072 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87bb896f-03b2-49fd-9b67-40cffe5278db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:56.245840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87bb896f-03b2-49fd-9b67-40cffe5278db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:56.246542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87bb896f-03b2-49fd-9b67-40cffe5278db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:56.278210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-87bb896f-03b2-49fd-9b67-40cffe5278db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057037 Sep 05 17:09:56.278747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 426/859] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:56 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 17:09:56.670815 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-760d7cac-eb80-4e32-bc72-08e13007345b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:56.671686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-760d7cac-eb80-4e32-bc72-08e13007345b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:56.679238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-760d7cac-eb80-4e32-bc72-08e13007345b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:56.679724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-760d7cac-eb80-4e32-bc72-08e13007345b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:56.680183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-760d7cac-eb80-4e32-bc72-08e13007345b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:56.680875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-760d7cac-eb80-4e32-bc72-08e13007345b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:56.681328 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-760d7cac-eb80-4e32-bc72-08e13007345b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:56.681766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-760d7cac-eb80-4e32-bc72-08e13007345b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:56.743142 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-760d7cac-eb80-4e32-bc72-08e13007345b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:56.751093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-760d7cac-eb80-4e32-bc72-08e13007345b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.085575 Sep 05 17:09:56.751659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 427/860] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:56 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:57.295490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0763c1cb-4389-4130-9cfe-9403eec444b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:57.298932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0763c1cb-4389-4130-9cfe-9403eec444b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:57.309348 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0763c1cb-4389-4130-9cfe-9403eec444b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:57.310126 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0763c1cb-4389-4130-9cfe-9403eec444b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:57.310830 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0763c1cb-4389-4130-9cfe-9403eec444b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:57.311947 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0763c1cb-4389-4130-9cfe-9403eec444b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:57.312716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0763c1cb-4389-4130-9cfe-9403eec444b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:57.313408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0763c1cb-4389-4130-9cfe-9403eec444b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:57.344441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0763c1cb-4389-4130-9cfe-9403eec444b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055660 Sep 05 17:09:57.344994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 428/861] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:57 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:57.778813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6d8e6c55-aafd-411a-9514-ed1e5bb41946 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:57.779876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6d8e6c55-aafd-411a-9514-ed1e5bb41946 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:57.791035 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d8e6c55-aafd-411a-9514-ed1e5bb41946 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:57.791807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d8e6c55-aafd-411a-9514-ed1e5bb41946 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:57.792575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d8e6c55-aafd-411a-9514-ed1e5bb41946 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:57.793748 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d8e6c55-aafd-411a-9514-ed1e5bb41946 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:57.794485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d8e6c55-aafd-411a-9514-ed1e5bb41946 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:57.795205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d8e6c55-aafd-411a-9514-ed1e5bb41946 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:57.859209 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6d8e6c55-aafd-411a-9514-ed1e5bb41946 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:57.867872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6d8e6c55-aafd-411a-9514-ed1e5bb41946 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095889 Sep 05 17:09:57.868486 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 429/862] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:57 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:58.358804 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b88137e0-0b82-4b4d-9d5f-d73e25ee5619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:58.360985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b88137e0-0b82-4b4d-9d5f-d73e25ee5619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:58.367542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b88137e0-0b82-4b4d-9d5f-d73e25ee5619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:58.367995 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b88137e0-0b82-4b4d-9d5f-d73e25ee5619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:58.368893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b88137e0-0b82-4b4d-9d5f-d73e25ee5619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:58.369580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b88137e0-0b82-4b4d-9d5f-d73e25ee5619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:58.370033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b88137e0-0b82-4b4d-9d5f-d73e25ee5619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:58.370454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b88137e0-0b82-4b4d-9d5f-d73e25ee5619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:58.404642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b88137e0-0b82-4b4d-9d5f-d73e25ee5619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049807 Sep 05 17:09:58.405200 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 430/863] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:58 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:09:58.896486 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a7d7f933-2ada-48ec-9429-e1fe051a2cbc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:58.897610 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a7d7f933-2ada-48ec-9429-e1fe051a2cbc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:58.901261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=68 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:09:58.910188 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a7d7f933-2ada-48ec-9429-e1fe051a2cbc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:58.910666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a7d7f933-2ada-48ec-9429-e1fe051a2cbc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:58.911096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a7d7f933-2ada-48ec-9429-e1fe051a2cbc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:58.911777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a7d7f933-2ada-48ec-9429-e1fe051a2cbc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:58.912255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a7d7f933-2ada-48ec-9429-e1fe051a2cbc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:58.912663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a7d7f933-2ada-48ec-9429-e1fe051a2cbc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:58.979316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a7d7f933-2ada-48ec-9429-e1fe051a2cbc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:09:58.981558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:09:58.988791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a7d7f933-2ada-48ec-9429-e1fe051a2cbc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098752 Sep 05 17:09:58.989390 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 431/864] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:09:58 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:09:59.420019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-818ecccb-8c20-40f0-9b3c-d8c415354fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:09:59.423276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-818ecccb-8c20-40f0-9b3c-d8c415354fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:09:59.431608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-818ecccb-8c20-40f0-9b3c-d8c415354fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:59.432343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-818ecccb-8c20-40f0-9b3c-d8c415354fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:59.432940 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-818ecccb-8c20-40f0-9b3c-d8c415354fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:59.433926 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-818ecccb-8c20-40f0-9b3c-d8c415354fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:09:59.434570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-818ecccb-8c20-40f0-9b3c-d8c415354fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:09:59.435139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-818ecccb-8c20-40f0-9b3c-d8c415354fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:09:59.467161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-818ecccb-8c20-40f0-9b3c-d8c415354fa8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053797 Sep 05 17:09:59.467721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 432/865] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:09:59 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:00.015397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-15c66ed0-8dcf-4d66-a814-b33f83fb118f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:00.016599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-15c66ed0-8dcf-4d66-a814-b33f83fb118f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:00.024666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15c66ed0-8dcf-4d66-a814-b33f83fb118f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:00.025161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15c66ed0-8dcf-4d66-a814-b33f83fb118f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:00.025587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15c66ed0-8dcf-4d66-a814-b33f83fb118f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:00.026266 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15c66ed0-8dcf-4d66-a814-b33f83fb118f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:00.026711 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15c66ed0-8dcf-4d66-a814-b33f83fb118f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:00.027123 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15c66ed0-8dcf-4d66-a814-b33f83fb118f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:00.096448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-15c66ed0-8dcf-4d66-a814-b33f83fb118f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:00.104899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-15c66ed0-8dcf-4d66-a814-b33f83fb118f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.096069 Sep 05 17:10:00.105472 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 433/866] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:00 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:00.484675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a4573e8c-0394-4d8e-a564-e51c4151ec35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:00.488999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a4573e8c-0394-4d8e-a564-e51c4151ec35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:00.499103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4573e8c-0394-4d8e-a564-e51c4151ec35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:00.499919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4573e8c-0394-4d8e-a564-e51c4151ec35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:00.500713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4573e8c-0394-4d8e-a564-e51c4151ec35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:00.501943 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4573e8c-0394-4d8e-a564-e51c4151ec35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:00.502692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4573e8c-0394-4d8e-a564-e51c4151ec35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:00.503885 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4573e8c-0394-4d8e-a564-e51c4151ec35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:00.534406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a4573e8c-0394-4d8e-a564-e51c4151ec35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056447 Sep 05 17:10:00.535446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 434/867] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:00 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 17:10:01.129279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d6d14099-eb24-4a6b-800f-542b1304a991 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:01.129916 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d6d14099-eb24-4a6b-800f-542b1304a991 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:01.136410 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6d14099-eb24-4a6b-800f-542b1304a991 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:01.136879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6d14099-eb24-4a6b-800f-542b1304a991 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:01.137316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6d14099-eb24-4a6b-800f-542b1304a991 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:01.138010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6d14099-eb24-4a6b-800f-542b1304a991 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:01.138461 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6d14099-eb24-4a6b-800f-542b1304a991 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:01.138881 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6d14099-eb24-4a6b-800f-542b1304a991 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:01.200345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d6d14099-eb24-4a6b-800f-542b1304a991 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:01.208769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d6d14099-eb24-4a6b-800f-542b1304a991 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.085025 Sep 05 17:10:01.209322 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 435/868] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:01 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:01.551417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e04790d8-586e-424c-b571-3e02c115960d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:01.553623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e04790d8-586e-424c-b571-3e02c115960d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:01.560492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e04790d8-586e-424c-b571-3e02c115960d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:01.560966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e04790d8-586e-424c-b571-3e02c115960d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:01.561390 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e04790d8-586e-424c-b571-3e02c115960d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:01.562072 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e04790d8-586e-424c-b571-3e02c115960d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:01.562512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e04790d8-586e-424c-b571-3e02c115960d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:01.562925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e04790d8-586e-424c-b571-3e02c115960d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:01.592030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e04790d8-586e-424c-b571-3e02c115960d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047045 Sep 05 17:10:01.592677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 436/869] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:01 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:02.240758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-83082d42-fac9-4eee-8a95-e43ae5e9df44 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:02.241588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-83082d42-fac9-4eee-8a95-e43ae5e9df44 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:02.249489 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83082d42-fac9-4eee-8a95-e43ae5e9df44 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:02.250061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83082d42-fac9-4eee-8a95-e43ae5e9df44 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:02.250569 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83082d42-fac9-4eee-8a95-e43ae5e9df44 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:02.251378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83082d42-fac9-4eee-8a95-e43ae5e9df44 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:02.251910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83082d42-fac9-4eee-8a95-e43ae5e9df44 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:02.252438 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83082d42-fac9-4eee-8a95-e43ae5e9df44 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:02.317870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-83082d42-fac9-4eee-8a95-e43ae5e9df44 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:02.328758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-83082d42-fac9-4eee-8a95-e43ae5e9df44 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093522 Sep 05 17:10:02.329560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 437/870] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:02 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:02.609536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-95532ff7-12ff-40b5-927d-ec5da8830c2d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:02.612937 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-95532ff7-12ff-40b5-927d-ec5da8830c2d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:02.622863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95532ff7-12ff-40b5-927d-ec5da8830c2d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:02.623422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95532ff7-12ff-40b5-927d-ec5da8830c2d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:02.624100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95532ff7-12ff-40b5-927d-ec5da8830c2d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:02.625046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95532ff7-12ff-40b5-927d-ec5da8830c2d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:02.625657 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95532ff7-12ff-40b5-927d-ec5da8830c2d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:02.626272 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95532ff7-12ff-40b5-927d-ec5da8830c2d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:02.657296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-95532ff7-12ff-40b5-927d-ec5da8830c2d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054661 Sep 05 17:10:02.657864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 438/871] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:02 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 17:10:03.355562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-80d1bb36-d80a-4eda-bac4-253cac077fcb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:03.356463 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-80d1bb36-d80a-4eda-bac4-253cac077fcb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:03.365005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d1bb36-d80a-4eda-bac4-253cac077fcb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:03.365626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d1bb36-d80a-4eda-bac4-253cac077fcb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:03.366165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d1bb36-d80a-4eda-bac4-253cac077fcb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:03.367020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d1bb36-d80a-4eda-bac4-253cac077fcb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:03.367586 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d1bb36-d80a-4eda-bac4-253cac077fcb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:03.368115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d1bb36-d80a-4eda-bac4-253cac077fcb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:03.438870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-80d1bb36-d80a-4eda-bac4-253cac077fcb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:03.447165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-80d1bb36-d80a-4eda-bac4-253cac077fcb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.096956 Sep 05 17:10:03.447733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 439/872] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:03 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:03.459622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=49 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:10:03.484659 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=60 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:10:03.675161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-15ff177c-d1f6-43df-bd3f-422464a8967e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:03.678163 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-15ff177c-d1f6-43df-bd3f-422464a8967e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:03.684714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15ff177c-d1f6-43df-bd3f-422464a8967e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:03.685203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15ff177c-d1f6-43df-bd3f-422464a8967e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:03.685632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15ff177c-d1f6-43df-bd3f-422464a8967e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:03.686391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15ff177c-d1f6-43df-bd3f-422464a8967e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:03.686778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15ff177c-d1f6-43df-bd3f-422464a8967e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:03.687202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15ff177c-d1f6-43df-bd3f-422464a8967e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:03.717159 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-15ff177c-d1f6-43df-bd3f-422464a8967e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048897 Sep 05 17:10:03.717709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 440/873] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:03 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:04.474638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-43b4ebb7-9232-4000-b0c7-fff7f93a4ee8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:04.476004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-43b4ebb7-9232-4000-b0c7-fff7f93a4ee8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:04.487819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43b4ebb7-9232-4000-b0c7-fff7f93a4ee8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:04.488681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43b4ebb7-9232-4000-b0c7-fff7f93a4ee8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:04.490001 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43b4ebb7-9232-4000-b0c7-fff7f93a4ee8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:04.490704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43b4ebb7-9232-4000-b0c7-fff7f93a4ee8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:04.491155 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43b4ebb7-9232-4000-b0c7-fff7f93a4ee8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:04.491606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43b4ebb7-9232-4000-b0c7-fff7f93a4ee8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:04.554422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-43b4ebb7-9232-4000-b0c7-fff7f93a4ee8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:04.562629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-43b4ebb7-9232-4000-b0c7-fff7f93a4ee8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095095 Sep 05 17:10:04.563192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 441/874] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:04 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:04.731002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dea665cd-85fb-477c-afe5-f0afd262c3ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:04.733219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dea665cd-85fb-477c-afe5-f0afd262c3ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:04.739656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dea665cd-85fb-477c-afe5-f0afd262c3ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:04.740137 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dea665cd-85fb-477c-afe5-f0afd262c3ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:04.740593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dea665cd-85fb-477c-afe5-f0afd262c3ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:04.741283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dea665cd-85fb-477c-afe5-f0afd262c3ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:04.741730 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dea665cd-85fb-477c-afe5-f0afd262c3ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:04.742152 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dea665cd-85fb-477c-afe5-f0afd262c3ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:04.774420 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dea665cd-85fb-477c-afe5-f0afd262c3ab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047474 Sep 05 17:10:04.774973 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 442/875] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:04 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:05.597377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c9c20898-ed64-479b-b4fd-66e047c122e3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:05.598604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c9c20898-ed64-479b-b4fd-66e047c122e3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:05.606015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9c20898-ed64-479b-b4fd-66e047c122e3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:05.606505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9c20898-ed64-479b-b4fd-66e047c122e3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:05.606932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9c20898-ed64-479b-b4fd-66e047c122e3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:05.607627 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9c20898-ed64-479b-b4fd-66e047c122e3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:05.608082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9c20898-ed64-479b-b4fd-66e047c122e3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:05.608538 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9c20898-ed64-479b-b4fd-66e047c122e3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:05.842877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c9c20898-ed64-479b-b4fd-66e047c122e3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:05.854964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c9c20898-ed64-479b-b4fd-66e047c122e3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.263904 Sep 05 17:10:05.855763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 443/876] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:05 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:05.862731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bba8209a-b6b3-4d41-a12e-3b72b3a8ad21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:05.866163 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bba8209a-b6b3-4d41-a12e-3b72b3a8ad21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:05.871947 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bba8209a-b6b3-4d41-a12e-3b72b3a8ad21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:05.872538 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bba8209a-b6b3-4d41-a12e-3b72b3a8ad21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:05.872968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bba8209a-b6b3-4d41-a12e-3b72b3a8ad21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:05.873649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bba8209a-b6b3-4d41-a12e-3b72b3a8ad21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:05.874090 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bba8209a-b6b3-4d41-a12e-3b72b3a8ad21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:05.874506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bba8209a-b6b3-4d41-a12e-3b72b3a8ad21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:05.904301 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bba8209a-b6b3-4d41-a12e-3b72b3a8ad21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047210 Sep 05 17:10:05.904831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 444/877] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:05 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:06.885790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-198c1d58-f8cf-4fda-9e7d-50e8e4aeaabd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:06.886884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-198c1d58-f8cf-4fda-9e7d-50e8e4aeaabd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:06.897658 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-198c1d58-f8cf-4fda-9e7d-50e8e4aeaabd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:06.898473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-198c1d58-f8cf-4fda-9e7d-50e8e4aeaabd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:06.899196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-198c1d58-f8cf-4fda-9e7d-50e8e4aeaabd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:06.900355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-198c1d58-f8cf-4fda-9e7d-50e8e4aeaabd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:06.901186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-198c1d58-f8cf-4fda-9e7d-50e8e4aeaabd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:06.901894 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-198c1d58-f8cf-4fda-9e7d-50e8e4aeaabd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:06.970214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-198c1d58-f8cf-4fda-9e7d-50e8e4aeaabd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:06.978999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-198c1d58-f8cf-4fda-9e7d-50e8e4aeaabd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.100349 Sep 05 17:10:06.979540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 445/878] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:06 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:06.984076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cc7cba6b-c510-46c9-b797-a1603fff5cee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:06.986215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cc7cba6b-c510-46c9-b797-a1603fff5cee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:06.992319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc7cba6b-c510-46c9-b797-a1603fff5cee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:06.992817 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc7cba6b-c510-46c9-b797-a1603fff5cee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:06.993254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc7cba6b-c510-46c9-b797-a1603fff5cee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:06.993951 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc7cba6b-c510-46c9-b797-a1603fff5cee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:06.994403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc7cba6b-c510-46c9-b797-a1603fff5cee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:06.994826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc7cba6b-c510-46c9-b797-a1603fff5cee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:07.025230 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cc7cba6b-c510-46c9-b797-a1603fff5cee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044618 Sep 05 17:10:07.025754 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 446/879] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:06 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:08.006550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1904134f-7bb2-4d90-b60f-145a7a2c8272 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:08.006550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1904134f-7bb2-4d90-b60f-145a7a2c8272 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:08.019375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1904134f-7bb2-4d90-b60f-145a7a2c8272 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:08.020823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1904134f-7bb2-4d90-b60f-145a7a2c8272 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:08.021919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1904134f-7bb2-4d90-b60f-145a7a2c8272 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:08.022656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1904134f-7bb2-4d90-b60f-145a7a2c8272 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:08.023113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1904134f-7bb2-4d90-b60f-145a7a2c8272 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:08.023537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1904134f-7bb2-4d90-b60f-145a7a2c8272 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:08.095690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1904134f-7bb2-4d90-b60f-145a7a2c8272 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:08.108008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1904134f-7bb2-4d90-b60f-145a7a2c8272 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.108732 Sep 05 17:10:08.108609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 447/880] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:07 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:08.113219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3ce5c367-7f90-410e-9297-afa059b4decf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:08.115435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3ce5c367-7f90-410e-9297-afa059b4decf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:08.121684 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ce5c367-7f90-410e-9297-afa059b4decf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:08.122184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ce5c367-7f90-410e-9297-afa059b4decf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:08.122619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ce5c367-7f90-410e-9297-afa059b4decf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:08.123313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ce5c367-7f90-410e-9297-afa059b4decf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:08.123759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ce5c367-7f90-410e-9297-afa059b4decf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:08.124194 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ce5c367-7f90-410e-9297-afa059b4decf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:08.137979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:10:08.155464 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3ce5c367-7f90-410e-9297-afa059b4decf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045860 Sep 05 17:10:08.156030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 448/881] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:08 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:09.131709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-16173fd1-2cea-4869-b2cb-27d1d67d6fd4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:09.132460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-16173fd1-2cea-4869-b2cb-27d1d67d6fd4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:09.139335 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16173fd1-2cea-4869-b2cb-27d1d67d6fd4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:09.139815 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16173fd1-2cea-4869-b2cb-27d1d67d6fd4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:09.140269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16173fd1-2cea-4869-b2cb-27d1d67d6fd4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:09.140950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16173fd1-2cea-4869-b2cb-27d1d67d6fd4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:09.141391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16173fd1-2cea-4869-b2cb-27d1d67d6fd4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:09.141799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16173fd1-2cea-4869-b2cb-27d1d67d6fd4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:09.203877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-16173fd1-2cea-4869-b2cb-27d1d67d6fd4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:09.211946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-16173fd1-2cea-4869-b2cb-27d1d67d6fd4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.084223 Sep 05 17:10:09.212536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 449/882] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:09 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:09.217124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0a3deaca-0531-4605-95c5-844f13a7f752 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:09.219215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0a3deaca-0531-4605-95c5-844f13a7f752 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:09.225500 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a3deaca-0531-4605-95c5-844f13a7f752 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:09.226157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a3deaca-0531-4605-95c5-844f13a7f752 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:09.226682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a3deaca-0531-4605-95c5-844f13a7f752 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:09.227364 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a3deaca-0531-4605-95c5-844f13a7f752 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:09.227807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a3deaca-0531-4605-95c5-844f13a7f752 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:09.228238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a3deaca-0531-4605-95c5-844f13a7f752 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:09.258275 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0a3deaca-0531-4605-95c5-844f13a7f752 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044744 Sep 05 17:10:09.258813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 450/883] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:09 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:09.950406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.objects.instance [None req-9c9e1c69-dc32-4f43-ab42-8f7f687e8251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lazy-loading 'services' on Instance uuid c8c420ca-19c4-4f51-8091-e83672ea54ca {{(pid=120733) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:10:10.097596 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9c9e1c69-dc32-4f43-ab42-8f7f687e8251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments/845219e9-5e7d-4f7d-97f1-99b468c4eca7" status: 202 len: 0 microversion: 2.1 time: 16.646590 Sep 05 17:10:10.098270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 434/884] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Sep 5 17:09:53 2022] DELETE /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments/845219e9-5e7d-4f7d-97f1-99b468c4eca7 => generated 0 bytes in 16648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:10:10.107470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c82274ef-f1b2-4c0a-882f-28a14d07a494 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:10.109791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c82274ef-f1b2-4c0a-882f-28a14d07a494 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:10.117530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c82274ef-f1b2-4c0a-882f-28a14d07a494 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:10.118347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c82274ef-f1b2-4c0a-882f-28a14d07a494 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:10.118893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c82274ef-f1b2-4c0a-882f-28a14d07a494 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:10.119932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c82274ef-f1b2-4c0a-882f-28a14d07a494 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:10.120634 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c82274ef-f1b2-4c0a-882f-28a14d07a494 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:10.121252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c82274ef-f1b2-4c0a-882f-28a14d07a494 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:10.153894 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c82274ef-f1b2-4c0a-882f-28a14d07a494 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050431 Sep 05 17:10:10.154537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 451/885] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:10 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:10.241406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3341876e-b68d-4352-b2aa-92e4365f1747 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:10.242479 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3341876e-b68d-4352-b2aa-92e4365f1747 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:10.249548 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3341876e-b68d-4352-b2aa-92e4365f1747 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:10.250048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3341876e-b68d-4352-b2aa-92e4365f1747 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:10.250502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3341876e-b68d-4352-b2aa-92e4365f1747 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:10.251243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3341876e-b68d-4352-b2aa-92e4365f1747 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:10.251689 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3341876e-b68d-4352-b2aa-92e4365f1747 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:10.252123 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3341876e-b68d-4352-b2aa-92e4365f1747 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:10.271405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-60ef253e-2c86-4391-aebc-eb098ec5a0f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:10.273796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-60ef253e-2c86-4391-aebc-eb098ec5a0f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:10.279847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60ef253e-2c86-4391-aebc-eb098ec5a0f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:10.280373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60ef253e-2c86-4391-aebc-eb098ec5a0f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:10.280808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60ef253e-2c86-4391-aebc-eb098ec5a0f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:10.281496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60ef253e-2c86-4391-aebc-eb098ec5a0f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:10.281946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60ef253e-2c86-4391-aebc-eb098ec5a0f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:10.282363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60ef253e-2c86-4391-aebc-eb098ec5a0f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:10.312787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-60ef253e-2c86-4391-aebc-eb098ec5a0f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045606 Sep 05 17:10:10.313420 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 452/886] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:10 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:10.318046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3341876e-b68d-4352-b2aa-92e4365f1747 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:10.326370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3341876e-b68d-4352-b2aa-92e4365f1747 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093001 Sep 05 17:10:10.326931 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 435/887] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:10 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:11.173110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7b6e16b8-f60d-4c9a-8095-0c2b7044dec2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:11.176623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7b6e16b8-f60d-4c9a-8095-0c2b7044dec2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:11.185447 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b6e16b8-f60d-4c9a-8095-0c2b7044dec2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:11.185933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b6e16b8-f60d-4c9a-8095-0c2b7044dec2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:11.186370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b6e16b8-f60d-4c9a-8095-0c2b7044dec2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:11.187065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b6e16b8-f60d-4c9a-8095-0c2b7044dec2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:11.187520 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b6e16b8-f60d-4c9a-8095-0c2b7044dec2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:11.187942 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b6e16b8-f60d-4c9a-8095-0c2b7044dec2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:11.216967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7b6e16b8-f60d-4c9a-8095-0c2b7044dec2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050619 Sep 05 17:10:11.217512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 453/888] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:11 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:11.330489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f41023a9-6f4d-409d-8db5-a037d401bf5d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:11.334033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f41023a9-6f4d-409d-8db5-a037d401bf5d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:11.345218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f41023a9-6f4d-409d-8db5-a037d401bf5d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:11.345856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f41023a9-6f4d-409d-8db5-a037d401bf5d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:11.346579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f41023a9-6f4d-409d-8db5-a037d401bf5d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:11.347701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f41023a9-6f4d-409d-8db5-a037d401bf5d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:11.348493 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f41023a9-6f4d-409d-8db5-a037d401bf5d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:11.349179 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f41023a9-6f4d-409d-8db5-a037d401bf5d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:11.354163 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-628fa4fa-4814-4376-b137-d40287bb4ac4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:11.354935 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-628fa4fa-4814-4376-b137-d40287bb4ac4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:11.361176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-628fa4fa-4814-4376-b137-d40287bb4ac4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:11.361658 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-628fa4fa-4814-4376-b137-d40287bb4ac4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:11.362084 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-628fa4fa-4814-4376-b137-d40287bb4ac4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:11.362772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-628fa4fa-4814-4376-b137-d40287bb4ac4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:11.363219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-628fa4fa-4814-4376-b137-d40287bb4ac4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:11.363635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-628fa4fa-4814-4376-b137-d40287bb4ac4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:11.381468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f41023a9-6f4d-409d-8db5-a037d401bf5d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057881 Sep 05 17:10:11.382025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 436/889] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:11 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:11.425211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-628fa4fa-4814-4376-b137-d40287bb4ac4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:11.433611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-628fa4fa-4814-4376-b137-d40287bb4ac4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086609 Sep 05 17:10:11.434164 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 454/890] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:11 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:12.234840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1ec5f6d0-1e31-454c-9d97-5dccb9d4f091 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:12.238329 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1ec5f6d0-1e31-454c-9d97-5dccb9d4f091 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:12.248885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ec5f6d0-1e31-454c-9d97-5dccb9d4f091 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:12.249693 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ec5f6d0-1e31-454c-9d97-5dccb9d4f091 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:12.250415 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ec5f6d0-1e31-454c-9d97-5dccb9d4f091 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:12.251554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ec5f6d0-1e31-454c-9d97-5dccb9d4f091 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:12.252352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ec5f6d0-1e31-454c-9d97-5dccb9d4f091 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:12.253063 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ec5f6d0-1e31-454c-9d97-5dccb9d4f091 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:12.287008 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1ec5f6d0-1e31-454c-9d97-5dccb9d4f091 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059207 Sep 05 17:10:12.287571 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 437/891] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:12 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:12.394756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bb7c983d-2c7a-4610-bda1-41eb530bd948 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:12.396962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bb7c983d-2c7a-4610-bda1-41eb530bd948 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:12.404406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb7c983d-2c7a-4610-bda1-41eb530bd948 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:12.404887 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb7c983d-2c7a-4610-bda1-41eb530bd948 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:12.405316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb7c983d-2c7a-4610-bda1-41eb530bd948 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:12.406003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb7c983d-2c7a-4610-bda1-41eb530bd948 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:12.406455 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb7c983d-2c7a-4610-bda1-41eb530bd948 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:12.406869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb7c983d-2c7a-4610-bda1-41eb530bd948 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:12.436897 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bb7c983d-2c7a-4610-bda1-41eb530bd948 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046443 Sep 05 17:10:12.437441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 455/892] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:12 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:12.459730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-eabf6b5f-814c-4209-bec8-dfcd4c47932e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:12.460428 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-eabf6b5f-814c-4209-bec8-dfcd4c47932e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:12.467900 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eabf6b5f-814c-4209-bec8-dfcd4c47932e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:12.468427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eabf6b5f-814c-4209-bec8-dfcd4c47932e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:12.468867 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eabf6b5f-814c-4209-bec8-dfcd4c47932e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:12.469558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eabf6b5f-814c-4209-bec8-dfcd4c47932e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:12.470007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eabf6b5f-814c-4209-bec8-dfcd4c47932e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:12.470429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eabf6b5f-814c-4209-bec8-dfcd4c47932e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:12.535362 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-eabf6b5f-814c-4209-bec8-dfcd4c47932e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:12.544198 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-eabf6b5f-814c-4209-bec8-dfcd4c47932e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091285 Sep 05 17:10:12.544773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 438/893] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:12 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:13.304258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-92f2c893-814d-4475-a5fe-289cb20ed55f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:13.307337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-92f2c893-814d-4475-a5fe-289cb20ed55f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:13.313744 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92f2c893-814d-4475-a5fe-289cb20ed55f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:13.314227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92f2c893-814d-4475-a5fe-289cb20ed55f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:13.314656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92f2c893-814d-4475-a5fe-289cb20ed55f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:13.315345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92f2c893-814d-4475-a5fe-289cb20ed55f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:13.315791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92f2c893-814d-4475-a5fe-289cb20ed55f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:13.316209 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92f2c893-814d-4475-a5fe-289cb20ed55f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:13.346317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-92f2c893-814d-4475-a5fe-289cb20ed55f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048868 Sep 05 17:10:13.346867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 456/894] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:13 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:13.453412 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-38336d8e-65ab-4ef2-aff3-50adad3b0198 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:13.457026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-38336d8e-65ab-4ef2-aff3-50adad3b0198 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:13.467026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38336d8e-65ab-4ef2-aff3-50adad3b0198 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:13.467606 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38336d8e-65ab-4ef2-aff3-50adad3b0198 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:13.468029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38336d8e-65ab-4ef2-aff3-50adad3b0198 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:13.469054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38336d8e-65ab-4ef2-aff3-50adad3b0198 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:13.469749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38336d8e-65ab-4ef2-aff3-50adad3b0198 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:13.470029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38336d8e-65ab-4ef2-aff3-50adad3b0198 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:13.501675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-38336d8e-65ab-4ef2-aff3-50adad3b0198 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055030 Sep 05 17:10:13.502235 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 439/895] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:13 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:13.570199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ce3bf296-52f2-4f1d-9e6b-a18172c8c708 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:13.570950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ce3bf296-52f2-4f1d-9e6b-a18172c8c708 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:13.578683 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce3bf296-52f2-4f1d-9e6b-a18172c8c708 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:13.579159 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce3bf296-52f2-4f1d-9e6b-a18172c8c708 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:13.579583 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce3bf296-52f2-4f1d-9e6b-a18172c8c708 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:13.580299 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce3bf296-52f2-4f1d-9e6b-a18172c8c708 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:13.580743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce3bf296-52f2-4f1d-9e6b-a18172c8c708 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:13.581155 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce3bf296-52f2-4f1d-9e6b-a18172c8c708 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:13.649867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ce3bf296-52f2-4f1d-9e6b-a18172c8c708 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:13.657845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ce3bf296-52f2-4f1d-9e6b-a18172c8c708 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093828 Sep 05 17:10:13.658396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 457/896] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:13 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:14.362105 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-72469a76-bc1c-4996-8fcc-380585bcddb6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:14.364523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-72469a76-bc1c-4996-8fcc-380585bcddb6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:14.372053 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72469a76-bc1c-4996-8fcc-380585bcddb6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:14.372802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72469a76-bc1c-4996-8fcc-380585bcddb6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:14.373362 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72469a76-bc1c-4996-8fcc-380585bcddb6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:14.374515 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72469a76-bc1c-4996-8fcc-380585bcddb6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:14.374515 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72469a76-bc1c-4996-8fcc-380585bcddb6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:14.375017 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72469a76-bc1c-4996-8fcc-380585bcddb6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:14.405990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-72469a76-bc1c-4996-8fcc-380585bcddb6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048150 Sep 05 17:10:14.406548 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 440/897] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:14 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:14.514914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-549ff217-eb94-40f0-bf77-439c9b1e926a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:14.517089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-549ff217-eb94-40f0-bf77-439c9b1e926a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:14.523593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-549ff217-eb94-40f0-bf77-439c9b1e926a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:14.524070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-549ff217-eb94-40f0-bf77-439c9b1e926a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:14.524523 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-549ff217-eb94-40f0-bf77-439c9b1e926a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:14.525283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-549ff217-eb94-40f0-bf77-439c9b1e926a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:14.525781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-549ff217-eb94-40f0-bf77-439c9b1e926a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:14.526147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-549ff217-eb94-40f0-bf77-439c9b1e926a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:14.557377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-549ff217-eb94-40f0-bf77-439c9b1e926a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046273 Sep 05 17:10:14.557870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 458/898] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:14 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:14.683878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-64645f04-a8c8-4bbc-bf92-f53f6f66e6ce tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:14.684608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-64645f04-a8c8-4bbc-bf92-f53f6f66e6ce tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:14.692930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64645f04-a8c8-4bbc-bf92-f53f6f66e6ce tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:14.693527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64645f04-a8c8-4bbc-bf92-f53f6f66e6ce tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:14.694058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64645f04-a8c8-4bbc-bf92-f53f6f66e6ce tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:14.694896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64645f04-a8c8-4bbc-bf92-f53f6f66e6ce tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:14.695454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64645f04-a8c8-4bbc-bf92-f53f6f66e6ce tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:14.695976 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64645f04-a8c8-4bbc-bf92-f53f6f66e6ce tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:14.761737 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-64645f04-a8c8-4bbc-bf92-f53f6f66e6ce tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:14.769642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-64645f04-a8c8-4bbc-bf92-f53f6f66e6ce tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091841 Sep 05 17:10:14.770201 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 441/899] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:14 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:15.419098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-79a596e0-4d9d-4dbf-be63-aa23608901a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:15.421279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-79a596e0-4d9d-4dbf-be63-aa23608901a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:15.428081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79a596e0-4d9d-4dbf-be63-aa23608901a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:15.428591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79a596e0-4d9d-4dbf-be63-aa23608901a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:15.429019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79a596e0-4d9d-4dbf-be63-aa23608901a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:15.429699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79a596e0-4d9d-4dbf-be63-aa23608901a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:15.430170 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79a596e0-4d9d-4dbf-be63-aa23608901a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:15.430561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79a596e0-4d9d-4dbf-be63-aa23608901a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:15.460486 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-79a596e0-4d9d-4dbf-be63-aa23608901a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045511 Sep 05 17:10:15.461022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 459/900] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:15 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:15.576449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e1dedc88-5cd2-4c62-b89b-1b8f17a731b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:15.580072 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e1dedc88-5cd2-4c62-b89b-1b8f17a731b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:15.590251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1dedc88-5cd2-4c62-b89b-1b8f17a731b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:15.590878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1dedc88-5cd2-4c62-b89b-1b8f17a731b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:15.591448 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1dedc88-5cd2-4c62-b89b-1b8f17a731b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:15.592486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1dedc88-5cd2-4c62-b89b-1b8f17a731b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:15.593030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1dedc88-5cd2-4c62-b89b-1b8f17a731b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:15.597972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1dedc88-5cd2-4c62-b89b-1b8f17a731b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:15.636648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e1dedc88-5cd2-4c62-b89b-1b8f17a731b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066930 Sep 05 17:10:15.636989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 442/901] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:15 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:15.797066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e57f6a12-4d2b-4019-bba1-6afa07b032e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:15.798052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e57f6a12-4d2b-4019-bba1-6afa07b032e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:15.808541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e57f6a12-4d2b-4019-bba1-6afa07b032e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:15.809328 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e57f6a12-4d2b-4019-bba1-6afa07b032e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:15.810029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e57f6a12-4d2b-4019-bba1-6afa07b032e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:15.811146 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e57f6a12-4d2b-4019-bba1-6afa07b032e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:15.811889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e57f6a12-4d2b-4019-bba1-6afa07b032e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:15.812620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e57f6a12-4d2b-4019-bba1-6afa07b032e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:15.884446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e57f6a12-4d2b-4019-bba1-6afa07b032e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:15.893624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e57f6a12-4d2b-4019-bba1-6afa07b032e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.103406 Sep 05 17:10:15.894121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 460/902] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:15 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:16.478345 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-99f84aa1-0575-4a43-a99f-c66b8f6d14fd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:16.481234 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-99f84aa1-0575-4a43-a99f-c66b8f6d14fd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:16.488192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99f84aa1-0575-4a43-a99f-c66b8f6d14fd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:16.488673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99f84aa1-0575-4a43-a99f-c66b8f6d14fd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:16.489099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99f84aa1-0575-4a43-a99f-c66b8f6d14fd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:16.489775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99f84aa1-0575-4a43-a99f-c66b8f6d14fd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:16.490220 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99f84aa1-0575-4a43-a99f-c66b8f6d14fd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:16.490631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99f84aa1-0575-4a43-a99f-c66b8f6d14fd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:16.520734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-99f84aa1-0575-4a43-a99f-c66b8f6d14fd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049709 Sep 05 17:10:16.521298 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 443/903] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:16 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:16.654347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b482ff16-cb1a-405f-8020-014426bcf160 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:16.656508 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b482ff16-cb1a-405f-8020-014426bcf160 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:16.665606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b482ff16-cb1a-405f-8020-014426bcf160 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:16.666091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b482ff16-cb1a-405f-8020-014426bcf160 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:16.666514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b482ff16-cb1a-405f-8020-014426bcf160 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:16.667590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b482ff16-cb1a-405f-8020-014426bcf160 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:16.668042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b482ff16-cb1a-405f-8020-014426bcf160 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:16.668495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b482ff16-cb1a-405f-8020-014426bcf160 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:16.699961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b482ff16-cb1a-405f-8020-014426bcf160 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052942 Sep 05 17:10:16.700546 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 461/904] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:16 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:16.926512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5f4d96f4-fc9d-4337-85d5-aa0fdaa3b6f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:16.927407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5f4d96f4-fc9d-4337-85d5-aa0fdaa3b6f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:16.936410 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f4d96f4-fc9d-4337-85d5-aa0fdaa3b6f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:16.937110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f4d96f4-fc9d-4337-85d5-aa0fdaa3b6f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:16.937494 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f4d96f4-fc9d-4337-85d5-aa0fdaa3b6f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:16.938257 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f4d96f4-fc9d-4337-85d5-aa0fdaa3b6f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:16.938748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f4d96f4-fc9d-4337-85d5-aa0fdaa3b6f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:16.939166 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f4d96f4-fc9d-4337-85d5-aa0fdaa3b6f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:17.014417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5f4d96f4-fc9d-4337-85d5-aa0fdaa3b6f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:17.022501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5f4d96f4-fc9d-4337-85d5-aa0fdaa3b6f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.102637 Sep 05 17:10:17.023073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 444/905] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:16 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:17.537949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b26e1496-b52b-48a0-8a70-a74822e5fae3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:17.541485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b26e1496-b52b-48a0-8a70-a74822e5fae3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:17.548050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b26e1496-b52b-48a0-8a70-a74822e5fae3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:17.548563 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b26e1496-b52b-48a0-8a70-a74822e5fae3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:17.548994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b26e1496-b52b-48a0-8a70-a74822e5fae3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:17.549682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b26e1496-b52b-48a0-8a70-a74822e5fae3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:17.550126 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b26e1496-b52b-48a0-8a70-a74822e5fae3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:17.550547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b26e1496-b52b-48a0-8a70-a74822e5fae3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:17.579749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b26e1496-b52b-48a0-8a70-a74822e5fae3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048473 Sep 05 17:10:17.580336 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 462/906] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:17 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:17.717594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-49cb88ac-9b89-4d43-8695-587f7dd4ebee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:17.720024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-49cb88ac-9b89-4d43-8695-587f7dd4ebee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:17.728184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49cb88ac-9b89-4d43-8695-587f7dd4ebee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:17.728784 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49cb88ac-9b89-4d43-8695-587f7dd4ebee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:17.729260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49cb88ac-9b89-4d43-8695-587f7dd4ebee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:17.730230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49cb88ac-9b89-4d43-8695-587f7dd4ebee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:17.730958 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49cb88ac-9b89-4d43-8695-587f7dd4ebee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:17.731458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49cb88ac-9b89-4d43-8695-587f7dd4ebee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:17.763599 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-49cb88ac-9b89-4d43-8695-587f7dd4ebee tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052068 Sep 05 17:10:17.764183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 445/907] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:17 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:18.048637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f9f5b141-fdc7-4709-9e31-fcdd385c6ec6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:18.049260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f9f5b141-fdc7-4709-9e31-fcdd385c6ec6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:18.056302 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f5b141-fdc7-4709-9e31-fcdd385c6ec6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:18.056810 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f5b141-fdc7-4709-9e31-fcdd385c6ec6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:18.057265 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f5b141-fdc7-4709-9e31-fcdd385c6ec6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:18.058094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f5b141-fdc7-4709-9e31-fcdd385c6ec6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:18.058680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f5b141-fdc7-4709-9e31-fcdd385c6ec6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:18.058975 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f5b141-fdc7-4709-9e31-fcdd385c6ec6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:18.127084 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f9f5b141-fdc7-4709-9e31-fcdd385c6ec6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:18.135184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f9f5b141-fdc7-4709-9e31-fcdd385c6ec6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092376 Sep 05 17:10:18.135739 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 463/908] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:18 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:18.596870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9a30ae1b-e6b2-4a0d-b721-28fedf41c1af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:18.600736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9a30ae1b-e6b2-4a0d-b721-28fedf41c1af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:18.611447 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a30ae1b-e6b2-4a0d-b721-28fedf41c1af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:18.612285 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a30ae1b-e6b2-4a0d-b721-28fedf41c1af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:18.612996 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a30ae1b-e6b2-4a0d-b721-28fedf41c1af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:18.614238 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a30ae1b-e6b2-4a0d-b721-28fedf41c1af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:18.614890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a30ae1b-e6b2-4a0d-b721-28fedf41c1af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:18.615591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a30ae1b-e6b2-4a0d-b721-28fedf41c1af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:18.648449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9a30ae1b-e6b2-4a0d-b721-28fedf41c1af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058322 Sep 05 17:10:18.649014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 446/909] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:18 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:18.780912 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2a482fe9-69a2-4ced-b9a0-83d90035242a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:18.784422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2a482fe9-69a2-4ced-b9a0-83d90035242a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:18.794535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a482fe9-69a2-4ced-b9a0-83d90035242a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:18.795041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a482fe9-69a2-4ced-b9a0-83d90035242a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:18.795475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a482fe9-69a2-4ced-b9a0-83d90035242a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:18.796193 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a482fe9-69a2-4ced-b9a0-83d90035242a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:18.796654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a482fe9-69a2-4ced-b9a0-83d90035242a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:18.797075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a482fe9-69a2-4ced-b9a0-83d90035242a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:18.826625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2a482fe9-69a2-4ced-b9a0-83d90035242a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052756 Sep 05 17:10:18.827176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 464/910] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:18 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:19.161195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0911e38e-595f-4fd6-bc88-ac1f8abc5dc3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:19.162302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0911e38e-595f-4fd6-bc88-ac1f8abc5dc3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:19.173492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0911e38e-595f-4fd6-bc88-ac1f8abc5dc3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:19.174282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0911e38e-595f-4fd6-bc88-ac1f8abc5dc3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:19.174980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0911e38e-595f-4fd6-bc88-ac1f8abc5dc3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:19.176105 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0911e38e-595f-4fd6-bc88-ac1f8abc5dc3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:19.176889 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0911e38e-595f-4fd6-bc88-ac1f8abc5dc3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:19.177576 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0911e38e-595f-4fd6-bc88-ac1f8abc5dc3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:19.241751 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0911e38e-595f-4fd6-bc88-ac1f8abc5dc3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:19.249853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0911e38e-595f-4fd6-bc88-ac1f8abc5dc3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095376 Sep 05 17:10:19.250424 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 447/911] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:19 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:19.665435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1daf740e-e7be-48c8-9541-d9d2835038f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:19.668964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1daf740e-e7be-48c8-9541-d9d2835038f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:19.675675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1daf740e-e7be-48c8-9541-d9d2835038f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:19.676183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1daf740e-e7be-48c8-9541-d9d2835038f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:19.676604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1daf740e-e7be-48c8-9541-d9d2835038f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:19.677286 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1daf740e-e7be-48c8-9541-d9d2835038f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:19.677726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1daf740e-e7be-48c8-9541-d9d2835038f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:19.678141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1daf740e-e7be-48c8-9541-d9d2835038f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:19.680506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:10:19.708445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1daf740e-e7be-48c8-9541-d9d2835038f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049660 Sep 05 17:10:19.709000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 465/912] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:19 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:19.842861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-63c7e2c4-73c1-452d-bd52-dbd25d54dc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:19.845268 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-63c7e2c4-73c1-452d-bd52-dbd25d54dc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:19.852532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63c7e2c4-73c1-452d-bd52-dbd25d54dc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:19.853058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63c7e2c4-73c1-452d-bd52-dbd25d54dc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:19.853550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63c7e2c4-73c1-452d-bd52-dbd25d54dc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:19.854274 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63c7e2c4-73c1-452d-bd52-dbd25d54dc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:19.854769 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63c7e2c4-73c1-452d-bd52-dbd25d54dc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:19.855260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63c7e2c4-73c1-452d-bd52-dbd25d54dc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:19.886240 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-63c7e2c4-73c1-452d-bd52-dbd25d54dc23 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049691 Sep 05 17:10:19.886780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 448/913] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:19 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:20.277077 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c8b04644-a276-4000-9cbf-0b6a2eb7aa85 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:20.278309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c8b04644-a276-4000-9cbf-0b6a2eb7aa85 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:20.288769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8b04644-a276-4000-9cbf-0b6a2eb7aa85 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:20.289573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8b04644-a276-4000-9cbf-0b6a2eb7aa85 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:20.290292 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8b04644-a276-4000-9cbf-0b6a2eb7aa85 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:20.291417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8b04644-a276-4000-9cbf-0b6a2eb7aa85 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:20.292187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8b04644-a276-4000-9cbf-0b6a2eb7aa85 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:20.292889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8b04644-a276-4000-9cbf-0b6a2eb7aa85 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:20.361771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c8b04644-a276-4000-9cbf-0b6a2eb7aa85 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:20.370159 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c8b04644-a276-4000-9cbf-0b6a2eb7aa85 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.099656 Sep 05 17:10:20.370731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 466/914] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:20 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:20.726353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a72c173f-a749-4980-ba50-1539db7cadfb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:20.729819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a72c173f-a749-4980-ba50-1539db7cadfb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:20.740874 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a72c173f-a749-4980-ba50-1539db7cadfb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:20.741702 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a72c173f-a749-4980-ba50-1539db7cadfb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:20.742404 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a72c173f-a749-4980-ba50-1539db7cadfb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:20.743638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a72c173f-a749-4980-ba50-1539db7cadfb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:20.744423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a72c173f-a749-4980-ba50-1539db7cadfb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:20.745109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a72c173f-a749-4980-ba50-1539db7cadfb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:20.776841 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a72c173f-a749-4980-ba50-1539db7cadfb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057794 Sep 05 17:10:20.777392 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 449/915] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:20 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:20.899498 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-82b3ebdb-ba8e-4368-b146-2e804531cc1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:20.901730 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-82b3ebdb-ba8e-4368-b146-2e804531cc1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:20.908603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82b3ebdb-ba8e-4368-b146-2e804531cc1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:20.909078 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82b3ebdb-ba8e-4368-b146-2e804531cc1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:20.909501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82b3ebdb-ba8e-4368-b146-2e804531cc1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:20.910178 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82b3ebdb-ba8e-4368-b146-2e804531cc1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:20.910621 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82b3ebdb-ba8e-4368-b146-2e804531cc1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:20.911033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82b3ebdb-ba8e-4368-b146-2e804531cc1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:20.941269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-82b3ebdb-ba8e-4368-b146-2e804531cc1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045923 Sep 05 17:10:20.941811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 467/916] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:20 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:21.394066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-42e840bd-41de-4a49-b010-bf28b5d8dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:21.394666 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-42e840bd-41de-4a49-b010-bf28b5d8dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:21.401142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42e840bd-41de-4a49-b010-bf28b5d8dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:21.401618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42e840bd-41de-4a49-b010-bf28b5d8dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:21.402040 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42e840bd-41de-4a49-b010-bf28b5d8dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:21.402742 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42e840bd-41de-4a49-b010-bf28b5d8dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:21.403227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42e840bd-41de-4a49-b010-bf28b5d8dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:21.403733 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42e840bd-41de-4a49-b010-bf28b5d8dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:21.423750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:10:21.471213 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-42e840bd-41de-4a49-b010-bf28b5d8dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:21.479698 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-42e840bd-41de-4a49-b010-bf28b5d8dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089638 Sep 05 17:10:21.480308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 450/917] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:21 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:21.794202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-015d082a-b8ef-43f0-9b2f-923caf7ed5b4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:21.796580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-015d082a-b8ef-43f0-9b2f-923caf7ed5b4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:21.803727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-015d082a-b8ef-43f0-9b2f-923caf7ed5b4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:21.804295 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-015d082a-b8ef-43f0-9b2f-923caf7ed5b4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:21.804797 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-015d082a-b8ef-43f0-9b2f-923caf7ed5b4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:21.805527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-015d082a-b8ef-43f0-9b2f-923caf7ed5b4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:21.806017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-015d082a-b8ef-43f0-9b2f-923caf7ed5b4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:21.806479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-015d082a-b8ef-43f0-9b2f-923caf7ed5b4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:21.838882 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-015d082a-b8ef-43f0-9b2f-923caf7ed5b4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051574 Sep 05 17:10:21.839412 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 468/918] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:21 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:21.960525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-21fc36b2-f375-44c2-af15-22793cbdfaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:21.963979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-21fc36b2-f375-44c2-af15-22793cbdfaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:21.975563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-21fc36b2-f375-44c2-af15-22793cbdfaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:21.976430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-21fc36b2-f375-44c2-af15-22793cbdfaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:21.977151 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-21fc36b2-f375-44c2-af15-22793cbdfaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:21.978303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-21fc36b2-f375-44c2-af15-22793cbdfaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:21.979056 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-21fc36b2-f375-44c2-af15-22793cbdfaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:21.979750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-21fc36b2-f375-44c2-af15-22793cbdfaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:22.010492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-21fc36b2-f375-44c2-af15-22793cbdfaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056761 Sep 05 17:10:22.011056 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 451/919] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:21 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:22.507163 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-523b6d24-dab6-4235-9811-fc345aa8c38b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:22.508131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-523b6d24-dab6-4235-9811-fc345aa8c38b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:22.516902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-523b6d24-dab6-4235-9811-fc345aa8c38b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:22.517377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-523b6d24-dab6-4235-9811-fc345aa8c38b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:22.517804 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-523b6d24-dab6-4235-9811-fc345aa8c38b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:22.518484 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-523b6d24-dab6-4235-9811-fc345aa8c38b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:22.518923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-523b6d24-dab6-4235-9811-fc345aa8c38b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:22.519447 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-523b6d24-dab6-4235-9811-fc345aa8c38b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:22.581802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-523b6d24-dab6-4235-9811-fc345aa8c38b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:22.589669 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-523b6d24-dab6-4235-9811-fc345aa8c38b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089223 Sep 05 17:10:22.590220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 469/920] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:22 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:22.855715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-56e12caf-ec31-4c1f-8057-c8932c04dd05 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:22.859652 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-56e12caf-ec31-4c1f-8057-c8932c04dd05 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:22.870153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56e12caf-ec31-4c1f-8057-c8932c04dd05 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:22.870935 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56e12caf-ec31-4c1f-8057-c8932c04dd05 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:22.871745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56e12caf-ec31-4c1f-8057-c8932c04dd05 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:22.872553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56e12caf-ec31-4c1f-8057-c8932c04dd05 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:22.872997 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56e12caf-ec31-4c1f-8057-c8932c04dd05 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:22.873406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56e12caf-ec31-4c1f-8057-c8932c04dd05 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:22.902713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-56e12caf-ec31-4c1f-8057-c8932c04dd05 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054228 Sep 05 17:10:22.903314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 452/921] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:22 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:23.027509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3b536d2c-bddc-43a5-b84d-51a9c17ef906 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:23.029817 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3b536d2c-bddc-43a5-b84d-51a9c17ef906 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:23.036422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b536d2c-bddc-43a5-b84d-51a9c17ef906 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:23.036901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b536d2c-bddc-43a5-b84d-51a9c17ef906 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:23.037330 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b536d2c-bddc-43a5-b84d-51a9c17ef906 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:23.038046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b536d2c-bddc-43a5-b84d-51a9c17ef906 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:23.038493 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b536d2c-bddc-43a5-b84d-51a9c17ef906 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:23.038910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b536d2c-bddc-43a5-b84d-51a9c17ef906 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:23.069696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3b536d2c-bddc-43a5-b84d-51a9c17ef906 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048868 Sep 05 17:10:23.070254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 470/922] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:23 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:23.622565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ca2968ac-06b0-4b8c-838d-6f03d583377e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:23.623194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ca2968ac-06b0-4b8c-838d-6f03d583377e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:23.630163 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca2968ac-06b0-4b8c-838d-6f03d583377e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:23.630580 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca2968ac-06b0-4b8c-838d-6f03d583377e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:23.631008 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca2968ac-06b0-4b8c-838d-6f03d583377e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:23.631696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca2968ac-06b0-4b8c-838d-6f03d583377e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:23.632168 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca2968ac-06b0-4b8c-838d-6f03d583377e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:23.632603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca2968ac-06b0-4b8c-838d-6f03d583377e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:23.701350 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ca2968ac-06b0-4b8c-838d-6f03d583377e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:23.709525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ca2968ac-06b0-4b8c-838d-6f03d583377e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093832 Sep 05 17:10:23.710085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 453/923] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:23 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:23.919374 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1645693a-59f4-46ed-bbb7-cc6767b9567b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:23.921500 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1645693a-59f4-46ed-bbb7-cc6767b9567b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:23.929201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1645693a-59f4-46ed-bbb7-cc6767b9567b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:23.929661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1645693a-59f4-46ed-bbb7-cc6767b9567b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:23.930220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1645693a-59f4-46ed-bbb7-cc6767b9567b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:23.930952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1645693a-59f4-46ed-bbb7-cc6767b9567b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:23.931409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1645693a-59f4-46ed-bbb7-cc6767b9567b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:23.931832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1645693a-59f4-46ed-bbb7-cc6767b9567b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:23.969594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1645693a-59f4-46ed-bbb7-cc6767b9567b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057004 Sep 05 17:10:23.970140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 471/924] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:23 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:24.083709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-61d6d79d-2799-4a0d-b630-bbb89f0b246b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:24.086124 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-61d6d79d-2799-4a0d-b630-bbb89f0b246b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:24.093364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-61d6d79d-2799-4a0d-b630-bbb89f0b246b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:24.093889 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-61d6d79d-2799-4a0d-b630-bbb89f0b246b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:24.094357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-61d6d79d-2799-4a0d-b630-bbb89f0b246b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:24.095108 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-61d6d79d-2799-4a0d-b630-bbb89f0b246b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:24.095643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-61d6d79d-2799-4a0d-b630-bbb89f0b246b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:24.096084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-61d6d79d-2799-4a0d-b630-bbb89f0b246b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:24.129729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-61d6d79d-2799-4a0d-b630-bbb89f0b246b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050557 Sep 05 17:10:24.130289 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 454/925] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:24 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:24.736619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e6fb2b86-efb2-49f5-8dad-7ada57d32f3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:24.737477 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e6fb2b86-efb2-49f5-8dad-7ada57d32f3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:24.747693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e6fb2b86-efb2-49f5-8dad-7ada57d32f3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:24.748552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e6fb2b86-efb2-49f5-8dad-7ada57d32f3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:24.749266 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e6fb2b86-efb2-49f5-8dad-7ada57d32f3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:24.750398 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e6fb2b86-efb2-49f5-8dad-7ada57d32f3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:24.751150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e6fb2b86-efb2-49f5-8dad-7ada57d32f3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:24.751851 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e6fb2b86-efb2-49f5-8dad-7ada57d32f3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:24.818078 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e6fb2b86-efb2-49f5-8dad-7ada57d32f3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:24.826262 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e6fb2b86-efb2-49f5-8dad-7ada57d32f3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.096450 Sep 05 17:10:24.826833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 472/926] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:24 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:24.990315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a0b0b744-b302-4ca9-8d12-bb56efae92ee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:24.993582 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a0b0b744-b302-4ca9-8d12-bb56efae92ee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:25.005830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0b0b744-b302-4ca9-8d12-bb56efae92ee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:25.006824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0b0b744-b302-4ca9-8d12-bb56efae92ee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:25.006824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0b0b744-b302-4ca9-8d12-bb56efae92ee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:25.009045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0b0b744-b302-4ca9-8d12-bb56efae92ee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:25.009045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0b0b744-b302-4ca9-8d12-bb56efae92ee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:25.009448 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0b0b744-b302-4ca9-8d12-bb56efae92ee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:25.040177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a0b0b744-b302-4ca9-8d12-bb56efae92ee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056849 Sep 05 17:10:25.040761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 455/927] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:24 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:25.147132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-77bd75a6-5468-4bb4-8d82-1cba182627e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:25.150604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-77bd75a6-5468-4bb4-8d82-1cba182627e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:25.158262 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77bd75a6-5468-4bb4-8d82-1cba182627e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:25.158738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77bd75a6-5468-4bb4-8d82-1cba182627e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:25.159161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77bd75a6-5468-4bb4-8d82-1cba182627e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:25.159839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77bd75a6-5468-4bb4-8d82-1cba182627e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:25.160344 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77bd75a6-5468-4bb4-8d82-1cba182627e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:25.160735 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77bd75a6-5468-4bb4-8d82-1cba182627e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:25.190706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-77bd75a6-5468-4bb4-8d82-1cba182627e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050340 Sep 05 17:10:25.191248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 473/928] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:25 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:25.853687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a4a5a6c9-2d3f-4987-a1c0-90119dd0dd52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:25.854674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a4a5a6c9-2d3f-4987-a1c0-90119dd0dd52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:25.865369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4a5a6c9-2d3f-4987-a1c0-90119dd0dd52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:25.866162 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4a5a6c9-2d3f-4987-a1c0-90119dd0dd52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:25.866870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4a5a6c9-2d3f-4987-a1c0-90119dd0dd52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:25.867997 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4a5a6c9-2d3f-4987-a1c0-90119dd0dd52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:25.868790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4a5a6c9-2d3f-4987-a1c0-90119dd0dd52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:25.869487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4a5a6c9-2d3f-4987-a1c0-90119dd0dd52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:25.935968 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a4a5a6c9-2d3f-4987-a1c0-90119dd0dd52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:25.944448 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a4a5a6c9-2d3f-4987-a1c0-90119dd0dd52 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.097740 Sep 05 17:10:25.945011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 456/929] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:25 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:26.053854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-48f9b24b-da0e-4077-b377-3ffa721fe710 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:26.056064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-48f9b24b-da0e-4077-b377-3ffa721fe710 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:26.062527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48f9b24b-da0e-4077-b377-3ffa721fe710 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:26.063008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48f9b24b-da0e-4077-b377-3ffa721fe710 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:26.063504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48f9b24b-da0e-4077-b377-3ffa721fe710 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:26.064179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48f9b24b-da0e-4077-b377-3ffa721fe710 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:26.064741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48f9b24b-da0e-4077-b377-3ffa721fe710 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:26.065157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48f9b24b-da0e-4077-b377-3ffa721fe710 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:26.094783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-48f9b24b-da0e-4077-b377-3ffa721fe710 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044929 Sep 05 17:10:26.095261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 474/930] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:26 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:26.205715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5307274c-5bf2-44fd-a8d5-18006f3c7a05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:26.208512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5307274c-5bf2-44fd-a8d5-18006f3c7a05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:26.217728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5307274c-5bf2-44fd-a8d5-18006f3c7a05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:26.218396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5307274c-5bf2-44fd-a8d5-18006f3c7a05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:26.219002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5307274c-5bf2-44fd-a8d5-18006f3c7a05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:26.219921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5307274c-5bf2-44fd-a8d5-18006f3c7a05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:26.220570 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5307274c-5bf2-44fd-a8d5-18006f3c7a05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:26.221145 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5307274c-5bf2-44fd-a8d5-18006f3c7a05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:26.254282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5307274c-5bf2-44fd-a8d5-18006f3c7a05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054332 Sep 05 17:10:26.254868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 457/931] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:26 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:26.971460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-17795b3c-3592-494b-9d7b-dcdc7a7e69a2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:26.972528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-17795b3c-3592-494b-9d7b-dcdc7a7e69a2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:26.983281 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17795b3c-3592-494b-9d7b-dcdc7a7e69a2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:26.983757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17795b3c-3592-494b-9d7b-dcdc7a7e69a2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:26.984179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17795b3c-3592-494b-9d7b-dcdc7a7e69a2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:26.984891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17795b3c-3592-494b-9d7b-dcdc7a7e69a2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:26.985334 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17795b3c-3592-494b-9d7b-dcdc7a7e69a2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:26.985747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17795b3c-3592-494b-9d7b-dcdc7a7e69a2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:27.049337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-17795b3c-3592-494b-9d7b-dcdc7a7e69a2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:27.062689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-17795b3c-3592-494b-9d7b-dcdc7a7e69a2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.097611 Sep 05 17:10:27.063611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 475/932] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:26 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:27.108387 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ac02150f-39f4-46c5-aa0e-1fbe53ae841e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:27.110826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ac02150f-39f4-46c5-aa0e-1fbe53ae841e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:27.119321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac02150f-39f4-46c5-aa0e-1fbe53ae841e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:27.119922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac02150f-39f4-46c5-aa0e-1fbe53ae841e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:27.120389 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac02150f-39f4-46c5-aa0e-1fbe53ae841e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:27.121395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac02150f-39f4-46c5-aa0e-1fbe53ae841e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:27.122041 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac02150f-39f4-46c5-aa0e-1fbe53ae841e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:27.122606 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac02150f-39f4-46c5-aa0e-1fbe53ae841e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:27.154135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ac02150f-39f4-46c5-aa0e-1fbe53ae841e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050375 Sep 05 17:10:27.154717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 458/933] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:27 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:27.273888 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-03e1ff99-604a-4a5f-9f76-3f70f9a8790b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:27.277227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-03e1ff99-604a-4a5f-9f76-3f70f9a8790b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:27.284053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03e1ff99-604a-4a5f-9f76-3f70f9a8790b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:27.284561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03e1ff99-604a-4a5f-9f76-3f70f9a8790b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:27.284985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03e1ff99-604a-4a5f-9f76-3f70f9a8790b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:27.285664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03e1ff99-604a-4a5f-9f76-3f70f9a8790b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:27.286108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03e1ff99-604a-4a5f-9f76-3f70f9a8790b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:27.286516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03e1ff99-604a-4a5f-9f76-3f70f9a8790b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:27.316631 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-03e1ff99-604a-4a5f-9f76-3f70f9a8790b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049730 Sep 05 17:10:27.317177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 476/934] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:27 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:28.094163 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cf9c2fa8-bad3-4490-8dd6-bfcef4a8e245 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:28.094915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cf9c2fa8-bad3-4490-8dd6-bfcef4a8e245 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:28.103704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf9c2fa8-bad3-4490-8dd6-bfcef4a8e245 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:28.104499 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf9c2fa8-bad3-4490-8dd6-bfcef4a8e245 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:28.105048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf9c2fa8-bad3-4490-8dd6-bfcef4a8e245 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:28.105972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf9c2fa8-bad3-4490-8dd6-bfcef4a8e245 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:28.106543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf9c2fa8-bad3-4490-8dd6-bfcef4a8e245 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:28.107071 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf9c2fa8-bad3-4490-8dd6-bfcef4a8e245 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:28.166465 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1df8bf6a-9246-42b4-bca2-7365aabb3d2f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:28.168703 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1df8bf6a-9246-42b4-bca2-7365aabb3d2f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:28.171384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cf9c2fa8-bad3-4490-8dd6-bfcef4a8e245 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:28.175300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1df8bf6a-9246-42b4-bca2-7365aabb3d2f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:28.175876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1df8bf6a-9246-42b4-bca2-7365aabb3d2f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:28.176441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1df8bf6a-9246-42b4-bca2-7365aabb3d2f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:28.177146 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1df8bf6a-9246-42b4-bca2-7365aabb3d2f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:28.177580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1df8bf6a-9246-42b4-bca2-7365aabb3d2f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:28.178006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1df8bf6a-9246-42b4-bca2-7365aabb3d2f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:28.179518 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cf9c2fa8-bad3-4490-8dd6-bfcef4a8e245 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091437 Sep 05 17:10:28.180324 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 459/935] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:28 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:28.208690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1df8bf6a-9246-42b4-bca2-7365aabb3d2f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046196 Sep 05 17:10:28.209248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 477/936] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:28 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:28.333794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-728230fa-0e17-4504-8d8f-ddc12bb422a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:28.337227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-728230fa-0e17-4504-8d8f-ddc12bb422a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:28.345375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-728230fa-0e17-4504-8d8f-ddc12bb422a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:28.345786 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-728230fa-0e17-4504-8d8f-ddc12bb422a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:28.346218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-728230fa-0e17-4504-8d8f-ddc12bb422a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:28.346900 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-728230fa-0e17-4504-8d8f-ddc12bb422a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:28.347346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-728230fa-0e17-4504-8d8f-ddc12bb422a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:28.347769 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-728230fa-0e17-4504-8d8f-ddc12bb422a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:28.380869 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-728230fa-0e17-4504-8d8f-ddc12bb422a4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053857 Sep 05 17:10:28.381487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 460/937] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:28 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:29.206567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e972e853-26a0-40d2-8102-3e8231cc9d3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:29.207503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e972e853-26a0-40d2-8102-3e8231cc9d3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:29.211213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=94 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:10:29.220527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e972e853-26a0-40d2-8102-3e8231cc9d3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:29.221315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e972e853-26a0-40d2-8102-3e8231cc9d3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:29.222026 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e972e853-26a0-40d2-8102-3e8231cc9d3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:29.223148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e972e853-26a0-40d2-8102-3e8231cc9d3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:29.223886 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e972e853-26a0-40d2-8102-3e8231cc9d3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:29.224613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e972e853-26a0-40d2-8102-3e8231cc9d3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:29.226054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3ed8b775-8d4e-46f1-91bc-928f754fa0d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:29.229778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3ed8b775-8d4e-46f1-91bc-928f754fa0d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:29.237424 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ed8b775-8d4e-46f1-91bc-928f754fa0d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:29.237907 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ed8b775-8d4e-46f1-91bc-928f754fa0d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:29.238329 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ed8b775-8d4e-46f1-91bc-928f754fa0d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:29.239024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ed8b775-8d4e-46f1-91bc-928f754fa0d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:29.239472 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ed8b775-8d4e-46f1-91bc-928f754fa0d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:29.239890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ed8b775-8d4e-46f1-91bc-928f754fa0d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:29.269669 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3ed8b775-8d4e-46f1-91bc-928f754fa0d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050851 Sep 05 17:10:29.270215 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 461/938] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:29 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:29.288866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e972e853-26a0-40d2-8102-3e8231cc9d3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:29.297116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e972e853-26a0-40d2-8102-3e8231cc9d3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.097416 Sep 05 17:10:29.297686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 478/939] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:29 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:29.393903 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-72ea4ba2-3135-4c0a-b6a0-2f1f7b006726 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:29.396077 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-72ea4ba2-3135-4c0a-b6a0-2f1f7b006726 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:29.402495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72ea4ba2-3135-4c0a-b6a0-2f1f7b006726 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:29.402973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72ea4ba2-3135-4c0a-b6a0-2f1f7b006726 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:29.403446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72ea4ba2-3135-4c0a-b6a0-2f1f7b006726 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:29.404371 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72ea4ba2-3135-4c0a-b6a0-2f1f7b006726 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:29.404820 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72ea4ba2-3135-4c0a-b6a0-2f1f7b006726 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:29.405233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72ea4ba2-3135-4c0a-b6a0-2f1f7b006726 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:29.446095 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-72ea4ba2-3135-4c0a-b6a0-2f1f7b006726 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055986 Sep 05 17:10:29.446925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 462/940] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:29 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 17:10:30.286929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9d1c60f2-5c18-4b2f-a630-7facc3b1ca34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:30.290438 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9d1c60f2-5c18-4b2f-a630-7facc3b1ca34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:30.301469 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d1c60f2-5c18-4b2f-a630-7facc3b1ca34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:30.302273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d1c60f2-5c18-4b2f-a630-7facc3b1ca34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:30.302989 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d1c60f2-5c18-4b2f-a630-7facc3b1ca34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:30.304140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d1c60f2-5c18-4b2f-a630-7facc3b1ca34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:30.304939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d1c60f2-5c18-4b2f-a630-7facc3b1ca34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:30.305642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d1c60f2-5c18-4b2f-a630-7facc3b1ca34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:30.318999 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fb03bc8d-626f-40a8-9cf7-2ac44a4cbf34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:30.319581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fb03bc8d-626f-40a8-9cf7-2ac44a4cbf34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:30.326067 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb03bc8d-626f-40a8-9cf7-2ac44a4cbf34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:30.326558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb03bc8d-626f-40a8-9cf7-2ac44a4cbf34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:30.326993 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb03bc8d-626f-40a8-9cf7-2ac44a4cbf34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:30.327685 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb03bc8d-626f-40a8-9cf7-2ac44a4cbf34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:30.328140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb03bc8d-626f-40a8-9cf7-2ac44a4cbf34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:30.328603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb03bc8d-626f-40a8-9cf7-2ac44a4cbf34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:30.337576 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9d1c60f2-5c18-4b2f-a630-7facc3b1ca34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057468 Sep 05 17:10:30.338482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 479/941] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:30 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:30.394750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fb03bc8d-626f-40a8-9cf7-2ac44a4cbf34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:30.402827 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fb03bc8d-626f-40a8-9cf7-2ac44a4cbf34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087749 Sep 05 17:10:30.403498 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 463/942] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:30 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:30.461863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c2d2830e-38b8-46c3-8816-7b9bc22df689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:30.464078 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c2d2830e-38b8-46c3-8816-7b9bc22df689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:30.470373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d2830e-38b8-46c3-8816-7b9bc22df689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:30.470854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d2830e-38b8-46c3-8816-7b9bc22df689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:30.471285 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d2830e-38b8-46c3-8816-7b9bc22df689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:30.471977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d2830e-38b8-46c3-8816-7b9bc22df689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:30.472457 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d2830e-38b8-46c3-8816-7b9bc22df689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:30.472900 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d2830e-38b8-46c3-8816-7b9bc22df689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:30.507788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c2d2830e-38b8-46c3-8816-7b9bc22df689 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049673 Sep 05 17:10:30.508560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 480/943] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:30 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:31.354860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1d8ad9e3-f39f-40d2-8751-15abad54327a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:31.358733 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1d8ad9e3-f39f-40d2-8751-15abad54327a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:31.369533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1d8ad9e3-f39f-40d2-8751-15abad54327a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:31.370320 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1d8ad9e3-f39f-40d2-8751-15abad54327a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:31.370994 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1d8ad9e3-f39f-40d2-8751-15abad54327a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:31.372129 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1d8ad9e3-f39f-40d2-8751-15abad54327a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:31.372993 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1d8ad9e3-f39f-40d2-8751-15abad54327a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:31.373436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1d8ad9e3-f39f-40d2-8751-15abad54327a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:31.404452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1d8ad9e3-f39f-40d2-8751-15abad54327a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056444 Sep 05 17:10:31.405002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 464/944] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:31 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:31.425762 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-20d3f797-6701-4283-b62e-cff344a1ca31 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:31.426681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-20d3f797-6701-4283-b62e-cff344a1ca31 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:31.433188 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20d3f797-6701-4283-b62e-cff344a1ca31 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:31.433659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20d3f797-6701-4283-b62e-cff344a1ca31 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:31.434081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20d3f797-6701-4283-b62e-cff344a1ca31 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:31.434757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20d3f797-6701-4283-b62e-cff344a1ca31 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:31.435334 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20d3f797-6701-4283-b62e-cff344a1ca31 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:31.435973 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20d3f797-6701-4283-b62e-cff344a1ca31 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:31.499074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-20d3f797-6701-4283-b62e-cff344a1ca31 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:31.501300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:10:31.508343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-20d3f797-6701-4283-b62e-cff344a1ca31 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086467 Sep 05 17:10:31.508908 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 481/945] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:31 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:31.523152 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7933002f-35c3-4dae-8947-ff97243d9a9b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:31.533005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7933002f-35c3-4dae-8947-ff97243d9a9b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:31.539199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7933002f-35c3-4dae-8947-ff97243d9a9b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:31.539670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7933002f-35c3-4dae-8947-ff97243d9a9b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:31.540219 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7933002f-35c3-4dae-8947-ff97243d9a9b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:31.540995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7933002f-35c3-4dae-8947-ff97243d9a9b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:31.541529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7933002f-35c3-4dae-8947-ff97243d9a9b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:31.541948 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7933002f-35c3-4dae-8947-ff97243d9a9b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:31.572743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7933002f-35c3-4dae-8947-ff97243d9a9b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053603 Sep 05 17:10:31.573314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 465/946] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:31 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:32.418394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b6fef596-47e6-42a0-be4b-b48d3ed0a292 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:32.420891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b6fef596-47e6-42a0-be4b-b48d3ed0a292 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:32.429505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6fef596-47e6-42a0-be4b-b48d3ed0a292 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:32.430172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6fef596-47e6-42a0-be4b-b48d3ed0a292 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:32.430413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6fef596-47e6-42a0-be4b-b48d3ed0a292 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:32.431145 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6fef596-47e6-42a0-be4b-b48d3ed0a292 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:32.431613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6fef596-47e6-42a0-be4b-b48d3ed0a292 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:32.432030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6fef596-47e6-42a0-be4b-b48d3ed0a292 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:32.466833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b6fef596-47e6-42a0-be4b-b48d3ed0a292 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052273 Sep 05 17:10:32.467410 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 482/947] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:32 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:32.532484 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ddb5b434-80d5-4f50-b22c-92024dab9c18 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:32.533064 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ddb5b434-80d5-4f50-b22c-92024dab9c18 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:32.541125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ddb5b434-80d5-4f50-b22c-92024dab9c18 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:32.541680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ddb5b434-80d5-4f50-b22c-92024dab9c18 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:32.542169 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ddb5b434-80d5-4f50-b22c-92024dab9c18 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:32.542995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ddb5b434-80d5-4f50-b22c-92024dab9c18 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:32.543522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ddb5b434-80d5-4f50-b22c-92024dab9c18 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:32.544011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ddb5b434-80d5-4f50-b22c-92024dab9c18 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:32.588927 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f00dd1ad-888f-4023-ab5a-52c183fe60be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:32.591013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f00dd1ad-888f-4023-ab5a-52c183fe60be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:32.602912 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f00dd1ad-888f-4023-ab5a-52c183fe60be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:32.603407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f00dd1ad-888f-4023-ab5a-52c183fe60be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:32.603834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f00dd1ad-888f-4023-ab5a-52c183fe60be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:32.604883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f00dd1ad-888f-4023-ab5a-52c183fe60be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:32.605332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f00dd1ad-888f-4023-ab5a-52c183fe60be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:32.605738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f00dd1ad-888f-4023-ab5a-52c183fe60be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:32.622752 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ddb5b434-80d5-4f50-b22c-92024dab9c18 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:32.630597 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ddb5b434-80d5-4f50-b22c-92024dab9c18 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.103064 Sep 05 17:10:32.631171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 466/948] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:32 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:32.641362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f00dd1ad-888f-4023-ab5a-52c183fe60be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056533 Sep 05 17:10:32.641933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 483/949] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:32 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:33.480101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b6dedb51-ae7b-4417-8794-f3c82b0b7dc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:33.482328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b6dedb51-ae7b-4417-8794-f3c82b0b7dc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:33.484286 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=65 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:10:33.489531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b6dedb51-ae7b-4417-8794-f3c82b0b7dc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:33.490015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b6dedb51-ae7b-4417-8794-f3c82b0b7dc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:33.490441 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b6dedb51-ae7b-4417-8794-f3c82b0b7dc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:33.491129 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b6dedb51-ae7b-4417-8794-f3c82b0b7dc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:33.491579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b6dedb51-ae7b-4417-8794-f3c82b0b7dc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:33.492018 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b6dedb51-ae7b-4417-8794-f3c82b0b7dc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:33.496094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:10:33.522590 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b6dedb51-ae7b-4417-8794-f3c82b0b7dc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046690 Sep 05 17:10:33.523158 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 467/950] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:33 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:33.657521 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9fad0e35-1359-4e14-a834-90df91c284f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:33.658444 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6a7f8a21-b1b6-4157-8613-8f30c6bcdea8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:33.659086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9fad0e35-1359-4e14-a834-90df91c284f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:33.661608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6a7f8a21-b1b6-4157-8613-8f30c6bcdea8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:33.669195 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fad0e35-1359-4e14-a834-90df91c284f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:33.669907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fad0e35-1359-4e14-a834-90df91c284f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:33.670501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fad0e35-1359-4e14-a834-90df91c284f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:33.671207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fad0e35-1359-4e14-a834-90df91c284f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:33.671352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a7f8a21-b1b6-4157-8613-8f30c6bcdea8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:33.671659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fad0e35-1359-4e14-a834-90df91c284f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:33.671872 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a7f8a21-b1b6-4157-8613-8f30c6bcdea8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:33.672043 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fad0e35-1359-4e14-a834-90df91c284f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:33.672248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a7f8a21-b1b6-4157-8613-8f30c6bcdea8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:33.672945 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a7f8a21-b1b6-4157-8613-8f30c6bcdea8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:33.673388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a7f8a21-b1b6-4157-8613-8f30c6bcdea8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:33.673796 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a7f8a21-b1b6-4157-8613-8f30c6bcdea8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:33.703719 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6a7f8a21-b1b6-4157-8613-8f30c6bcdea8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052570 Sep 05 17:10:33.704328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 468/951] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:33 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:33.735509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9fad0e35-1359-4e14-a834-90df91c284f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:33.747889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9fad0e35-1359-4e14-a834-90df91c284f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.096769 Sep 05 17:10:33.748633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 484/952] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:33 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:34.539916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d27a5fd3-ec4c-4287-b32e-de96c33af695 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:34.543330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d27a5fd3-ec4c-4287-b32e-de96c33af695 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:34.550435 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d27a5fd3-ec4c-4287-b32e-de96c33af695 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:34.550928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d27a5fd3-ec4c-4287-b32e-de96c33af695 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:34.551349 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d27a5fd3-ec4c-4287-b32e-de96c33af695 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:34.552061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d27a5fd3-ec4c-4287-b32e-de96c33af695 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:34.552541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d27a5fd3-ec4c-4287-b32e-de96c33af695 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:34.552955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d27a5fd3-ec4c-4287-b32e-de96c33af695 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:34.582640 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d27a5fd3-ec4c-4287-b32e-de96c33af695 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049520 Sep 05 17:10:34.583181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 469/953] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:34 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:34.720233 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-12a4828e-f41a-41e3-8e13-ed3e33197349 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:34.723617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-12a4828e-f41a-41e3-8e13-ed3e33197349 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:34.733970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12a4828e-f41a-41e3-8e13-ed3e33197349 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:34.734447 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12a4828e-f41a-41e3-8e13-ed3e33197349 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:34.734872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12a4828e-f41a-41e3-8e13-ed3e33197349 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:34.735560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12a4828e-f41a-41e3-8e13-ed3e33197349 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:34.736005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12a4828e-f41a-41e3-8e13-ed3e33197349 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:34.736448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12a4828e-f41a-41e3-8e13-ed3e33197349 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:34.765799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-12a4828e-f41a-41e3-8e13-ed3e33197349 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052524 Sep 05 17:10:34.766342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 485/954] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:34 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:34.771091 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-68fed2fa-7110-46c0-85a0-0a1baeff845d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:34.771725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-68fed2fa-7110-46c0-85a0-0a1baeff845d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:34.778315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68fed2fa-7110-46c0-85a0-0a1baeff845d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:34.779012 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68fed2fa-7110-46c0-85a0-0a1baeff845d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:34.779900 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68fed2fa-7110-46c0-85a0-0a1baeff845d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:34.780619 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68fed2fa-7110-46c0-85a0-0a1baeff845d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:34.781071 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68fed2fa-7110-46c0-85a0-0a1baeff845d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:34.781492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68fed2fa-7110-46c0-85a0-0a1baeff845d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:34.855197 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-68fed2fa-7110-46c0-85a0-0a1baeff845d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:34.863524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-68fed2fa-7110-46c0-85a0-0a1baeff845d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.096599 Sep 05 17:10:34.864091 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 470/955] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:34 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:35.599908 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-03651fcb-655f-4935-a854-50a565c15c5d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:35.603804 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-03651fcb-655f-4935-a854-50a565c15c5d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:35.613972 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03651fcb-655f-4935-a854-50a565c15c5d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:35.614756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03651fcb-655f-4935-a854-50a565c15c5d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:35.615468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03651fcb-655f-4935-a854-50a565c15c5d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:35.616651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03651fcb-655f-4935-a854-50a565c15c5d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:35.617367 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03651fcb-655f-4935-a854-50a565c15c5d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:35.618053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03651fcb-655f-4935-a854-50a565c15c5d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:35.650096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-03651fcb-655f-4935-a854-50a565c15c5d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056833 Sep 05 17:10:35.650570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 486/956] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:35 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:35.781785 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f58708ba-8fff-47e9-a785-fc5498edd5d9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:35.784492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f58708ba-8fff-47e9-a785-fc5498edd5d9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:35.792672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f58708ba-8fff-47e9-a785-fc5498edd5d9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:35.793346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f58708ba-8fff-47e9-a785-fc5498edd5d9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:35.793857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f58708ba-8fff-47e9-a785-fc5498edd5d9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:35.794816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f58708ba-8fff-47e9-a785-fc5498edd5d9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:35.795347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f58708ba-8fff-47e9-a785-fc5498edd5d9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:35.795839 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f58708ba-8fff-47e9-a785-fc5498edd5d9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:35.828269 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f58708ba-8fff-47e9-a785-fc5498edd5d9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052298 Sep 05 17:10:35.828810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 471/957] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:35 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:35.886857 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e7ad601e-2821-44da-969f-42f685f56404 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:35.887474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e7ad601e-2821-44da-969f-42f685f56404 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:35.894332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7ad601e-2821-44da-969f-42f685f56404 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:35.894812 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7ad601e-2821-44da-969f-42f685f56404 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:35.895238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7ad601e-2821-44da-969f-42f685f56404 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:35.895920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7ad601e-2821-44da-969f-42f685f56404 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:35.896401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7ad601e-2821-44da-969f-42f685f56404 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:35.896819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7ad601e-2821-44da-969f-42f685f56404 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:35.963691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e7ad601e-2821-44da-969f-42f685f56404 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:35.975928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e7ad601e-2821-44da-969f-42f685f56404 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092429 Sep 05 17:10:35.976789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 487/958] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:35 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:36.665712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c206e632-b007-4d42-bea2-294289546e5a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:36.668717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c206e632-b007-4d42-bea2-294289546e5a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:36.675379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c206e632-b007-4d42-bea2-294289546e5a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:36.675864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c206e632-b007-4d42-bea2-294289546e5a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:36.676322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c206e632-b007-4d42-bea2-294289546e5a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:36.677010 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c206e632-b007-4d42-bea2-294289546e5a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:36.677461 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c206e632-b007-4d42-bea2-294289546e5a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:36.677885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c206e632-b007-4d42-bea2-294289546e5a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:36.707491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c206e632-b007-4d42-bea2-294289546e5a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047765 Sep 05 17:10:36.708041 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 472/959] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:36 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:36.846155 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c375a782-5ff5-4938-998b-86937b06f356 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:36.849712 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c375a782-5ff5-4938-998b-86937b06f356 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:36.859577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c375a782-5ff5-4938-998b-86937b06f356 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:36.860056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c375a782-5ff5-4938-998b-86937b06f356 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:36.860576 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c375a782-5ff5-4938-998b-86937b06f356 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:36.861269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c375a782-5ff5-4938-998b-86937b06f356 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:36.861715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c375a782-5ff5-4938-998b-86937b06f356 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:36.862136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c375a782-5ff5-4938-998b-86937b06f356 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:36.892814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c375a782-5ff5-4938-998b-86937b06f356 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054272 Sep 05 17:10:36.893437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 488/960] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:36 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:37.001160 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-900dd948-bcdb-483e-b032-62f48c26cbf0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:37.001724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-900dd948-bcdb-483e-b032-62f48c26cbf0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:37.008792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-900dd948-bcdb-483e-b032-62f48c26cbf0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:37.009368 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-900dd948-bcdb-483e-b032-62f48c26cbf0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:37.009768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-900dd948-bcdb-483e-b032-62f48c26cbf0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:37.010464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-900dd948-bcdb-483e-b032-62f48c26cbf0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:37.010960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-900dd948-bcdb-483e-b032-62f48c26cbf0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:37.011377 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-900dd948-bcdb-483e-b032-62f48c26cbf0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:37.073174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-900dd948-bcdb-483e-b032-62f48c26cbf0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:37.081160 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-900dd948-bcdb-483e-b032-62f48c26cbf0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.084628 Sep 05 17:10:37.081702 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 473/961] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:36 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:37.724961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ec36117f-f095-4044-bcd0-54ec5952ff10 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:37.728724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ec36117f-f095-4044-bcd0-54ec5952ff10 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:37.736708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec36117f-f095-4044-bcd0-54ec5952ff10 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:37.737439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec36117f-f095-4044-bcd0-54ec5952ff10 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:37.737899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec36117f-f095-4044-bcd0-54ec5952ff10 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:37.738578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec36117f-f095-4044-bcd0-54ec5952ff10 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:37.739025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec36117f-f095-4044-bcd0-54ec5952ff10 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:37.739445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec36117f-f095-4044-bcd0-54ec5952ff10 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:37.770188 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ec36117f-f095-4044-bcd0-54ec5952ff10 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052166 Sep 05 17:10:37.770740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 489/962] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:37 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:37.909249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-25c27569-ec91-4aeb-98cb-ed7761fcf5e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:37.912042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-25c27569-ec91-4aeb-98cb-ed7761fcf5e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:37.919400 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25c27569-ec91-4aeb-98cb-ed7761fcf5e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:37.919966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25c27569-ec91-4aeb-98cb-ed7761fcf5e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:37.921109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25c27569-ec91-4aeb-98cb-ed7761fcf5e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:37.921920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25c27569-ec91-4aeb-98cb-ed7761fcf5e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:37.922451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25c27569-ec91-4aeb-98cb-ed7761fcf5e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:37.922951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25c27569-ec91-4aeb-98cb-ed7761fcf5e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:37.956626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-25c27569-ec91-4aeb-98cb-ed7761fcf5e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053339 Sep 05 17:10:37.957214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 474/963] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:37 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:38.107679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ea811123-ff73-4eb1-a641-c88320c0eeb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:38.109058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ea811123-ff73-4eb1-a641-c88320c0eeb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:38.116289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea811123-ff73-4eb1-a641-c88320c0eeb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:38.116822 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea811123-ff73-4eb1-a641-c88320c0eeb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:38.117329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea811123-ff73-4eb1-a641-c88320c0eeb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:38.118084 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea811123-ff73-4eb1-a641-c88320c0eeb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:38.118579 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea811123-ff73-4eb1-a641-c88320c0eeb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:38.119040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea811123-ff73-4eb1-a641-c88320c0eeb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:38.182296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ea811123-ff73-4eb1-a641-c88320c0eeb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:38.190099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ea811123-ff73-4eb1-a641-c88320c0eeb8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.088947 Sep 05 17:10:38.190659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 490/964] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:38 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:38.787744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6ad2acfb-b852-4466-b06e-eaee7b9fe893 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:38.791236 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6ad2acfb-b852-4466-b06e-eaee7b9fe893 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:38.802920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ad2acfb-b852-4466-b06e-eaee7b9fe893 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:38.803711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ad2acfb-b852-4466-b06e-eaee7b9fe893 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:38.804477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ad2acfb-b852-4466-b06e-eaee7b9fe893 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:38.805608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ad2acfb-b852-4466-b06e-eaee7b9fe893 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:38.806357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ad2acfb-b852-4466-b06e-eaee7b9fe893 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:38.807053 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ad2acfb-b852-4466-b06e-eaee7b9fe893 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:38.839063 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6ad2acfb-b852-4466-b06e-eaee7b9fe893 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059073 Sep 05 17:10:38.839613 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 475/965] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:38 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:38.973207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fc089975-a533-43f2-b8cd-3a9dcce8439d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:38.975653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fc089975-a533-43f2-b8cd-3a9dcce8439d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:38.982459 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc089975-a533-43f2-b8cd-3a9dcce8439d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:38.983190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc089975-a533-43f2-b8cd-3a9dcce8439d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:38.983652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc089975-a533-43f2-b8cd-3a9dcce8439d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:38.984421 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc089975-a533-43f2-b8cd-3a9dcce8439d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:38.984870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc089975-a533-43f2-b8cd-3a9dcce8439d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:38.985289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc089975-a533-43f2-b8cd-3a9dcce8439d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:39.016424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fc089975-a533-43f2-b8cd-3a9dcce8439d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047426 Sep 05 17:10:39.016999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 491/966] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:38 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:39.217230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-290cd085-eb03-4739-a679-65145fe31349 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:39.217829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-290cd085-eb03-4739-a679-65145fe31349 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:39.224174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-290cd085-eb03-4739-a679-65145fe31349 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:39.224593 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-290cd085-eb03-4739-a679-65145fe31349 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:39.225379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-290cd085-eb03-4739-a679-65145fe31349 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:39.226066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-290cd085-eb03-4739-a679-65145fe31349 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:39.226502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-290cd085-eb03-4739-a679-65145fe31349 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:39.226946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-290cd085-eb03-4739-a679-65145fe31349 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:39.291951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-290cd085-eb03-4739-a679-65145fe31349 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:39.300399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-290cd085-eb03-4739-a679-65145fe31349 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087083 Sep 05 17:10:39.300990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 476/967] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:39 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:39.852077 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-be105162-0fce-4f6d-a1d2-64973b80915d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:39.854256 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-be105162-0fce-4f6d-a1d2-64973b80915d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:39.860570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be105162-0fce-4f6d-a1d2-64973b80915d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:39.861036 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be105162-0fce-4f6d-a1d2-64973b80915d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:39.861484 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be105162-0fce-4f6d-a1d2-64973b80915d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:39.862191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be105162-0fce-4f6d-a1d2-64973b80915d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:39.862613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be105162-0fce-4f6d-a1d2-64973b80915d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:39.863044 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be105162-0fce-4f6d-a1d2-64973b80915d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:39.897411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-be105162-0fce-4f6d-a1d2-64973b80915d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049582 Sep 05 17:10:39.897968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 492/968] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:39 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:40.034078 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f99d36d5-48d5-4130-bb55-e6941b520121 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:40.037537 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f99d36d5-48d5-4130-bb55-e6941b520121 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:40.047356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f99d36d5-48d5-4130-bb55-e6941b520121 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:40.047856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f99d36d5-48d5-4130-bb55-e6941b520121 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:40.048410 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f99d36d5-48d5-4130-bb55-e6941b520121 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:40.049097 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f99d36d5-48d5-4130-bb55-e6941b520121 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:40.049542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f99d36d5-48d5-4130-bb55-e6941b520121 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:40.049951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f99d36d5-48d5-4130-bb55-e6941b520121 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:40.079616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f99d36d5-48d5-4130-bb55-e6941b520121 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052626 Sep 05 17:10:40.080200 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 477/969] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:40 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:40.328790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-70df8751-2700-4351-b890-9d8c0bb02d98 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:40.329545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-70df8751-2700-4351-b890-9d8c0bb02d98 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:40.337449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70df8751-2700-4351-b890-9d8c0bb02d98 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:40.338050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70df8751-2700-4351-b890-9d8c0bb02d98 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:40.338570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70df8751-2700-4351-b890-9d8c0bb02d98 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:40.339409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70df8751-2700-4351-b890-9d8c0bb02d98 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:40.339966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70df8751-2700-4351-b890-9d8c0bb02d98 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:40.340543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70df8751-2700-4351-b890-9d8c0bb02d98 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:40.402825 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-70df8751-2700-4351-b890-9d8c0bb02d98 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:40.410734 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-70df8751-2700-4351-b890-9d8c0bb02d98 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.088216 Sep 05 17:10:40.411293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 493/970] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:40 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:40.915178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-585cacde-9d7a-4a82-a9c2-6708274ab7c6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:40.918650 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-585cacde-9d7a-4a82-a9c2-6708274ab7c6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:40.928263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-585cacde-9d7a-4a82-a9c2-6708274ab7c6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:40.928746 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-585cacde-9d7a-4a82-a9c2-6708274ab7c6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:40.929178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-585cacde-9d7a-4a82-a9c2-6708274ab7c6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:40.929857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-585cacde-9d7a-4a82-a9c2-6708274ab7c6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:40.930312 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-585cacde-9d7a-4a82-a9c2-6708274ab7c6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:40.930730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-585cacde-9d7a-4a82-a9c2-6708274ab7c6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:40.964254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-585cacde-9d7a-4a82-a9c2-6708274ab7c6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056095 Sep 05 17:10:40.964862 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 478/971] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:40 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:41.094977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-24820ba9-f869-432a-9416-433859468f98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:41.097829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-24820ba9-f869-432a-9416-433859468f98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:41.105314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24820ba9-f869-432a-9416-433859468f98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:41.105789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24820ba9-f869-432a-9416-433859468f98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:41.106226 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24820ba9-f869-432a-9416-433859468f98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:41.106901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24820ba9-f869-432a-9416-433859468f98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:41.107346 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24820ba9-f869-432a-9416-433859468f98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:41.107759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24820ba9-f869-432a-9416-433859468f98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:41.140139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-24820ba9-f869-432a-9416-433859468f98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050544 Sep 05 17:10:41.140984 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 494/972] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:41 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:41.437267 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0dc93261-352d-42ab-880e-76060fd83550 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:41.438271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0dc93261-352d-42ab-880e-76060fd83550 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:41.449376 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0dc93261-352d-42ab-880e-76060fd83550 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:41.450178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0dc93261-352d-42ab-880e-76060fd83550 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:41.450896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0dc93261-352d-42ab-880e-76060fd83550 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:41.452029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0dc93261-352d-42ab-880e-76060fd83550 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:41.452878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0dc93261-352d-42ab-880e-76060fd83550 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:41.453584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0dc93261-352d-42ab-880e-76060fd83550 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:41.516877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0dc93261-352d-42ab-880e-76060fd83550 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:41.524896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0dc93261-352d-42ab-880e-76060fd83550 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.094139 Sep 05 17:10:41.525469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 479/973] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:41 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:41.982284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f808f873-851f-491d-8f14-dff97bfde388 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:41.985675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f808f873-851f-491d-8f14-dff97bfde388 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:41.996002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f808f873-851f-491d-8f14-dff97bfde388 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:41.996856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f808f873-851f-491d-8f14-dff97bfde388 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:41.997560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f808f873-851f-491d-8f14-dff97bfde388 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:41.998682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f808f873-851f-491d-8f14-dff97bfde388 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:41.999415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f808f873-851f-491d-8f14-dff97bfde388 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:42.000103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f808f873-851f-491d-8f14-dff97bfde388 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:42.030799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f808f873-851f-491d-8f14-dff97bfde388 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055784 Sep 05 17:10:42.031347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 495/974] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:41 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:42.157712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-38cef1c8-be68-45cc-b5fc-19743a828db2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:42.161466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-38cef1c8-be68-45cc-b5fc-19743a828db2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:42.171533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38cef1c8-be68-45cc-b5fc-19743a828db2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:42.172388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38cef1c8-be68-45cc-b5fc-19743a828db2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:42.173106 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38cef1c8-be68-45cc-b5fc-19743a828db2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:42.174240 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38cef1c8-be68-45cc-b5fc-19743a828db2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:42.174989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38cef1c8-be68-45cc-b5fc-19743a828db2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:42.175690 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38cef1c8-be68-45cc-b5fc-19743a828db2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:42.205527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-38cef1c8-be68-45cc-b5fc-19743a828db2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054579 Sep 05 17:10:42.206068 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 480/975] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:42 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:42.550864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bb0f57a9-b46b-4a15-9a80-0f840abb032b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:42.552810 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bb0f57a9-b46b-4a15-9a80-0f840abb032b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:42.563841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb0f57a9-b46b-4a15-9a80-0f840abb032b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:42.564734 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb0f57a9-b46b-4a15-9a80-0f840abb032b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:42.565596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb0f57a9-b46b-4a15-9a80-0f840abb032b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:42.566731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb0f57a9-b46b-4a15-9a80-0f840abb032b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:42.567887 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb0f57a9-b46b-4a15-9a80-0f840abb032b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:42.568664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb0f57a9-b46b-4a15-9a80-0f840abb032b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:42.640404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bb0f57a9-b46b-4a15-9a80-0f840abb032b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:42.649127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bb0f57a9-b46b-4a15-9a80-0f840abb032b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.104950 Sep 05 17:10:42.649695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 496/976] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:42 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:43.048189 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2591b4f2-2800-4861-b4ea-87ceaad16a4a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:43.051982 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2591b4f2-2800-4861-b4ea-87ceaad16a4a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:43.058458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2591b4f2-2800-4861-b4ea-87ceaad16a4a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:43.059025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2591b4f2-2800-4861-b4ea-87ceaad16a4a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:43.059454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2591b4f2-2800-4861-b4ea-87ceaad16a4a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:43.060130 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2591b4f2-2800-4861-b4ea-87ceaad16a4a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:43.060607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2591b4f2-2800-4861-b4ea-87ceaad16a4a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:43.061015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2591b4f2-2800-4861-b4ea-87ceaad16a4a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:43.091685 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2591b4f2-2800-4861-b4ea-87ceaad16a4a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050602 Sep 05 17:10:43.092257 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 481/977] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:43 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:43.222905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1daaf4c8-b947-4f33-9bee-7ce45cf327b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:43.225921 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1daaf4c8-b947-4f33-9bee-7ce45cf327b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:43.232249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1daaf4c8-b947-4f33-9bee-7ce45cf327b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:43.232738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1daaf4c8-b947-4f33-9bee-7ce45cf327b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:43.233179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1daaf4c8-b947-4f33-9bee-7ce45cf327b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:43.233856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1daaf4c8-b947-4f33-9bee-7ce45cf327b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:43.234309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1daaf4c8-b947-4f33-9bee-7ce45cf327b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:43.234733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1daaf4c8-b947-4f33-9bee-7ce45cf327b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:43.264685 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1daaf4c8-b947-4f33-9bee-7ce45cf327b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048609 Sep 05 17:10:43.265239 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 497/978] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:43 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:43.680187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c0f470a1-bed6-47c9-9fb3-e2f1f505596a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:43.680846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c0f470a1-bed6-47c9-9fb3-e2f1f505596a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:43.688294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0f470a1-bed6-47c9-9fb3-e2f1f505596a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:43.688853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0f470a1-bed6-47c9-9fb3-e2f1f505596a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:43.689354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0f470a1-bed6-47c9-9fb3-e2f1f505596a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:43.690148 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0f470a1-bed6-47c9-9fb3-e2f1f505596a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:43.690677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0f470a1-bed6-47c9-9fb3-e2f1f505596a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:43.691165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0f470a1-bed6-47c9-9fb3-e2f1f505596a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:43.758302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c0f470a1-bed6-47c9-9fb3-e2f1f505596a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:43.766522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c0f470a1-bed6-47c9-9fb3-e2f1f505596a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092963 Sep 05 17:10:43.767082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 482/979] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:43 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:44.105665 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d34befa8-1d78-467c-a356-ff0a9eb8423c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:44.107870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d34befa8-1d78-467c-a356-ff0a9eb8423c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:44.114961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d34befa8-1d78-467c-a356-ff0a9eb8423c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:44.115450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d34befa8-1d78-467c-a356-ff0a9eb8423c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:44.115853 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d34befa8-1d78-467c-a356-ff0a9eb8423c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:44.116973 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d34befa8-1d78-467c-a356-ff0a9eb8423c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:44.117432 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d34befa8-1d78-467c-a356-ff0a9eb8423c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:44.117852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d34befa8-1d78-467c-a356-ff0a9eb8423c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:44.134648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:10:44.152392 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d34befa8-1d78-467c-a356-ff0a9eb8423c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050759 Sep 05 17:10:44.153169 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 498/980] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:44 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:44.279433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2dcc9d0b-0734-4a91-8c84-2a78523b636b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:44.281683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2dcc9d0b-0734-4a91-8c84-2a78523b636b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:44.288633 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2dcc9d0b-0734-4a91-8c84-2a78523b636b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:44.289121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2dcc9d0b-0734-4a91-8c84-2a78523b636b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:44.289553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2dcc9d0b-0734-4a91-8c84-2a78523b636b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:44.290229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2dcc9d0b-0734-4a91-8c84-2a78523b636b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:44.290678 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2dcc9d0b-0734-4a91-8c84-2a78523b636b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:44.291108 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2dcc9d0b-0734-4a91-8c84-2a78523b636b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:44.317249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:10:44.322804 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2dcc9d0b-0734-4a91-8c84-2a78523b636b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047502 Sep 05 17:10:44.323686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 483/981] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:44 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:44.790715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-14cf9425-d7ff-429a-8353-2e7d3d1dbc3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:44.791237 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-14cf9425-d7ff-429a-8353-2e7d3d1dbc3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:44.797822 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14cf9425-d7ff-429a-8353-2e7d3d1dbc3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:44.798305 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14cf9425-d7ff-429a-8353-2e7d3d1dbc3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:44.798758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14cf9425-d7ff-429a-8353-2e7d3d1dbc3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:44.799417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14cf9425-d7ff-429a-8353-2e7d3d1dbc3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:44.799866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14cf9425-d7ff-429a-8353-2e7d3d1dbc3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:44.800316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14cf9425-d7ff-429a-8353-2e7d3d1dbc3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:44.862160 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-14cf9425-d7ff-429a-8353-2e7d3d1dbc3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:44.870404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-14cf9425-d7ff-429a-8353-2e7d3d1dbc3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.083717 Sep 05 17:10:44.870967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 499/982] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:44 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:45.168405 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-dae0fec8-abef-48ef-a797-ab43100c58a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:45.171364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-dae0fec8-abef-48ef-a797-ab43100c58a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:45.179299 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dae0fec8-abef-48ef-a797-ab43100c58a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:45.179782 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dae0fec8-abef-48ef-a797-ab43100c58a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:45.180247 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dae0fec8-abef-48ef-a797-ab43100c58a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:45.180920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dae0fec8-abef-48ef-a797-ab43100c58a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:45.181386 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dae0fec8-abef-48ef-a797-ab43100c58a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:45.181771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dae0fec8-abef-48ef-a797-ab43100c58a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:45.210775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-dae0fec8-abef-48ef-a797-ab43100c58a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048533 Sep 05 17:10:45.211325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 484/983] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:45 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:45.339937 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ae9d8ae2-54e2-4eff-ad90-c881ea6005c7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:45.343399 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ae9d8ae2-54e2-4eff-ad90-c881ea6005c7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:45.354754 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae9d8ae2-54e2-4eff-ad90-c881ea6005c7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:45.355553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae9d8ae2-54e2-4eff-ad90-c881ea6005c7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:45.356356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae9d8ae2-54e2-4eff-ad90-c881ea6005c7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:45.357502 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae9d8ae2-54e2-4eff-ad90-c881ea6005c7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:45.358240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae9d8ae2-54e2-4eff-ad90-c881ea6005c7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:45.358922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae9d8ae2-54e2-4eff-ad90-c881ea6005c7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:45.391397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ae9d8ae2-54e2-4eff-ad90-c881ea6005c7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058329 Sep 05 17:10:45.391950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 500/984] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:45 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:45.893119 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5771d250-ce2f-49d1-84c9-f78e044061c6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:45.893756 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5771d250-ce2f-49d1-84c9-f78e044061c6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:45.902453 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5771d250-ce2f-49d1-84c9-f78e044061c6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:45.903135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5771d250-ce2f-49d1-84c9-f78e044061c6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:45.903726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5771d250-ce2f-49d1-84c9-f78e044061c6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:45.904811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5771d250-ce2f-49d1-84c9-f78e044061c6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:45.905416 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5771d250-ce2f-49d1-84c9-f78e044061c6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:45.905992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5771d250-ce2f-49d1-84c9-f78e044061c6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:45.976660 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5771d250-ce2f-49d1-84c9-f78e044061c6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:45.984547 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5771d250-ce2f-49d1-84c9-f78e044061c6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095382 Sep 05 17:10:45.985108 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 485/985] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:45 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:46.225799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ac85797e-57bb-489f-92d2-08daaf58c7f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:46.227892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ac85797e-57bb-489f-92d2-08daaf58c7f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:46.234408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac85797e-57bb-489f-92d2-08daaf58c7f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:46.234893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac85797e-57bb-489f-92d2-08daaf58c7f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:46.235324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac85797e-57bb-489f-92d2-08daaf58c7f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:46.236019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac85797e-57bb-489f-92d2-08daaf58c7f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:46.236503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac85797e-57bb-489f-92d2-08daaf58c7f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:46.236929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac85797e-57bb-489f-92d2-08daaf58c7f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:46.269571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ac85797e-57bb-489f-92d2-08daaf58c7f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049466 Sep 05 17:10:46.270320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 501/986] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:46 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:46.404461 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-90c84da4-eb65-4155-b65a-aa744a099878 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:46.406590 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-90c84da4-eb65-4155-b65a-aa744a099878 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:46.413264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90c84da4-eb65-4155-b65a-aa744a099878 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:46.413740 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90c84da4-eb65-4155-b65a-aa744a099878 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:46.414165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90c84da4-eb65-4155-b65a-aa744a099878 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:46.414847 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90c84da4-eb65-4155-b65a-aa744a099878 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:46.415286 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90c84da4-eb65-4155-b65a-aa744a099878 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:46.415699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90c84da4-eb65-4155-b65a-aa744a099878 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:46.446026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-90c84da4-eb65-4155-b65a-aa744a099878 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045580 Sep 05 17:10:46.446585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 486/987] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:46 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:47.010451 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1f6801a3-4c34-45ca-a478-2c7008d2c205 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:47.011330 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1f6801a3-4c34-45ca-a478-2c7008d2c205 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:47.018936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f6801a3-4c34-45ca-a478-2c7008d2c205 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:47.019521 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f6801a3-4c34-45ca-a478-2c7008d2c205 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:47.020053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f6801a3-4c34-45ca-a478-2c7008d2c205 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:47.020983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f6801a3-4c34-45ca-a478-2c7008d2c205 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:47.021542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f6801a3-4c34-45ca-a478-2c7008d2c205 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:47.022060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f6801a3-4c34-45ca-a478-2c7008d2c205 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:47.087809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1f6801a3-4c34-45ca-a478-2c7008d2c205 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:47.099662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1f6801a3-4c34-45ca-a478-2c7008d2c205 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095208 Sep 05 17:10:47.100613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 502/988] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:47 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:47.289044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-53780848-232d-4612-aff4-25e4d0af9d00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:47.291608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-53780848-232d-4612-aff4-25e4d0af9d00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:47.299933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53780848-232d-4612-aff4-25e4d0af9d00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:47.300562 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53780848-232d-4612-aff4-25e4d0af9d00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:47.301096 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53780848-232d-4612-aff4-25e4d0af9d00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:47.302245 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53780848-232d-4612-aff4-25e4d0af9d00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:47.302924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53780848-232d-4612-aff4-25e4d0af9d00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:47.303447 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53780848-232d-4612-aff4-25e4d0af9d00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:47.336068 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-53780848-232d-4612-aff4-25e4d0af9d00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053927 Sep 05 17:10:47.336833 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 487/989] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:47 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:47.461910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-908e8202-6539-4e81-8f25-9451d9ba67bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:47.464371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-908e8202-6539-4e81-8f25-9451d9ba67bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:47.471463 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-908e8202-6539-4e81-8f25-9451d9ba67bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:47.471991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-908e8202-6539-4e81-8f25-9451d9ba67bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:47.472504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-908e8202-6539-4e81-8f25-9451d9ba67bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:47.473262 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-908e8202-6539-4e81-8f25-9451d9ba67bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:47.473991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-908e8202-6539-4e81-8f25-9451d9ba67bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:47.474454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-908e8202-6539-4e81-8f25-9451d9ba67bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:47.505981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-908e8202-6539-4e81-8f25-9451d9ba67bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049675 Sep 05 17:10:47.506512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 503/990] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:47 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:48.127063 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6f6a13df-9b18-40af-ac20-310dabed7051 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:48.128055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6f6a13df-9b18-40af-ac20-310dabed7051 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:48.138055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f6a13df-9b18-40af-ac20-310dabed7051 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:48.138844 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f6a13df-9b18-40af-ac20-310dabed7051 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:48.139548 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f6a13df-9b18-40af-ac20-310dabed7051 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:48.140711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f6a13df-9b18-40af-ac20-310dabed7051 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:48.141455 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f6a13df-9b18-40af-ac20-310dabed7051 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:48.142137 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f6a13df-9b18-40af-ac20-310dabed7051 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:48.209759 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6f6a13df-9b18-40af-ac20-310dabed7051 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:48.222422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6f6a13df-9b18-40af-ac20-310dabed7051 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.101765 Sep 05 17:10:48.223406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 488/991] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:48 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:48.356935 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9ea0c010-d542-44c7-821e-e7c49ad594b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:48.360508 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9ea0c010-d542-44c7-821e-e7c49ad594b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:48.369535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea0c010-d542-44c7-821e-e7c49ad594b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:48.370051 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea0c010-d542-44c7-821e-e7c49ad594b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:48.370626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea0c010-d542-44c7-821e-e7c49ad594b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:48.371331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea0c010-d542-44c7-821e-e7c49ad594b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:48.371778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea0c010-d542-44c7-821e-e7c49ad594b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:48.372494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea0c010-d542-44c7-821e-e7c49ad594b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:48.404861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9ea0c010-d542-44c7-821e-e7c49ad594b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055927 Sep 05 17:10:48.405417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 504/992] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:48 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:48.521062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9b9a3979-2d04-440f-9d5b-4af6cec9c0f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:48.523861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9b9a3979-2d04-440f-9d5b-4af6cec9c0f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:48.532581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9b9a3979-2d04-440f-9d5b-4af6cec9c0f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:48.533223 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9b9a3979-2d04-440f-9d5b-4af6cec9c0f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:48.533791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9b9a3979-2d04-440f-9d5b-4af6cec9c0f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:48.534697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9b9a3979-2d04-440f-9d5b-4af6cec9c0f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:48.535305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9b9a3979-2d04-440f-9d5b-4af6cec9c0f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:48.535998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9b9a3979-2d04-440f-9d5b-4af6cec9c0f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:48.566382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9b9a3979-2d04-440f-9d5b-4af6cec9c0f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050734 Sep 05 17:10:48.566940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 489/993] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:48 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:49.256841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-142bdc2b-407c-4e73-af18-ea8de7065ce1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:49.257845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-142bdc2b-407c-4e73-af18-ea8de7065ce1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:49.267970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-142bdc2b-407c-4e73-af18-ea8de7065ce1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:49.268843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-142bdc2b-407c-4e73-af18-ea8de7065ce1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:49.269544 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-142bdc2b-407c-4e73-af18-ea8de7065ce1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:49.270671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-142bdc2b-407c-4e73-af18-ea8de7065ce1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:49.271424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-142bdc2b-407c-4e73-af18-ea8de7065ce1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:49.272128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-142bdc2b-407c-4e73-af18-ea8de7065ce1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:49.338196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-142bdc2b-407c-4e73-af18-ea8de7065ce1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:49.348716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-142bdc2b-407c-4e73-af18-ea8de7065ce1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098250 Sep 05 17:10:49.349281 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 505/994] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:49 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:49.421924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f8acff29-6e96-4d64-8263-6446c7b29cf1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:49.425386 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f8acff29-6e96-4d64-8263-6446c7b29cf1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:49.435641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8acff29-6e96-4d64-8263-6446c7b29cf1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:49.436533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8acff29-6e96-4d64-8263-6446c7b29cf1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:49.437240 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8acff29-6e96-4d64-8263-6446c7b29cf1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:49.438369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8acff29-6e96-4d64-8263-6446c7b29cf1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:49.439107 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8acff29-6e96-4d64-8263-6446c7b29cf1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:49.439797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8acff29-6e96-4d64-8263-6446c7b29cf1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:49.470296 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f8acff29-6e96-4d64-8263-6446c7b29cf1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055119 Sep 05 17:10:49.470857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 490/995] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:49 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:49.583540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-71e9fe9d-6891-4445-9adf-2b03ebf8322d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:49.585851 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-71e9fe9d-6891-4445-9adf-2b03ebf8322d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:49.592820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71e9fe9d-6891-4445-9adf-2b03ebf8322d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:49.593381 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71e9fe9d-6891-4445-9adf-2b03ebf8322d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:49.593807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71e9fe9d-6891-4445-9adf-2b03ebf8322d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:49.594497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71e9fe9d-6891-4445-9adf-2b03ebf8322d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:49.594941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71e9fe9d-6891-4445-9adf-2b03ebf8322d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:49.595355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71e9fe9d-6891-4445-9adf-2b03ebf8322d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:49.626576 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-71e9fe9d-6891-4445-9adf-2b03ebf8322d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049577 Sep 05 17:10:49.627113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 506/996] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:49 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:50.376261 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8d1108c7-8660-40f6-bf2a-8e4f1bca7a46 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:50.377249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8d1108c7-8660-40f6-bf2a-8e4f1bca7a46 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:50.388439 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d1108c7-8660-40f6-bf2a-8e4f1bca7a46 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:50.389294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d1108c7-8660-40f6-bf2a-8e4f1bca7a46 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:50.389938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d1108c7-8660-40f6-bf2a-8e4f1bca7a46 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:50.391068 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d1108c7-8660-40f6-bf2a-8e4f1bca7a46 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:50.391805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d1108c7-8660-40f6-bf2a-8e4f1bca7a46 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:50.392542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d1108c7-8660-40f6-bf2a-8e4f1bca7a46 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:50.455855 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8d1108c7-8660-40f6-bf2a-8e4f1bca7a46 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:50.464760 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8d1108c7-8660-40f6-bf2a-8e4f1bca7a46 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095498 Sep 05 17:10:50.465334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 491/997] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:50 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:50.483625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-992fa328-f9aa-4bc9-a7ba-68ba65051e1a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:50.485820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-992fa328-f9aa-4bc9-a7ba-68ba65051e1a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:50.492705 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-992fa328-f9aa-4bc9-a7ba-68ba65051e1a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:50.493183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-992fa328-f9aa-4bc9-a7ba-68ba65051e1a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:50.493605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-992fa328-f9aa-4bc9-a7ba-68ba65051e1a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:50.494285 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-992fa328-f9aa-4bc9-a7ba-68ba65051e1a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:50.494726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-992fa328-f9aa-4bc9-a7ba-68ba65051e1a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:50.495139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-992fa328-f9aa-4bc9-a7ba-68ba65051e1a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:50.525836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-992fa328-f9aa-4bc9-a7ba-68ba65051e1a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046418 Sep 05 17:10:50.526389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 507/998] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:50 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:50.640279 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4196ee48-a7db-4100-8948-509e5eb6f0cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:50.642248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4196ee48-a7db-4100-8948-509e5eb6f0cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:50.648807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4196ee48-a7db-4100-8948-509e5eb6f0cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:50.649285 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4196ee48-a7db-4100-8948-509e5eb6f0cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:50.649711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4196ee48-a7db-4100-8948-509e5eb6f0cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:50.650392 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4196ee48-a7db-4100-8948-509e5eb6f0cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:50.650833 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4196ee48-a7db-4100-8948-509e5eb6f0cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:50.651245 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4196ee48-a7db-4100-8948-509e5eb6f0cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:50.681015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4196ee48-a7db-4100-8948-509e5eb6f0cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044999 Sep 05 17:10:50.681563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 492/999] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:50 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:51.495159 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ea36b570-dbe3-45db-8913-e3eff92d2aa7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:51.496136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ea36b570-dbe3-45db-8913-e3eff92d2aa7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:51.506642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea36b570-dbe3-45db-8913-e3eff92d2aa7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:51.507124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea36b570-dbe3-45db-8913-e3eff92d2aa7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:51.507555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea36b570-dbe3-45db-8913-e3eff92d2aa7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:51.508294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea36b570-dbe3-45db-8913-e3eff92d2aa7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:51.508745 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea36b570-dbe3-45db-8913-e3eff92d2aa7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:51.509167 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea36b570-dbe3-45db-8913-e3eff92d2aa7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:51.538996 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d3562a67-7e97-4d6a-85f8-a4f57107e218 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:51.541274 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d3562a67-7e97-4d6a-85f8-a4f57107e218 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:51.548072 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3562a67-7e97-4d6a-85f8-a4f57107e218 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:51.548579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3562a67-7e97-4d6a-85f8-a4f57107e218 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:51.548981 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3562a67-7e97-4d6a-85f8-a4f57107e218 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:51.549703 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3562a67-7e97-4d6a-85f8-a4f57107e218 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:51.550146 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3562a67-7e97-4d6a-85f8-a4f57107e218 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:51.550557 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3562a67-7e97-4d6a-85f8-a4f57107e218 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:51.571414 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ea36b570-dbe3-45db-8913-e3eff92d2aa7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:51.579636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ea36b570-dbe3-45db-8913-e3eff92d2aa7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091243 Sep 05 17:10:51.580207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 508/1000] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:51 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:51.580386 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d3562a67-7e97-4d6a-85f8-a4f57107e218 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045546 Sep 05 17:10:51.580835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 493/1001] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:51 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:51.697861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bcb7536c-59c1-4d32-91af-ba4c07abecb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:51.701526 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bcb7536c-59c1-4d32-91af-ba4c07abecb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:51.711765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bcb7536c-59c1-4d32-91af-ba4c07abecb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:51.712853 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bcb7536c-59c1-4d32-91af-ba4c07abecb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:51.713597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bcb7536c-59c1-4d32-91af-ba4c07abecb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:51.714699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bcb7536c-59c1-4d32-91af-ba4c07abecb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:51.715453 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bcb7536c-59c1-4d32-91af-ba4c07abecb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:51.716249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bcb7536c-59c1-4d32-91af-ba4c07abecb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:51.750303 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bcb7536c-59c1-4d32-91af-ba4c07abecb2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059731 Sep 05 17:10:51.750855 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 509/1002] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:51 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:52.598065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a54d8ed7-6fa8-4456-af5b-2fbdb0a1e21c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:52.602312 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a54d8ed7-6fa8-4456-af5b-2fbdb0a1e21c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:52.607645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1c49fcb0-a4d7-40f9-a24e-ca14f82caa79 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:52.608700 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1c49fcb0-a4d7-40f9-a24e-ca14f82caa79 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:52.613662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a54d8ed7-6fa8-4456-af5b-2fbdb0a1e21c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:52.614388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a54d8ed7-6fa8-4456-af5b-2fbdb0a1e21c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:52.615181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a54d8ed7-6fa8-4456-af5b-2fbdb0a1e21c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:52.616341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a54d8ed7-6fa8-4456-af5b-2fbdb0a1e21c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:52.617101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a54d8ed7-6fa8-4456-af5b-2fbdb0a1e21c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:52.617970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a54d8ed7-6fa8-4456-af5b-2fbdb0a1e21c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:52.619054 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c49fcb0-a4d7-40f9-a24e-ca14f82caa79 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:52.619639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c49fcb0-a4d7-40f9-a24e-ca14f82caa79 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:52.620172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c49fcb0-a4d7-40f9-a24e-ca14f82caa79 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:52.620891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c49fcb0-a4d7-40f9-a24e-ca14f82caa79 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:52.621340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c49fcb0-a4d7-40f9-a24e-ca14f82caa79 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:52.621763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c49fcb0-a4d7-40f9-a24e-ca14f82caa79 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:52.648241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a54d8ed7-6fa8-4456-af5b-2fbdb0a1e21c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057280 Sep 05 17:10:52.648767 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 494/1003] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:52 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:52.691099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1c49fcb0-a4d7-40f9-a24e-ca14f82caa79 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:52.699429 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1c49fcb0-a4d7-40f9-a24e-ca14f82caa79 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.100100 Sep 05 17:10:52.700003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 510/1004] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:52 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:52.763127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2178bc44-ec15-4a9e-9db4-ba3960fe9a09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:52.765306 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2178bc44-ec15-4a9e-9db4-ba3960fe9a09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:52.771803 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2178bc44-ec15-4a9e-9db4-ba3960fe9a09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:52.772331 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2178bc44-ec15-4a9e-9db4-ba3960fe9a09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:52.772817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2178bc44-ec15-4a9e-9db4-ba3960fe9a09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:52.773529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2178bc44-ec15-4a9e-9db4-ba3960fe9a09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:52.774047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2178bc44-ec15-4a9e-9db4-ba3960fe9a09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:52.774468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2178bc44-ec15-4a9e-9db4-ba3960fe9a09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:52.804514 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2178bc44-ec15-4a9e-9db4-ba3960fe9a09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045456 Sep 05 17:10:52.805422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 495/1005] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:52 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:53.665722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-82441299-54f9-4cba-9b1d-06b6381e25dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:53.668048 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-82441299-54f9-4cba-9b1d-06b6381e25dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:53.675744 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82441299-54f9-4cba-9b1d-06b6381e25dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:53.676315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82441299-54f9-4cba-9b1d-06b6381e25dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:53.676800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82441299-54f9-4cba-9b1d-06b6381e25dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:53.677597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82441299-54f9-4cba-9b1d-06b6381e25dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:53.678097 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82441299-54f9-4cba-9b1d-06b6381e25dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:53.678568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82441299-54f9-4cba-9b1d-06b6381e25dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:53.710836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-82441299-54f9-4cba-9b1d-06b6381e25dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052460 Sep 05 17:10:53.711830 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 511/1006] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:53 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:53.725595 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ce7e737b-9d52-4c20-b8f2-db68d2f3aa3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:53.726160 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ce7e737b-9d52-4c20-b8f2-db68d2f3aa3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:53.733812 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce7e737b-9d52-4c20-b8f2-db68d2f3aa3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:53.734290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce7e737b-9d52-4c20-b8f2-db68d2f3aa3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:53.734709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce7e737b-9d52-4c20-b8f2-db68d2f3aa3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:53.735384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce7e737b-9d52-4c20-b8f2-db68d2f3aa3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:53.735827 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce7e737b-9d52-4c20-b8f2-db68d2f3aa3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:53.736274 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce7e737b-9d52-4c20-b8f2-db68d2f3aa3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:53.799748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ce7e737b-9d52-4c20-b8f2-db68d2f3aa3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:53.807928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ce7e737b-9d52-4c20-b8f2-db68d2f3aa3b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089187 Sep 05 17:10:53.808609 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 496/1007] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:53 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:53.817512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3098ff94-b3ab-4c1e-afe3-37bc2744f452 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:53.819799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3098ff94-b3ab-4c1e-afe3-37bc2744f452 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:53.826028 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3098ff94-b3ab-4c1e-afe3-37bc2744f452 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:53.826506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3098ff94-b3ab-4c1e-afe3-37bc2744f452 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:53.826936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3098ff94-b3ab-4c1e-afe3-37bc2744f452 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:53.827617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3098ff94-b3ab-4c1e-afe3-37bc2744f452 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:53.828061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3098ff94-b3ab-4c1e-afe3-37bc2744f452 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:53.828545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3098ff94-b3ab-4c1e-afe3-37bc2744f452 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:53.859252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3098ff94-b3ab-4c1e-afe3-37bc2744f452 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045759 Sep 05 17:10:53.859806 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 512/1008] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:53 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:54.728746 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-626bcba9-2f09-4eab-b73f-6adb4d2ce36e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:54.732215 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-626bcba9-2f09-4eab-b73f-6adb4d2ce36e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:54.743116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-626bcba9-2f09-4eab-b73f-6adb4d2ce36e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:54.744029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-626bcba9-2f09-4eab-b73f-6adb4d2ce36e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:54.744507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-626bcba9-2f09-4eab-b73f-6adb4d2ce36e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:54.745203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-626bcba9-2f09-4eab-b73f-6adb4d2ce36e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:54.745654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-626bcba9-2f09-4eab-b73f-6adb4d2ce36e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:54.746073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-626bcba9-2f09-4eab-b73f-6adb4d2ce36e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:54.776115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-626bcba9-2f09-4eab-b73f-6adb4d2ce36e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054580 Sep 05 17:10:54.776701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 497/1009] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:54 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:54.831031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4baf3b67-62ab-4576-ab0d-d63880dcd43b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:54.831670 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4baf3b67-62ab-4576-ab0d-d63880dcd43b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:54.838977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4baf3b67-62ab-4576-ab0d-d63880dcd43b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:54.839494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4baf3b67-62ab-4576-ab0d-d63880dcd43b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:54.839922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4baf3b67-62ab-4576-ab0d-d63880dcd43b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:54.840650 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4baf3b67-62ab-4576-ab0d-d63880dcd43b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:54.841100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4baf3b67-62ab-4576-ab0d-d63880dcd43b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:54.841522 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4baf3b67-62ab-4576-ab0d-d63880dcd43b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:54.871191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1f86529a-a60b-4500-89ea-33ce3574ec02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:54.873491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1f86529a-a60b-4500-89ea-33ce3574ec02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:54.880275 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f86529a-a60b-4500-89ea-33ce3574ec02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:54.880771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f86529a-a60b-4500-89ea-33ce3574ec02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:54.881229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f86529a-a60b-4500-89ea-33ce3574ec02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:54.881952 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f86529a-a60b-4500-89ea-33ce3574ec02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:54.882396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f86529a-a60b-4500-89ea-33ce3574ec02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:54.882809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f86529a-a60b-4500-89ea-33ce3574ec02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:54.904216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4baf3b67-62ab-4576-ab0d-d63880dcd43b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:54.912428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4baf3b67-62ab-4576-ab0d-d63880dcd43b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.085263 Sep 05 17:10:54.913082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 513/1010] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:54 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:54.914064 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1f86529a-a60b-4500-89ea-33ce3574ec02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046915 Sep 05 17:10:54.914618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 498/1011] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:54 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:55.792590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d674a2d5-3d77-4150-a8e2-05e4de970352 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:55.795033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d674a2d5-3d77-4150-a8e2-05e4de970352 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:55.801867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d674a2d5-3d77-4150-a8e2-05e4de970352 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:55.802359 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d674a2d5-3d77-4150-a8e2-05e4de970352 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:55.802791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d674a2d5-3d77-4150-a8e2-05e4de970352 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:55.803506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d674a2d5-3d77-4150-a8e2-05e4de970352 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:55.803988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d674a2d5-3d77-4150-a8e2-05e4de970352 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:55.804439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d674a2d5-3d77-4150-a8e2-05e4de970352 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:55.837297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d674a2d5-3d77-4150-a8e2-05e4de970352 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049656 Sep 05 17:10:55.838047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 514/1012] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:55 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:55.928695 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-703cfb2f-5a6b-41e2-b15f-2768bbcf8fce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:55.930792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-703cfb2f-5a6b-41e2-b15f-2768bbcf8fce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:55.935745 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d9a593e8-db6f-4903-ad48-2c912252e66b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:55.936565 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d9a593e8-db6f-4903-ad48-2c912252e66b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:55.942037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-703cfb2f-5a6b-41e2-b15f-2768bbcf8fce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:55.942726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-703cfb2f-5a6b-41e2-b15f-2768bbcf8fce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:55.943394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-703cfb2f-5a6b-41e2-b15f-2768bbcf8fce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:55.944094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-703cfb2f-5a6b-41e2-b15f-2768bbcf8fce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:55.944764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-703cfb2f-5a6b-41e2-b15f-2768bbcf8fce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:55.945620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-703cfb2f-5a6b-41e2-b15f-2768bbcf8fce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:55.947551 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9a593e8-db6f-4903-ad48-2c912252e66b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:55.948025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9a593e8-db6f-4903-ad48-2c912252e66b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:55.948498 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9a593e8-db6f-4903-ad48-2c912252e66b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:55.949236 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9a593e8-db6f-4903-ad48-2c912252e66b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:55.949715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9a593e8-db6f-4903-ad48-2c912252e66b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:55.950140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9a593e8-db6f-4903-ad48-2c912252e66b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:55.958143 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:10:55.993074 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-703cfb2f-5a6b-41e2-b15f-2768bbcf8fce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068647 Sep 05 17:10:55.994327 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 499/1013] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:55 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:56.021898 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d9a593e8-db6f-4903-ad48-2c912252e66b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:56.030436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d9a593e8-db6f-4903-ad48-2c912252e66b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.099199 Sep 05 17:10:56.030986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 515/1014] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:55 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:56.853545 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-af241058-0cf7-4cec-b2cb-dab901597264 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:56.855862 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-af241058-0cf7-4cec-b2cb-dab901597264 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:56.862283 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af241058-0cf7-4cec-b2cb-dab901597264 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:56.862813 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af241058-0cf7-4cec-b2cb-dab901597264 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:56.863229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af241058-0cf7-4cec-b2cb-dab901597264 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:56.863908 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af241058-0cf7-4cec-b2cb-dab901597264 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:56.864375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af241058-0cf7-4cec-b2cb-dab901597264 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:56.864789 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af241058-0cf7-4cec-b2cb-dab901597264 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:56.882436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:10:56.895368 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-af241058-0cf7-4cec-b2cb-dab901597264 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048854 Sep 05 17:10:56.895932 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 500/1015] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:56 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:57.013547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e9f79f36-5a53-4fb7-8d82-f30305b6abea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:57.016690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e9f79f36-5a53-4fb7-8d82-f30305b6abea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:57.026552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9f79f36-5a53-4fb7-8d82-f30305b6abea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:57.027035 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9f79f36-5a53-4fb7-8d82-f30305b6abea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:57.027467 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9f79f36-5a53-4fb7-8d82-f30305b6abea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:57.028173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9f79f36-5a53-4fb7-8d82-f30305b6abea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:57.028638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9f79f36-5a53-4fb7-8d82-f30305b6abea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:57.029063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9f79f36-5a53-4fb7-8d82-f30305b6abea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:57.058683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b608157e-5337-4980-9284-3600e03dcf20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:57.059262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b608157e-5337-4980-9284-3600e03dcf20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:57.063012 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e9f79f36-5a53-4fb7-8d82-f30305b6abea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056394 Sep 05 17:10:57.063795 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 516/1016] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:57 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:57.066857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b608157e-5337-4980-9284-3600e03dcf20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:57.067353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b608157e-5337-4980-9284-3600e03dcf20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:57.067775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b608157e-5337-4980-9284-3600e03dcf20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:57.068635 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b608157e-5337-4980-9284-3600e03dcf20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:57.069081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b608157e-5337-4980-9284-3600e03dcf20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:57.069488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b608157e-5337-4980-9284-3600e03dcf20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:57.135406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b608157e-5337-4980-9284-3600e03dcf20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:57.144280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b608157e-5337-4980-9284-3600e03dcf20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089962 Sep 05 17:10:57.144824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 501/1017] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:57 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:57.914856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-70be6469-f602-42e8-937f-0c5fbe191bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:57.918542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-70be6469-f602-42e8-937f-0c5fbe191bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:57.928730 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70be6469-f602-42e8-937f-0c5fbe191bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:57.929528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70be6469-f602-42e8-937f-0c5fbe191bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:57.930308 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70be6469-f602-42e8-937f-0c5fbe191bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:57.931573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70be6469-f602-42e8-937f-0c5fbe191bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:57.932192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70be6469-f602-42e8-937f-0c5fbe191bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:57.932760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70be6469-f602-42e8-937f-0c5fbe191bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:57.962287 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-70be6469-f602-42e8-937f-0c5fbe191bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054549 Sep 05 17:10:57.963036 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 517/1018] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:57 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:58.080600 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-87a721e7-7edf-4f3e-8388-2696403ddb0d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:58.084089 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-87a721e7-7edf-4f3e-8388-2696403ddb0d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:58.092829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87a721e7-7edf-4f3e-8388-2696403ddb0d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:58.093438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87a721e7-7edf-4f3e-8388-2696403ddb0d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:58.093867 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87a721e7-7edf-4f3e-8388-2696403ddb0d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:58.094537 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87a721e7-7edf-4f3e-8388-2696403ddb0d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:58.095028 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87a721e7-7edf-4f3e-8388-2696403ddb0d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:58.095440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87a721e7-7edf-4f3e-8388-2696403ddb0d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:58.125259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-87a721e7-7edf-4f3e-8388-2696403ddb0d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051447 Sep 05 17:10:58.125813 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 502/1019] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:58 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:58.167234 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-17d69a7f-f053-4b48-be0b-6bbb62d81be6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:58.167785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-17d69a7f-f053-4b48-be0b-6bbb62d81be6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:58.174100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17d69a7f-f053-4b48-be0b-6bbb62d81be6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:58.174578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17d69a7f-f053-4b48-be0b-6bbb62d81be6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:58.175005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17d69a7f-f053-4b48-be0b-6bbb62d81be6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:58.175685 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17d69a7f-f053-4b48-be0b-6bbb62d81be6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:58.176137 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17d69a7f-f053-4b48-be0b-6bbb62d81be6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:58.176581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17d69a7f-f053-4b48-be0b-6bbb62d81be6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:58.245079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-17d69a7f-f053-4b48-be0b-6bbb62d81be6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:58.253556 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-17d69a7f-f053-4b48-be0b-6bbb62d81be6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.090477 Sep 05 17:10:58.254130 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 518/1020] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:58 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:10:58.975981 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2c4c6891-c139-4cfc-948a-fbde8d881269 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:58.978239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2c4c6891-c139-4cfc-948a-fbde8d881269 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:58.984428 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c4c6891-c139-4cfc-948a-fbde8d881269 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:58.984918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c4c6891-c139-4cfc-948a-fbde8d881269 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:58.985354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c4c6891-c139-4cfc-948a-fbde8d881269 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:58.986077 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c4c6891-c139-4cfc-948a-fbde8d881269 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:58.986529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c4c6891-c139-4cfc-948a-fbde8d881269 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:58.986946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c4c6891-c139-4cfc-948a-fbde8d881269 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:59.017542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2c4c6891-c139-4cfc-948a-fbde8d881269 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046051 Sep 05 17:10:59.018096 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 503/1021] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:10:58 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:10:59.146967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-62bdaf66-3a87-4bdf-99a5-4be2e7b870e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:59.151120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-62bdaf66-3a87-4bdf-99a5-4be2e7b870e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:59.162088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62bdaf66-3a87-4bdf-99a5-4be2e7b870e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:59.162883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62bdaf66-3a87-4bdf-99a5-4be2e7b870e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:59.163610 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62bdaf66-3a87-4bdf-99a5-4be2e7b870e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:59.164796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62bdaf66-3a87-4bdf-99a5-4be2e7b870e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:59.165661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62bdaf66-3a87-4bdf-99a5-4be2e7b870e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:59.166595 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62bdaf66-3a87-4bdf-99a5-4be2e7b870e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:59.197590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-62bdaf66-3a87-4bdf-99a5-4be2e7b870e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061141 Sep 05 17:10:59.198374 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 519/1022] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:10:59 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:10:59.280975 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5bd42dc6-1039-4219-bf8b-65642753493d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:10:59.281989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5bd42dc6-1039-4219-bf8b-65642753493d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:10:59.292973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5bd42dc6-1039-4219-bf8b-65642753493d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:59.293916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5bd42dc6-1039-4219-bf8b-65642753493d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:59.294658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5bd42dc6-1039-4219-bf8b-65642753493d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:59.295794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5bd42dc6-1039-4219-bf8b-65642753493d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:10:59.296587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5bd42dc6-1039-4219-bf8b-65642753493d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:10:59.297332 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5bd42dc6-1039-4219-bf8b-65642753493d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:10:59.363609 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5bd42dc6-1039-4219-bf8b-65642753493d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:10:59.372188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5bd42dc6-1039-4219-bf8b-65642753493d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098077 Sep 05 17:10:59.372778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 504/1023] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:10:59 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:00.035025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-94b60e25-28e8-4276-b599-621e55dbef3e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:00.038383 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-94b60e25-28e8-4276-b599-621e55dbef3e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:00.042152 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=84 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:11:00.051329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94b60e25-28e8-4276-b599-621e55dbef3e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:00.052131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94b60e25-28e8-4276-b599-621e55dbef3e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:00.052893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94b60e25-28e8-4276-b599-621e55dbef3e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:00.054044 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94b60e25-28e8-4276-b599-621e55dbef3e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:00.054793 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94b60e25-28e8-4276-b599-621e55dbef3e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:00.055548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94b60e25-28e8-4276-b599-621e55dbef3e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:00.086320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-94b60e25-28e8-4276-b599-621e55dbef3e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058271 Sep 05 17:11:00.086881 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 520/1024] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:00 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:00.213619 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-23047a88-e3a9-48e5-805c-6b5357842cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:00.215757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-23047a88-e3a9-48e5-805c-6b5357842cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:00.222224 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23047a88-e3a9-48e5-805c-6b5357842cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:00.222701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23047a88-e3a9-48e5-805c-6b5357842cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:00.223115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23047a88-e3a9-48e5-805c-6b5357842cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:00.223816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23047a88-e3a9-48e5-805c-6b5357842cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:00.224305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23047a88-e3a9-48e5-805c-6b5357842cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:00.224722 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23047a88-e3a9-48e5-805c-6b5357842cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:00.254488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-23047a88-e3a9-48e5-805c-6b5357842cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047125 Sep 05 17:11:00.255054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 505/1025] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:00 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:00.395099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dbef7540-f83d-4aa0-bd00-af29888f7c67 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:00.395727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dbef7540-f83d-4aa0-bd00-af29888f7c67 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:00.402339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dbef7540-f83d-4aa0-bd00-af29888f7c67 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:00.402818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dbef7540-f83d-4aa0-bd00-af29888f7c67 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:00.403246 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dbef7540-f83d-4aa0-bd00-af29888f7c67 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:00.403929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dbef7540-f83d-4aa0-bd00-af29888f7c67 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:00.404401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dbef7540-f83d-4aa0-bd00-af29888f7c67 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:00.404815 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dbef7540-f83d-4aa0-bd00-af29888f7c67 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:00.469933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dbef7540-f83d-4aa0-bd00-af29888f7c67 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:00.479378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dbef7540-f83d-4aa0-bd00-af29888f7c67 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.088201 Sep 05 17:11:00.479960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 521/1026] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:00 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:01.104546 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d2da182d-8b89-41b1-b0d9-81a545a9b148 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:01.106713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d2da182d-8b89-41b1-b0d9-81a545a9b148 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:01.113528 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2da182d-8b89-41b1-b0d9-81a545a9b148 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:01.114045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2da182d-8b89-41b1-b0d9-81a545a9b148 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:01.114472 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2da182d-8b89-41b1-b0d9-81a545a9b148 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:01.115161 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2da182d-8b89-41b1-b0d9-81a545a9b148 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:01.115607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2da182d-8b89-41b1-b0d9-81a545a9b148 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:01.116024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2da182d-8b89-41b1-b0d9-81a545a9b148 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:01.148544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d2da182d-8b89-41b1-b0d9-81a545a9b148 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051318 Sep 05 17:11:01.149143 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 506/1027] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:01 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:01.274205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fccff6e9-7a4f-45a1-9fa8-42cb45006529 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:01.277685 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fccff6e9-7a4f-45a1-9fa8-42cb45006529 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:01.287976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fccff6e9-7a4f-45a1-9fa8-42cb45006529 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:01.288848 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fccff6e9-7a4f-45a1-9fa8-42cb45006529 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:01.289566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fccff6e9-7a4f-45a1-9fa8-42cb45006529 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:01.291173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fccff6e9-7a4f-45a1-9fa8-42cb45006529 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:01.292017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fccff6e9-7a4f-45a1-9fa8-42cb45006529 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:01.292463 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fccff6e9-7a4f-45a1-9fa8-42cb45006529 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:01.322622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fccff6e9-7a4f-45a1-9fa8-42cb45006529 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054631 Sep 05 17:11:01.323152 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 522/1028] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:01 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:01.507478 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-12903b27-6884-44a9-960e-c9b0004d5ac0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:01.508549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-12903b27-6884-44a9-960e-c9b0004d5ac0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:01.520294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-12903b27-6884-44a9-960e-c9b0004d5ac0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:01.521488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-12903b27-6884-44a9-960e-c9b0004d5ac0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:01.522570 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-12903b27-6884-44a9-960e-c9b0004d5ac0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:01.523698 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-12903b27-6884-44a9-960e-c9b0004d5ac0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:01.524502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-12903b27-6884-44a9-960e-c9b0004d5ac0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:01.525429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-12903b27-6884-44a9-960e-c9b0004d5ac0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:01.592530 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-12903b27-6884-44a9-960e-c9b0004d5ac0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:01.604778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-12903b27-6884-44a9-960e-c9b0004d5ac0 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.103696 Sep 05 17:11:01.605666 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 507/1029] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:01 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:02.165859 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1bf69562-323a-4f2b-a390-701782e4930e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:02.168021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1bf69562-323a-4f2b-a390-701782e4930e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:02.174885 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bf69562-323a-4f2b-a390-701782e4930e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:02.175363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bf69562-323a-4f2b-a390-701782e4930e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:02.175795 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bf69562-323a-4f2b-a390-701782e4930e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:02.176520 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bf69562-323a-4f2b-a390-701782e4930e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:02.176968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bf69562-323a-4f2b-a390-701782e4930e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:02.177388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bf69562-323a-4f2b-a390-701782e4930e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:02.217192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1bf69562-323a-4f2b-a390-701782e4930e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058186 Sep 05 17:11:02.217748 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 523/1030] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:02 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:02.339881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d1e051ac-6a38-448b-b0fd-ef6122848cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:02.342543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d1e051ac-6a38-448b-b0fd-ef6122848cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:02.351240 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1e051ac-6a38-448b-b0fd-ef6122848cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:02.351841 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1e051ac-6a38-448b-b0fd-ef6122848cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:02.352445 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1e051ac-6a38-448b-b0fd-ef6122848cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:02.353855 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1e051ac-6a38-448b-b0fd-ef6122848cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:02.354429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1e051ac-6a38-448b-b0fd-ef6122848cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:02.354953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1e051ac-6a38-448b-b0fd-ef6122848cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:02.391337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d1e051ac-6a38-448b-b0fd-ef6122848cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058582 Sep 05 17:11:02.391924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 508/1031] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:02 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:02.635911 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3237b9c7-9e7b-4efd-b0dc-d86b1e6e7f20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:02.636547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3237b9c7-9e7b-4efd-b0dc-d86b1e6e7f20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:02.642911 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3237b9c7-9e7b-4efd-b0dc-d86b1e6e7f20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:02.643415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3237b9c7-9e7b-4efd-b0dc-d86b1e6e7f20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:02.643839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3237b9c7-9e7b-4efd-b0dc-d86b1e6e7f20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:02.644564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3237b9c7-9e7b-4efd-b0dc-d86b1e6e7f20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:02.645029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3237b9c7-9e7b-4efd-b0dc-d86b1e6e7f20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:02.645444 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3237b9c7-9e7b-4efd-b0dc-d86b1e6e7f20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:02.707945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3237b9c7-9e7b-4efd-b0dc-d86b1e6e7f20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:02.716517 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3237b9c7-9e7b-4efd-b0dc-d86b1e6e7f20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086250 Sep 05 17:11:02.717314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 524/1032] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:02 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:03.234371 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8498eb77-b355-4dca-8179-4dbe6375862a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:03.237932 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8498eb77-b355-4dca-8179-4dbe6375862a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:03.246674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8498eb77-b355-4dca-8179-4dbe6375862a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:03.247149 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8498eb77-b355-4dca-8179-4dbe6375862a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:03.247569 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8498eb77-b355-4dca-8179-4dbe6375862a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:03.248284 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8498eb77-b355-4dca-8179-4dbe6375862a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:03.248740 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8498eb77-b355-4dca-8179-4dbe6375862a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:03.249147 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8498eb77-b355-4dca-8179-4dbe6375862a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:03.279233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8498eb77-b355-4dca-8179-4dbe6375862a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051828 Sep 05 17:11:03.279828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 509/1033] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:03 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:03.403506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7fab60b0-0274-47ae-87b6-1415961ecf9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:03.405732 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7fab60b0-0274-47ae-87b6-1415961ecf9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:03.412634 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fab60b0-0274-47ae-87b6-1415961ecf9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:03.413085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fab60b0-0274-47ae-87b6-1415961ecf9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:03.413506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fab60b0-0274-47ae-87b6-1415961ecf9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:03.414185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fab60b0-0274-47ae-87b6-1415961ecf9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:03.414622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fab60b0-0274-47ae-87b6-1415961ecf9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:03.415034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fab60b0-0274-47ae-87b6-1415961ecf9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:03.445516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7fab60b0-0274-47ae-87b6-1415961ecf9e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046179 Sep 05 17:11:03.446065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 525/1034] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:03 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:03.743014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f14b8bdb-e3c6-4668-923c-8f3fa5b25828 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:03.744215 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f14b8bdb-e3c6-4668-923c-8f3fa5b25828 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:03.746747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=86 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:11:03.752367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f14b8bdb-e3c6-4668-923c-8f3fa5b25828 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:03.752846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f14b8bdb-e3c6-4668-923c-8f3fa5b25828 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:03.753275 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f14b8bdb-e3c6-4668-923c-8f3fa5b25828 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:03.753958 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f14b8bdb-e3c6-4668-923c-8f3fa5b25828 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:03.754407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f14b8bdb-e3c6-4668-923c-8f3fa5b25828 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:03.754820 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f14b8bdb-e3c6-4668-923c-8f3fa5b25828 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:03.822642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f14b8bdb-e3c6-4668-923c-8f3fa5b25828 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:03.830660 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f14b8bdb-e3c6-4668-923c-8f3fa5b25828 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.094218 Sep 05 17:11:03.831225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 510/1035] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:03 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:04.296766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f5df9e43-a780-47a9-b55e-101409cb6a00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:04.300282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f5df9e43-a780-47a9-b55e-101409cb6a00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:04.310532 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5df9e43-a780-47a9-b55e-101409cb6a00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:04.311329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5df9e43-a780-47a9-b55e-101409cb6a00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:04.312045 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5df9e43-a780-47a9-b55e-101409cb6a00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:04.313233 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5df9e43-a780-47a9-b55e-101409cb6a00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:04.314016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5df9e43-a780-47a9-b55e-101409cb6a00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:04.314786 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5df9e43-a780-47a9-b55e-101409cb6a00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:04.362343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f5df9e43-a780-47a9-b55e-101409cb6a00 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072196 Sep 05 17:11:04.363031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 526/1036] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:04 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:04.463170 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1cef8b6a-bd77-413f-bcac-6f06e034f7b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:04.465376 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1cef8b6a-bd77-413f-bcac-6f06e034f7b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:04.471824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1cef8b6a-bd77-413f-bcac-6f06e034f7b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:04.472339 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1cef8b6a-bd77-413f-bcac-6f06e034f7b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:04.472766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1cef8b6a-bd77-413f-bcac-6f06e034f7b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:04.473452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1cef8b6a-bd77-413f-bcac-6f06e034f7b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:04.473898 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1cef8b6a-bd77-413f-bcac-6f06e034f7b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:04.474314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1cef8b6a-bd77-413f-bcac-6f06e034f7b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:04.505349 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1cef8b6a-bd77-413f-bcac-6f06e034f7b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049124 Sep 05 17:11:04.505911 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 511/1037] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:04 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:04.855738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-459c4f8c-e60d-4487-8111-2429a39f4887 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:04.856560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-459c4f8c-e60d-4487-8111-2429a39f4887 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:04.865113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-459c4f8c-e60d-4487-8111-2429a39f4887 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:04.865568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-459c4f8c-e60d-4487-8111-2429a39f4887 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:04.866102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-459c4f8c-e60d-4487-8111-2429a39f4887 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:04.866950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-459c4f8c-e60d-4487-8111-2429a39f4887 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:04.867514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-459c4f8c-e60d-4487-8111-2429a39f4887 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:04.868034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-459c4f8c-e60d-4487-8111-2429a39f4887 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:04.933234 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-459c4f8c-e60d-4487-8111-2429a39f4887 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:04.941378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-459c4f8c-e60d-4487-8111-2429a39f4887 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091083 Sep 05 17:11:04.941949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 527/1038] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:04 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:05.377072 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a4a4b35a-7e5f-4ec4-94c2-2122b21b5165 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:05.379469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a4a4b35a-7e5f-4ec4-94c2-2122b21b5165 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:05.388035 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4a4b35a-7e5f-4ec4-94c2-2122b21b5165 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:05.388712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4a4b35a-7e5f-4ec4-94c2-2122b21b5165 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:05.389277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4a4b35a-7e5f-4ec4-94c2-2122b21b5165 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:05.390175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4a4b35a-7e5f-4ec4-94c2-2122b21b5165 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:05.390834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4a4b35a-7e5f-4ec4-94c2-2122b21b5165 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:05.391300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4a4b35a-7e5f-4ec4-94c2-2122b21b5165 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:05.423735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a4a4b35a-7e5f-4ec4-94c2-2122b21b5165 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051762 Sep 05 17:11:05.424326 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 512/1039] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:05 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:05.522090 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c5fccf16-4f0b-44f1-8e85-ad32b937cb98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:05.525623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c5fccf16-4f0b-44f1-8e85-ad32b937cb98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:05.532840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5fccf16-4f0b-44f1-8e85-ad32b937cb98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:05.533320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5fccf16-4f0b-44f1-8e85-ad32b937cb98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:05.533748 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5fccf16-4f0b-44f1-8e85-ad32b937cb98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:05.534468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5fccf16-4f0b-44f1-8e85-ad32b937cb98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:05.534902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5fccf16-4f0b-44f1-8e85-ad32b937cb98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:05.535339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5fccf16-4f0b-44f1-8e85-ad32b937cb98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:05.566356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c5fccf16-4f0b-44f1-8e85-ad32b937cb98 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051115 Sep 05 17:11:05.566948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 528/1040] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:05 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:05.968452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d65232cc-0d9a-40b7-b9cb-71a75434a488 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:05.969288 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d65232cc-0d9a-40b7-b9cb-71a75434a488 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:05.979038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d65232cc-0d9a-40b7-b9cb-71a75434a488 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:05.979677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d65232cc-0d9a-40b7-b9cb-71a75434a488 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:05.980302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d65232cc-0d9a-40b7-b9cb-71a75434a488 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:05.981165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d65232cc-0d9a-40b7-b9cb-71a75434a488 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:05.981840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d65232cc-0d9a-40b7-b9cb-71a75434a488 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:05.982451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d65232cc-0d9a-40b7-b9cb-71a75434a488 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:06.061205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d65232cc-0d9a-40b7-b9cb-71a75434a488 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:06.070237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d65232cc-0d9a-40b7-b9cb-71a75434a488 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.108266 Sep 05 17:11:06.071004 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 513/1041] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:05 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:06.440093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e997e7ad-199d-4381-ac6a-2ce31fcf893b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:06.443374 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e997e7ad-199d-4381-ac6a-2ce31fcf893b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:06.452713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e997e7ad-199d-4381-ac6a-2ce31fcf893b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:06.453170 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e997e7ad-199d-4381-ac6a-2ce31fcf893b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:06.453622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e997e7ad-199d-4381-ac6a-2ce31fcf893b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:06.454314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e997e7ad-199d-4381-ac6a-2ce31fcf893b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:06.454763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e997e7ad-199d-4381-ac6a-2ce31fcf893b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:06.455181 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e997e7ad-199d-4381-ac6a-2ce31fcf893b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:06.484619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e997e7ad-199d-4381-ac6a-2ce31fcf893b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050786 Sep 05 17:11:06.485170 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 529/1042] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:06 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:06.581174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-93028884-d8a4-49ae-923c-00144c4610d2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:06.583438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-93028884-d8a4-49ae-923c-00144c4610d2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:06.590033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-93028884-d8a4-49ae-923c-00144c4610d2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:06.590709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-93028884-d8a4-49ae-923c-00144c4610d2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:06.591176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-93028884-d8a4-49ae-923c-00144c4610d2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:06.591859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-93028884-d8a4-49ae-923c-00144c4610d2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:06.592360 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-93028884-d8a4-49ae-923c-00144c4610d2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:06.592775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-93028884-d8a4-49ae-923c-00144c4610d2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:06.624224 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-93028884-d8a4-49ae-923c-00144c4610d2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047301 Sep 05 17:11:06.624981 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 514/1043] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:06 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:07.098883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bf6b0a48-e2fe-478f-991b-dc65950b2743 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:07.099814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bf6b0a48-e2fe-478f-991b-dc65950b2743 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:07.108907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf6b0a48-e2fe-478f-991b-dc65950b2743 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:07.109395 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf6b0a48-e2fe-478f-991b-dc65950b2743 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:07.109828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf6b0a48-e2fe-478f-991b-dc65950b2743 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:07.110514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf6b0a48-e2fe-478f-991b-dc65950b2743 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:07.110965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf6b0a48-e2fe-478f-991b-dc65950b2743 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:07.111385 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf6b0a48-e2fe-478f-991b-dc65950b2743 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:07.173141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bf6b0a48-e2fe-478f-991b-dc65950b2743 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:07.181340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bf6b0a48-e2fe-478f-991b-dc65950b2743 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.088484 Sep 05 17:11:07.181903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 530/1044] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:07 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:07.498249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0d6e7e22-9883-43af-8a21-42491d734e6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:07.500662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0d6e7e22-9883-43af-8a21-42491d734e6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:07.507807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d6e7e22-9883-43af-8a21-42491d734e6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:07.508383 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d6e7e22-9883-43af-8a21-42491d734e6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:07.508858 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d6e7e22-9883-43af-8a21-42491d734e6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:07.509613 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d6e7e22-9883-43af-8a21-42491d734e6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:07.510110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d6e7e22-9883-43af-8a21-42491d734e6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:07.510574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d6e7e22-9883-43af-8a21-42491d734e6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:07.542398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0d6e7e22-9883-43af-8a21-42491d734e6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048675 Sep 05 17:11:07.542958 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 515/1045] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:07 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:07.637734 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-54476340-cc27-49b3-9d70-a88ee0b4f276 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:07.639809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-54476340-cc27-49b3-9d70-a88ee0b4f276 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:07.646692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54476340-cc27-49b3-9d70-a88ee0b4f276 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:07.647165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54476340-cc27-49b3-9d70-a88ee0b4f276 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:07.647591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54476340-cc27-49b3-9d70-a88ee0b4f276 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:07.648302 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54476340-cc27-49b3-9d70-a88ee0b4f276 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:07.648747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54476340-cc27-49b3-9d70-a88ee0b4f276 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:07.649156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54476340-cc27-49b3-9d70-a88ee0b4f276 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:07.673405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:11:07.680041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-54476340-cc27-49b3-9d70-a88ee0b4f276 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046756 Sep 05 17:11:07.680627 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 531/1046] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:07 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:08.208218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e8820a34-81fd-4d29-b6df-56aa3d8785b4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:08.209258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e8820a34-81fd-4d29-b6df-56aa3d8785b4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:08.218488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8820a34-81fd-4d29-b6df-56aa3d8785b4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:08.218970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8820a34-81fd-4d29-b6df-56aa3d8785b4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:08.219398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8820a34-81fd-4d29-b6df-56aa3d8785b4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:08.220079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8820a34-81fd-4d29-b6df-56aa3d8785b4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:08.220571 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8820a34-81fd-4d29-b6df-56aa3d8785b4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:08.221010 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8820a34-81fd-4d29-b6df-56aa3d8785b4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:08.291381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e8820a34-81fd-4d29-b6df-56aa3d8785b4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:08.299524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e8820a34-81fd-4d29-b6df-56aa3d8785b4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.097817 Sep 05 17:11:08.300088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 516/1047] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:08 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:08.560219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d6b33604-b0e0-450e-b867-0311b140b199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:08.563679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d6b33604-b0e0-450e-b867-0311b140b199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:08.573763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6b33604-b0e0-450e-b867-0311b140b199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:08.574554 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6b33604-b0e0-450e-b867-0311b140b199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:08.575417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6b33604-b0e0-450e-b867-0311b140b199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:08.576103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6b33604-b0e0-450e-b867-0311b140b199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:08.576586 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6b33604-b0e0-450e-b867-0311b140b199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:08.577002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6b33604-b0e0-450e-b867-0311b140b199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:08.606691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d6b33604-b0e0-450e-b867-0311b140b199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053804 Sep 05 17:11:08.607384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 532/1048] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:08 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:08.697658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5ae9bec8-a1de-411c-892d-29c5de5961f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:08.700773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5ae9bec8-a1de-411c-892d-29c5de5961f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:08.707522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ae9bec8-a1de-411c-892d-29c5de5961f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:08.708034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ae9bec8-a1de-411c-892d-29c5de5961f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:08.708519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ae9bec8-a1de-411c-892d-29c5de5961f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:08.709239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ae9bec8-a1de-411c-892d-29c5de5961f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:08.709711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ae9bec8-a1de-411c-892d-29c5de5961f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:08.710147 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ae9bec8-a1de-411c-892d-29c5de5961f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:08.713958 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:11:08.741046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5ae9bec8-a1de-411c-892d-29c5de5961f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050414 Sep 05 17:11:08.741603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 517/1049] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:08 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:09.326164 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-45ced429-5ea9-4b86-b534-f6b1278e07fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:09.326874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-45ced429-5ea9-4b86-b534-f6b1278e07fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:09.334432 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45ced429-5ea9-4b86-b534-f6b1278e07fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:09.334960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45ced429-5ea9-4b86-b534-f6b1278e07fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:09.335432 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45ced429-5ea9-4b86-b534-f6b1278e07fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:09.336187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45ced429-5ea9-4b86-b534-f6b1278e07fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:09.336717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45ced429-5ea9-4b86-b534-f6b1278e07fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:09.337175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45ced429-5ea9-4b86-b534-f6b1278e07fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:09.400185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-45ced429-5ea9-4b86-b534-f6b1278e07fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:09.408174 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-45ced429-5ea9-4b86-b534-f6b1278e07fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.088352 Sep 05 17:11:09.408757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 533/1050] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:09 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:09.624334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-24b0e08a-383a-4660-bf9f-621a4dca2245 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:09.626386 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-24b0e08a-383a-4660-bf9f-621a4dca2245 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:09.633260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-24b0e08a-383a-4660-bf9f-621a4dca2245 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:09.633742 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-24b0e08a-383a-4660-bf9f-621a4dca2245 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:09.634169 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-24b0e08a-383a-4660-bf9f-621a4dca2245 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:09.634850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-24b0e08a-383a-4660-bf9f-621a4dca2245 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:09.635300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-24b0e08a-383a-4660-bf9f-621a4dca2245 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:09.635715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-24b0e08a-383a-4660-bf9f-621a4dca2245 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:09.666025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-24b0e08a-383a-4660-bf9f-621a4dca2245 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048673 Sep 05 17:11:09.666588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 518/1051] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:09 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:09.758088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-85496e2e-88b9-4e61-bf9a-e4af4b0cbce6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:09.761681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-85496e2e-88b9-4e61-bf9a-e4af4b0cbce6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:09.772020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85496e2e-88b9-4e61-bf9a-e4af4b0cbce6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:09.772864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85496e2e-88b9-4e61-bf9a-e4af4b0cbce6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:09.773573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85496e2e-88b9-4e61-bf9a-e4af4b0cbce6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:09.774706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85496e2e-88b9-4e61-bf9a-e4af4b0cbce6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:09.775452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85496e2e-88b9-4e61-bf9a-e4af4b0cbce6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:09.776134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85496e2e-88b9-4e61-bf9a-e4af4b0cbce6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:09.807743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-85496e2e-88b9-4e61-bf9a-e4af4b0cbce6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056449 Sep 05 17:11:09.808555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 534/1052] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:09 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:10.430724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3c6d49ae-ae0a-413f-81bb-0263fa68778f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:10.431311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3c6d49ae-ae0a-413f-81bb-0263fa68778f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:10.437440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c6d49ae-ae0a-413f-81bb-0263fa68778f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:10.437913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c6d49ae-ae0a-413f-81bb-0263fa68778f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:10.438403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c6d49ae-ae0a-413f-81bb-0263fa68778f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:10.439078 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c6d49ae-ae0a-413f-81bb-0263fa68778f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:10.439522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c6d49ae-ae0a-413f-81bb-0263fa68778f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:10.439955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c6d49ae-ae0a-413f-81bb-0263fa68778f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:10.504460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3c6d49ae-ae0a-413f-81bb-0263fa68778f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:10.516435 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3c6d49ae-ae0a-413f-81bb-0263fa68778f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089450 Sep 05 17:11:10.517129 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 519/1053] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:10 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:10.683171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5ca41583-afd3-486c-9ab3-9af565afd984 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:10.686612 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5ca41583-afd3-486c-9ab3-9af565afd984 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:10.698107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ca41583-afd3-486c-9ab3-9af565afd984 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:10.698895 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ca41583-afd3-486c-9ab3-9af565afd984 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:10.699609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ca41583-afd3-486c-9ab3-9af565afd984 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:10.700782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ca41583-afd3-486c-9ab3-9af565afd984 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:10.701528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ca41583-afd3-486c-9ab3-9af565afd984 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:10.702210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ca41583-afd3-486c-9ab3-9af565afd984 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:10.734471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5ca41583-afd3-486c-9ab3-9af565afd984 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058155 Sep 05 17:11:10.735027 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 535/1054] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:10 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:10.825971 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f8027fcd-df51-4228-ba55-a27119cde8e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:10.829376 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f8027fcd-df51-4228-ba55-a27119cde8e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:10.836109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8027fcd-df51-4228-ba55-a27119cde8e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:10.836622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8027fcd-df51-4228-ba55-a27119cde8e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:10.837048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8027fcd-df51-4228-ba55-a27119cde8e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:10.837739 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8027fcd-df51-4228-ba55-a27119cde8e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:10.838200 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8027fcd-df51-4228-ba55-a27119cde8e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:10.838611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8027fcd-df51-4228-ba55-a27119cde8e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:10.873731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f8027fcd-df51-4228-ba55-a27119cde8e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054102 Sep 05 17:11:10.874602 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 520/1055] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:10 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:11.548702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3fbf2c02-31db-4024-9c96-fe244f1b7361 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:11.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3fbf2c02-31db-4024-9c96-fe244f1b7361 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:11.556641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fbf2c02-31db-4024-9c96-fe244f1b7361 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:11.557179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fbf2c02-31db-4024-9c96-fe244f1b7361 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:11.557654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fbf2c02-31db-4024-9c96-fe244f1b7361 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:11.558422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fbf2c02-31db-4024-9c96-fe244f1b7361 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:11.558921 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fbf2c02-31db-4024-9c96-fe244f1b7361 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:11.559386 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fbf2c02-31db-4024-9c96-fe244f1b7361 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:11.630511 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3fbf2c02-31db-4024-9c96-fe244f1b7361 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:11.640857 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3fbf2c02-31db-4024-9c96-fe244f1b7361 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098760 Sep 05 17:11:11.641507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 536/1056] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:11 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:11.752192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0c373877-179f-4c14-a35c-a9b9ea309ad3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:11.755632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0c373877-179f-4c14-a35c-a9b9ea309ad3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:11.766382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c373877-179f-4c14-a35c-a9b9ea309ad3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:11.767019 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c373877-179f-4c14-a35c-a9b9ea309ad3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:11.767451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c373877-179f-4c14-a35c-a9b9ea309ad3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:11.768138 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c373877-179f-4c14-a35c-a9b9ea309ad3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:11.768626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c373877-179f-4c14-a35c-a9b9ea309ad3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:11.769051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c373877-179f-4c14-a35c-a9b9ea309ad3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:11.799553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0c373877-179f-4c14-a35c-a9b9ea309ad3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054538 Sep 05 17:11:11.800106 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 521/1057] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:11 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:11.895689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-04111b4c-ed32-4d9e-b142-fd69b12ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:11.899088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-04111b4c-ed32-4d9e-b142-fd69b12ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:11.909577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04111b4c-ed32-4d9e-b142-fd69b12ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:11.910066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04111b4c-ed32-4d9e-b142-fd69b12ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:11.910500 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04111b4c-ed32-4d9e-b142-fd69b12ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:11.911193 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04111b4c-ed32-4d9e-b142-fd69b12ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:11.911644 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04111b4c-ed32-4d9e-b142-fd69b12ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:11.912063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04111b4c-ed32-4d9e-b142-fd69b12ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:11.942939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-04111b4c-ed32-4d9e-b142-fd69b12ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054849 Sep 05 17:11:11.943485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 537/1058] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:11 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:12.665002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cc51a8ef-5985-4ceb-9e6e-451b3994dd84 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:12.665657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cc51a8ef-5985-4ceb-9e6e-451b3994dd84 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:12.674161 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc51a8ef-5985-4ceb-9e6e-451b3994dd84 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:12.674760 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc51a8ef-5985-4ceb-9e6e-451b3994dd84 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:12.675290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc51a8ef-5985-4ceb-9e6e-451b3994dd84 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:12.676142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc51a8ef-5985-4ceb-9e6e-451b3994dd84 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:12.676741 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc51a8ef-5985-4ceb-9e6e-451b3994dd84 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:12.677264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc51a8ef-5985-4ceb-9e6e-451b3994dd84 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:12.745082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cc51a8ef-5985-4ceb-9e6e-451b3994dd84 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:12.753293 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cc51a8ef-5985-4ceb-9e6e-451b3994dd84 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093275 Sep 05 17:11:12.753857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 522/1059] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:12 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:12.815791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d9e75d04-c015-4038-a5ac-5f8c0d764d97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:12.818689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d9e75d04-c015-4038-a5ac-5f8c0d764d97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:12.826540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9e75d04-c015-4038-a5ac-5f8c0d764d97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:12.827142 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9e75d04-c015-4038-a5ac-5f8c0d764d97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:12.827643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9e75d04-c015-4038-a5ac-5f8c0d764d97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:12.828594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9e75d04-c015-4038-a5ac-5f8c0d764d97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:12.829274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9e75d04-c015-4038-a5ac-5f8c0d764d97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:12.829865 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9e75d04-c015-4038-a5ac-5f8c0d764d97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:12.863205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d9e75d04-c015-4038-a5ac-5f8c0d764d97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053536 Sep 05 17:11:12.863750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 538/1060] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:12 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:12.959711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e0919441-4483-44a4-872f-ac8429b819da tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:12.963122 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e0919441-4483-44a4-872f-ac8429b819da tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:12.973089 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e0919441-4483-44a4-872f-ac8429b819da tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:12.973887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e0919441-4483-44a4-872f-ac8429b819da tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:12.974609 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e0919441-4483-44a4-872f-ac8429b819da tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:12.976115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e0919441-4483-44a4-872f-ac8429b819da tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:12.976921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e0919441-4483-44a4-872f-ac8429b819da tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:12.977612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e0919441-4483-44a4-872f-ac8429b819da tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:13.010249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e0919441-4483-44a4-872f-ac8429b819da tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057723 Sep 05 17:11:13.010790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 523/1061] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:12 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:13.779309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-90992539-79a6-40bb-b9e4-19c19c8af4bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:13.780236 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-90992539-79a6-40bb-b9e4-19c19c8af4bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:13.791757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90992539-79a6-40bb-b9e4-19c19c8af4bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:13.792624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90992539-79a6-40bb-b9e4-19c19c8af4bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:13.793353 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90992539-79a6-40bb-b9e4-19c19c8af4bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:13.794494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90992539-79a6-40bb-b9e4-19c19c8af4bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:13.795251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90992539-79a6-40bb-b9e4-19c19c8af4bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:13.795958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90992539-79a6-40bb-b9e4-19c19c8af4bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:13.866091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-90992539-79a6-40bb-b9e4-19c19c8af4bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:13.874920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-90992539-79a6-40bb-b9e4-19c19c8af4bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.102352 Sep 05 17:11:13.875123 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-161cf949-327f-4d7f-a0e0-9d5a138c2bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:13.875561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 539/1062] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:13 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:13.877637 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-161cf949-327f-4d7f-a0e0-9d5a138c2bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:13.884523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-161cf949-327f-4d7f-a0e0-9d5a138c2bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:13.885001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-161cf949-327f-4d7f-a0e0-9d5a138c2bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:13.885431 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-161cf949-327f-4d7f-a0e0-9d5a138c2bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:13.886124 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-161cf949-327f-4d7f-a0e0-9d5a138c2bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:13.886573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-161cf949-327f-4d7f-a0e0-9d5a138c2bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:13.886989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-161cf949-327f-4d7f-a0e0-9d5a138c2bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:13.916459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-161cf949-327f-4d7f-a0e0-9d5a138c2bc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045356 Sep 05 17:11:13.917011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 524/1063] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:13 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:14.028040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5832dd8f-e650-4661-b043-f509fce9d2de tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:14.031700 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5832dd8f-e650-4661-b043-f509fce9d2de tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:14.038312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5832dd8f-e650-4661-b043-f509fce9d2de tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:14.038787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5832dd8f-e650-4661-b043-f509fce9d2de tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:14.039215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5832dd8f-e650-4661-b043-f509fce9d2de tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:14.039920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5832dd8f-e650-4661-b043-f509fce9d2de tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:14.040404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5832dd8f-e650-4661-b043-f509fce9d2de tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:14.040819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5832dd8f-e650-4661-b043-f509fce9d2de tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:14.070907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5832dd8f-e650-4661-b043-f509fce9d2de tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049574 Sep 05 17:11:14.071509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 540/1064] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:14 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:14.903007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-14c8bfce-80ed-457f-b73a-ad94d957dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:14.903930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-14c8bfce-80ed-457f-b73a-ad94d957dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:14.912000 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-14c8bfce-80ed-457f-b73a-ad94d957dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:14.912486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-14c8bfce-80ed-457f-b73a-ad94d957dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:14.912914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-14c8bfce-80ed-457f-b73a-ad94d957dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:14.913598 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-14c8bfce-80ed-457f-b73a-ad94d957dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:14.914045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-14c8bfce-80ed-457f-b73a-ad94d957dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:14.914457 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-14c8bfce-80ed-457f-b73a-ad94d957dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:14.929231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6239504b-1585-4783-b975-e2a168a4df12 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:14.931407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6239504b-1585-4783-b975-e2a168a4df12 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:14.938680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6239504b-1585-4783-b975-e2a168a4df12 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:14.939167 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6239504b-1585-4783-b975-e2a168a4df12 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:14.939595 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6239504b-1585-4783-b975-e2a168a4df12 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:14.940318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6239504b-1585-4783-b975-e2a168a4df12 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:14.940764 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6239504b-1585-4783-b975-e2a168a4df12 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:14.941306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6239504b-1585-4783-b975-e2a168a4df12 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:14.971260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6239504b-1585-4783-b975-e2a168a4df12 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046032 Sep 05 17:11:14.971828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 541/1065] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:14 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:14.980180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-14c8bfce-80ed-457f-b73a-ad94d957dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:14.988916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-14c8bfce-80ed-457f-b73a-ad94d957dc05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092439 Sep 05 17:11:14.989480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 525/1066] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:14 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:15.089737 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-181990bf-e8bd-46b2-bda5-4caf751dda35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:15.093121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-181990bf-e8bd-46b2-bda5-4caf751dda35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:15.100371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-181990bf-e8bd-46b2-bda5-4caf751dda35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:15.100857 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-181990bf-e8bd-46b2-bda5-4caf751dda35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:15.101286 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-181990bf-e8bd-46b2-bda5-4caf751dda35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:15.101982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-181990bf-e8bd-46b2-bda5-4caf751dda35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:15.102433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-181990bf-e8bd-46b2-bda5-4caf751dda35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:15.102851 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-181990bf-e8bd-46b2-bda5-4caf751dda35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:15.132962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-181990bf-e8bd-46b2-bda5-4caf751dda35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049809 Sep 05 17:11:15.133515 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 542/1067] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:15 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:15.988263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9518500a-0502-4502-b7f7-1fc2dca255a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:15.991037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9518500a-0502-4502-b7f7-1fc2dca255a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:15.999912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9518500a-0502-4502-b7f7-1fc2dca255a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:16.000689 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9518500a-0502-4502-b7f7-1fc2dca255a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:16.001600 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9518500a-0502-4502-b7f7-1fc2dca255a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:16.002534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9518500a-0502-4502-b7f7-1fc2dca255a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:16.003155 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9518500a-0502-4502-b7f7-1fc2dca255a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:16.003706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9518500a-0502-4502-b7f7-1fc2dca255a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:16.014332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1e4d4286-bc62-4386-b472-1803779da3f3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:16.015210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1e4d4286-bc62-4386-b472-1803779da3f3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:16.022364 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e4d4286-bc62-4386-b472-1803779da3f3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:16.022854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e4d4286-bc62-4386-b472-1803779da3f3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:16.023285 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e4d4286-bc62-4386-b472-1803779da3f3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:16.023983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e4d4286-bc62-4386-b472-1803779da3f3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:16.024490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e4d4286-bc62-4386-b472-1803779da3f3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:16.025419 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e4d4286-bc62-4386-b472-1803779da3f3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:16.037637 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9518500a-0502-4502-b7f7-1fc2dca255a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055742 Sep 05 17:11:16.038211 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 526/1068] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:15 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:16.100547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1e4d4286-bc62-4386-b472-1803779da3f3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:16.109132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1e4d4286-bc62-4386-b472-1803779da3f3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.100036 Sep 05 17:11:16.109687 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 543/1069] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:16 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:16.145194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3072bc1b-6cf7-4196-8a3e-629a1a048cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:16.147353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3072bc1b-6cf7-4196-8a3e-629a1a048cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:16.149353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:11:16.149520 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:11:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments (ip 10.222.0.23) !!! Sep 05 17:11:16.155538 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3072bc1b-6cf7-4196-8a3e-629a1a048cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:16.156012 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3072bc1b-6cf7-4196-8a3e-629a1a048cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:16.156467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3072bc1b-6cf7-4196-8a3e-629a1a048cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:16.157184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3072bc1b-6cf7-4196-8a3e-629a1a048cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:16.157671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3072bc1b-6cf7-4196-8a3e-629a1a048cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:16.158084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3072bc1b-6cf7-4196-8a3e-629a1a048cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:16.189134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3072bc1b-6cf7-4196-8a3e-629a1a048cd7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048258 Sep 05 17:11:16.189708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 527/1070] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:16 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:17.132871 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e6a15dad-dbe4-41cb-bdc0-c4513ead6e1c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:17.133448 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e6a15dad-dbe4-41cb-bdc0-c4513ead6e1c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:17.139996 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6a15dad-dbe4-41cb-bdc0-c4513ead6e1c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:17.140506 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6a15dad-dbe4-41cb-bdc0-c4513ead6e1c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:17.140934 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6a15dad-dbe4-41cb-bdc0-c4513ead6e1c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:17.141961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6a15dad-dbe4-41cb-bdc0-c4513ead6e1c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:17.142156 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6a15dad-dbe4-41cb-bdc0-c4513ead6e1c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:17.142571 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6a15dad-dbe4-41cb-bdc0-c4513ead6e1c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:17.149094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a8e16f3a-329c-4b4f-8e61-43ac8120ac84 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:17.151247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a8e16f3a-329c-4b4f-8e61-43ac8120ac84 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:17.157295 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e16f3a-329c-4b4f-8e61-43ac8120ac84 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:17.157775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e16f3a-329c-4b4f-8e61-43ac8120ac84 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:17.158203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e16f3a-329c-4b4f-8e61-43ac8120ac84 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:17.158887 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e16f3a-329c-4b4f-8e61-43ac8120ac84 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:17.159342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e16f3a-329c-4b4f-8e61-43ac8120ac84 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:17.159758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e16f3a-329c-4b4f-8e61-43ac8120ac84 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:17.189003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a8e16f3a-329c-4b4f-8e61-43ac8120ac84 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142339 Sep 05 17:11:17.189595 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 544/1071] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:17 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:17.201718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bd51bcf3-b965-4e70-a685-dbbba022c9a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:17.203927 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bd51bcf3-b965-4e70-a685-dbbba022c9a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:17.205680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e6a15dad-dbe4-41cb-bdc0-c4513ead6e1c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:17.210071 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd51bcf3-b965-4e70-a685-dbbba022c9a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:17.210550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd51bcf3-b965-4e70-a685-dbbba022c9a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:17.210971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd51bcf3-b965-4e70-a685-dbbba022c9a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:17.211664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd51bcf3-b965-4e70-a685-dbbba022c9a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:17.212140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd51bcf3-b965-4e70-a685-dbbba022c9a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:17.212588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd51bcf3-b965-4e70-a685-dbbba022c9a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:17.213863 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e6a15dad-dbe4-41cb-bdc0-c4513ead6e1c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.084850 Sep 05 17:11:17.214619 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 528/1072] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:17 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:17.242468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bd51bcf3-b965-4e70-a685-dbbba022c9a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044513 Sep 05 17:11:17.243008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 545/1073] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:17 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 17:11:18.204384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-11050ee4-eb41-4be6-92ff-922def3fe266 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:18.206593 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-11050ee4-eb41-4be6-92ff-922def3fe266 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:18.213822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11050ee4-eb41-4be6-92ff-922def3fe266 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:18.214302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11050ee4-eb41-4be6-92ff-922def3fe266 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:18.214730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11050ee4-eb41-4be6-92ff-922def3fe266 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:18.215421 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11050ee4-eb41-4be6-92ff-922def3fe266 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:18.215867 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11050ee4-eb41-4be6-92ff-922def3fe266 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:18.216315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11050ee4-eb41-4be6-92ff-922def3fe266 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:18.237717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-98f1db4f-5a21-4f9e-96d8-6f0f35f1fa74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:18.238303 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-98f1db4f-5a21-4f9e-96d8-6f0f35f1fa74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:18.245115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98f1db4f-5a21-4f9e-96d8-6f0f35f1fa74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:18.245602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98f1db4f-5a21-4f9e-96d8-6f0f35f1fa74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:18.246033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98f1db4f-5a21-4f9e-96d8-6f0f35f1fa74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:18.246736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98f1db4f-5a21-4f9e-96d8-6f0f35f1fa74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:18.247191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98f1db4f-5a21-4f9e-96d8-6f0f35f1fa74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:18.247614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98f1db4f-5a21-4f9e-96d8-6f0f35f1fa74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:18.247761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-11050ee4-eb41-4be6-92ff-922def3fe266 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047908 Sep 05 17:11:18.249820 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 529/1074] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:18 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:18.256605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-64743e3d-ed75-489d-866f-572d8290d5d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:18.258707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-64743e3d-ed75-489d-866f-572d8290d5d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:18.264978 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64743e3d-ed75-489d-866f-572d8290d5d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:18.265462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64743e3d-ed75-489d-866f-572d8290d5d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:18.265890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64743e3d-ed75-489d-866f-572d8290d5d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:18.266683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64743e3d-ed75-489d-866f-572d8290d5d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:18.267150 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64743e3d-ed75-489d-866f-572d8290d5d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:18.267542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64743e3d-ed75-489d-866f-572d8290d5d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:18.298730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-64743e3d-ed75-489d-866f-572d8290d5d1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045589 Sep 05 17:11:18.299338 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 530/1075] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:18 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:18.310667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-98f1db4f-5a21-4f9e-96d8-6f0f35f1fa74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:18.319289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-98f1db4f-5a21-4f9e-96d8-6f0f35f1fa74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086075 Sep 05 17:11:18.319896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 546/1076] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:18 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:19.265531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0ca80065-3087-45c7-8ee2-4f95c80f521f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:19.269101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0ca80065-3087-45c7-8ee2-4f95c80f521f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:19.279792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ca80065-3087-45c7-8ee2-4f95c80f521f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:19.280669 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ca80065-3087-45c7-8ee2-4f95c80f521f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:19.281382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ca80065-3087-45c7-8ee2-4f95c80f521f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:19.282501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ca80065-3087-45c7-8ee2-4f95c80f521f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:19.283462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ca80065-3087-45c7-8ee2-4f95c80f521f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:19.284014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ca80065-3087-45c7-8ee2-4f95c80f521f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:19.311380 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9e70814b-4299-4ed7-8f48-4ba2ead8679d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:19.313603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9e70814b-4299-4ed7-8f48-4ba2ead8679d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:19.314293 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0ca80065-3087-45c7-8ee2-4f95c80f521f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055442 Sep 05 17:11:19.319149 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 531/1077] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:19 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:19.320087 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e70814b-4299-4ed7-8f48-4ba2ead8679d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:19.320607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e70814b-4299-4ed7-8f48-4ba2ead8679d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:19.321042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e70814b-4299-4ed7-8f48-4ba2ead8679d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:19.321747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e70814b-4299-4ed7-8f48-4ba2ead8679d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:19.322227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e70814b-4299-4ed7-8f48-4ba2ead8679d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:19.322646 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e70814b-4299-4ed7-8f48-4ba2ead8679d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:19.342187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2909ecf0-a7c2-4112-b8df-9ce948a72394 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:19.342795 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2909ecf0-a7c2-4112-b8df-9ce948a72394 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:19.349404 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2909ecf0-a7c2-4112-b8df-9ce948a72394 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:19.350208 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2909ecf0-a7c2-4112-b8df-9ce948a72394 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:19.350671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2909ecf0-a7c2-4112-b8df-9ce948a72394 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:19.351335 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2909ecf0-a7c2-4112-b8df-9ce948a72394 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:19.351812 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2909ecf0-a7c2-4112-b8df-9ce948a72394 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:19.352265 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2909ecf0-a7c2-4112-b8df-9ce948a72394 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:19.352720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9e70814b-4299-4ed7-8f48-4ba2ead8679d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045461 Sep 05 17:11:19.353261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 547/1078] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:19 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:19.416081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2909ecf0-a7c2-4112-b8df-9ce948a72394 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:19.424260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2909ecf0-a7c2-4112-b8df-9ce948a72394 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.085866 Sep 05 17:11:19.424803 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 532/1079] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:19 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:20.331382 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-af213599-c56a-434b-a7f4-783b0efeab6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:20.334993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-af213599-c56a-434b-a7f4-783b0efeab6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:20.345907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af213599-c56a-434b-a7f4-783b0efeab6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:20.346702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af213599-c56a-434b-a7f4-783b0efeab6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:20.347389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af213599-c56a-434b-a7f4-783b0efeab6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:20.348182 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af213599-c56a-434b-a7f4-783b0efeab6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:20.348665 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af213599-c56a-434b-a7f4-783b0efeab6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:20.349093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af213599-c56a-434b-a7f4-783b0efeab6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:20.365163 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2947df1d-a13f-46f7-8957-84f4698df371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:20.365724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:11:20.367469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2947df1d-a13f-46f7-8957-84f4698df371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:20.378836 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2947df1d-a13f-46f7-8957-84f4698df371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:20.379327 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2947df1d-a13f-46f7-8957-84f4698df371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:20.379751 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2947df1d-a13f-46f7-8957-84f4698df371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:20.380466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2947df1d-a13f-46f7-8957-84f4698df371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:20.380893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2947df1d-a13f-46f7-8957-84f4698df371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:20.381309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2947df1d-a13f-46f7-8957-84f4698df371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:20.383392 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-af213599-c56a-434b-a7f4-783b0efeab6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058774 Sep 05 17:11:20.383968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 548/1080] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:20 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:20.409594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:11:20.414437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2947df1d-a13f-46f7-8957-84f4698df371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053454 Sep 05 17:11:20.414998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 533/1081] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:20 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:20.447212 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8dfeab48-0348-422f-8da6-20b5d0eba02a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:20.447821 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8dfeab48-0348-422f-8da6-20b5d0eba02a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:20.454802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8dfeab48-0348-422f-8da6-20b5d0eba02a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:20.455668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8dfeab48-0348-422f-8da6-20b5d0eba02a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:20.456697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8dfeab48-0348-422f-8da6-20b5d0eba02a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:20.457637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8dfeab48-0348-422f-8da6-20b5d0eba02a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:20.458339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8dfeab48-0348-422f-8da6-20b5d0eba02a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:20.458779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8dfeab48-0348-422f-8da6-20b5d0eba02a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:20.531753 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8dfeab48-0348-422f-8da6-20b5d0eba02a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:20.545564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8dfeab48-0348-422f-8da6-20b5d0eba02a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.102034 Sep 05 17:11:20.546205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 549/1082] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:20 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:21.398150 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e3f98d98-05f8-4cfa-a71f-e7d53c44bcca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:21.400326 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e3f98d98-05f8-4cfa-a71f-e7d53c44bcca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:21.407619 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f98d98-05f8-4cfa-a71f-e7d53c44bcca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:21.408099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f98d98-05f8-4cfa-a71f-e7d53c44bcca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:21.408568 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f98d98-05f8-4cfa-a71f-e7d53c44bcca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:21.409252 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f98d98-05f8-4cfa-a71f-e7d53c44bcca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:21.410217 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f98d98-05f8-4cfa-a71f-e7d53c44bcca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:21.410641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f98d98-05f8-4cfa-a71f-e7d53c44bcca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:21.427559 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c548988b-2030-4c16-b766-e5b6d569058b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:21.429717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c548988b-2030-4c16-b766-e5b6d569058b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:21.436438 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c548988b-2030-4c16-b766-e5b6d569058b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:21.436915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c548988b-2030-4c16-b766-e5b6d569058b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:21.437340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c548988b-2030-4c16-b766-e5b6d569058b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:21.438025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c548988b-2030-4c16-b766-e5b6d569058b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:21.438466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c548988b-2030-4c16-b766-e5b6d569058b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:21.438879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c548988b-2030-4c16-b766-e5b6d569058b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:21.440281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e3f98d98-05f8-4cfa-a71f-e7d53c44bcca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047403 Sep 05 17:11:21.441419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 534/1083] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:21 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:21.469245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c548988b-2030-4c16-b766-e5b6d569058b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045783 Sep 05 17:11:21.469770 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 550/1084] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:21 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:21.570308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3203eda8-6da5-4c94-8aed-9d69dd9d6e9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:21.570914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3203eda8-6da5-4c94-8aed-9d69dd9d6e9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:21.577734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3203eda8-6da5-4c94-8aed-9d69dd9d6e9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:21.578210 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3203eda8-6da5-4c94-8aed-9d69dd9d6e9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:21.578630 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3203eda8-6da5-4c94-8aed-9d69dd9d6e9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:21.579308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3203eda8-6da5-4c94-8aed-9d69dd9d6e9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:21.579752 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3203eda8-6da5-4c94-8aed-9d69dd9d6e9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:21.580183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3203eda8-6da5-4c94-8aed-9d69dd9d6e9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:21.646861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3203eda8-6da5-4c94-8aed-9d69dd9d6e9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:21.654701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3203eda8-6da5-4c94-8aed-9d69dd9d6e9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.088501 Sep 05 17:11:21.655259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 535/1085] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:21 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:22.457452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fe99562b-8faf-4908-8b73-de1ec5bcea4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:22.460924 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fe99562b-8faf-4908-8b73-de1ec5bcea4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:22.473428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe99562b-8faf-4908-8b73-de1ec5bcea4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:22.474305 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe99562b-8faf-4908-8b73-de1ec5bcea4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:22.475436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe99562b-8faf-4908-8b73-de1ec5bcea4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:22.476370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe99562b-8faf-4908-8b73-de1ec5bcea4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:22.476868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe99562b-8faf-4908-8b73-de1ec5bcea4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:22.477379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe99562b-8faf-4908-8b73-de1ec5bcea4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:22.482751 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3b2c433a-6546-4380-88a1-1efae2a155e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:22.485030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3b2c433a-6546-4380-88a1-1efae2a155e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:22.491869 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b2c433a-6546-4380-88a1-1efae2a155e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:22.492401 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b2c433a-6546-4380-88a1-1efae2a155e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:22.492832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b2c433a-6546-4380-88a1-1efae2a155e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:22.493526 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b2c433a-6546-4380-88a1-1efae2a155e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:22.493975 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b2c433a-6546-4380-88a1-1efae2a155e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:22.494400 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b2c433a-6546-4380-88a1-1efae2a155e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:22.507617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fe99562b-8faf-4908-8b73-de1ec5bcea4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056948 Sep 05 17:11:22.508472 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 551/1086] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:22 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:22.526483 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3b2c433a-6546-4380-88a1-1efae2a155e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047841 Sep 05 17:11:22.527101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 536/1087] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:22 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:22.682396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-37d22630-2e91-4ab5-92f4-806a84f7bb0a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:22.683492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-37d22630-2e91-4ab5-92f4-806a84f7bb0a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:22.693681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37d22630-2e91-4ab5-92f4-806a84f7bb0a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:22.694465 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37d22630-2e91-4ab5-92f4-806a84f7bb0a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:22.695209 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37d22630-2e91-4ab5-92f4-806a84f7bb0a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:22.696372 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37d22630-2e91-4ab5-92f4-806a84f7bb0a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:22.697115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37d22630-2e91-4ab5-92f4-806a84f7bb0a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:22.697808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37d22630-2e91-4ab5-92f4-806a84f7bb0a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:22.763377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-37d22630-2e91-4ab5-92f4-806a84f7bb0a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:22.771310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-37d22630-2e91-4ab5-92f4-806a84f7bb0a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095813 Sep 05 17:11:22.771876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 552/1088] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:22 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:23.520739 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-43ff3125-9c60-4ad9-95d9-9f51d8db0978 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:23.522805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-43ff3125-9c60-4ad9-95d9-9f51d8db0978 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:23.529856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43ff3125-9c60-4ad9-95d9-9f51d8db0978 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:23.530333 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43ff3125-9c60-4ad9-95d9-9f51d8db0978 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:23.530755 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43ff3125-9c60-4ad9-95d9-9f51d8db0978 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:23.531436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43ff3125-9c60-4ad9-95d9-9f51d8db0978 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:23.531877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43ff3125-9c60-4ad9-95d9-9f51d8db0978 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:23.532325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43ff3125-9c60-4ad9-95d9-9f51d8db0978 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:23.539331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f093f1d3-3041-4262-8cbb-801dc2ededf9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:23.541511 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f093f1d3-3041-4262-8cbb-801dc2ededf9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:23.548555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f093f1d3-3041-4262-8cbb-801dc2ededf9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:23.549043 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f093f1d3-3041-4262-8cbb-801dc2ededf9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:23.549507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f093f1d3-3041-4262-8cbb-801dc2ededf9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:23.550323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f093f1d3-3041-4262-8cbb-801dc2ededf9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:23.550765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f093f1d3-3041-4262-8cbb-801dc2ededf9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:23.551199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f093f1d3-3041-4262-8cbb-801dc2ededf9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:23.563823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-43ff3125-9c60-4ad9-95d9-9f51d8db0978 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047505 Sep 05 17:11:23.564431 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 537/1089] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:23 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:23.581584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f093f1d3-3041-4262-8cbb-801dc2ededf9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046364 Sep 05 17:11:23.582284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 553/1090] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:23 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:23.798470 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b101022b-85e5-47db-9b52-2bb9309c6664 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:23.799369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b101022b-85e5-47db-9b52-2bb9309c6664 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:23.809917 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b101022b-85e5-47db-9b52-2bb9309c6664 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:23.810727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b101022b-85e5-47db-9b52-2bb9309c6664 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:23.811444 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b101022b-85e5-47db-9b52-2bb9309c6664 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:23.812659 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b101022b-85e5-47db-9b52-2bb9309c6664 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:23.813416 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b101022b-85e5-47db-9b52-2bb9309c6664 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:23.814117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b101022b-85e5-47db-9b52-2bb9309c6664 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:23.887651 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b101022b-85e5-47db-9b52-2bb9309c6664 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:23.895724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b101022b-85e5-47db-9b52-2bb9309c6664 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.104104 Sep 05 17:11:23.896329 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 538/1091] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:23 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:24.581064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2a445f5c-80e9-41aa-9bf0-26ce6b5f7e44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:24.584570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2a445f5c-80e9-41aa-9bf0-26ce6b5f7e44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:24.595448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a445f5c-80e9-41aa-9bf0-26ce6b5f7e44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:24.596264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a445f5c-80e9-41aa-9bf0-26ce6b5f7e44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:24.597168 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a445f5c-80e9-41aa-9bf0-26ce6b5f7e44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:24.597971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a445f5c-80e9-41aa-9bf0-26ce6b5f7e44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:24.598426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a445f5c-80e9-41aa-9bf0-26ce6b5f7e44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:24.598594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-43717836-68da-46d2-8cb4-a75e140dc0e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:24.599017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a445f5c-80e9-41aa-9bf0-26ce6b5f7e44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:24.600965 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-43717836-68da-46d2-8cb4-a75e140dc0e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:24.607612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43717836-68da-46d2-8cb4-a75e140dc0e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:24.608115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43717836-68da-46d2-8cb4-a75e140dc0e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:24.608574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43717836-68da-46d2-8cb4-a75e140dc0e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:24.609257 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43717836-68da-46d2-8cb4-a75e140dc0e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:24.609700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43717836-68da-46d2-8cb4-a75e140dc0e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:24.610090 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43717836-68da-46d2-8cb4-a75e140dc0e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:24.629997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2a445f5c-80e9-41aa-9bf0-26ce6b5f7e44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055563 Sep 05 17:11:24.630487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 554/1092] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:24 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:24.643159 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-43717836-68da-46d2-8cb4-a75e140dc0e2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051353 Sep 05 17:11:24.643733 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 539/1093] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:24 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:24.922938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-05e5184c-be28-41af-a325-5c4ef8cda5a9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:24.923809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-05e5184c-be28-41af-a325-5c4ef8cda5a9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:24.930753 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05e5184c-be28-41af-a325-5c4ef8cda5a9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:24.931228 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05e5184c-be28-41af-a325-5c4ef8cda5a9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:24.931658 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05e5184c-be28-41af-a325-5c4ef8cda5a9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:24.932383 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05e5184c-be28-41af-a325-5c4ef8cda5a9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:24.932834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05e5184c-be28-41af-a325-5c4ef8cda5a9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:24.933253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05e5184c-be28-41af-a325-5c4ef8cda5a9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:25.222943 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-05e5184c-be28-41af-a325-5c4ef8cda5a9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:25.231413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-05e5184c-be28-41af-a325-5c4ef8cda5a9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.315173 Sep 05 17:11:25.231978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 555/1094] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:24 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:25.646522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-608d4e06-a8ca-4c56-bd20-e39cb926e0dd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:25.649190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-608d4e06-a8ca-4c56-bd20-e39cb926e0dd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:25.656678 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3368a6c1-e257-42a7-a772-55cd6f923d5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:25.657511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-608d4e06-a8ca-4c56-bd20-e39cb926e0dd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:25.658104 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-608d4e06-a8ca-4c56-bd20-e39cb926e0dd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:25.658635 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-608d4e06-a8ca-4c56-bd20-e39cb926e0dd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:25.659572 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-608d4e06-a8ca-4c56-bd20-e39cb926e0dd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:25.659755 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3368a6c1-e257-42a7-a772-55cd6f923d5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:25.660192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-608d4e06-a8ca-4c56-bd20-e39cb926e0dd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:25.660743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-608d4e06-a8ca-4c56-bd20-e39cb926e0dd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:25.668431 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3368a6c1-e257-42a7-a772-55cd6f923d5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:25.669031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3368a6c1-e257-42a7-a772-55cd6f923d5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:25.669569 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3368a6c1-e257-42a7-a772-55cd6f923d5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:25.670436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3368a6c1-e257-42a7-a772-55cd6f923d5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:25.671194 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3368a6c1-e257-42a7-a772-55cd6f923d5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:25.671747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3368a6c1-e257-42a7-a772-55cd6f923d5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:25.693512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-608d4e06-a8ca-4c56-bd20-e39cb926e0dd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053235 Sep 05 17:11:25.694075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 540/1095] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:25 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:25.703734 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3368a6c1-e257-42a7-a772-55cd6f923d5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052054 Sep 05 17:11:25.704329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 556/1096] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:25 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:26.260809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b1062645-1c54-4ba9-9e66-b00861a4d112 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:26.260809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b1062645-1c54-4ba9-9e66-b00861a4d112 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:26.270889 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1062645-1c54-4ba9-9e66-b00861a4d112 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:26.271679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1062645-1c54-4ba9-9e66-b00861a4d112 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:26.272440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1062645-1c54-4ba9-9e66-b00861a4d112 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:26.273549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1062645-1c54-4ba9-9e66-b00861a4d112 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:26.274293 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1062645-1c54-4ba9-9e66-b00861a4d112 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:26.274974 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1062645-1c54-4ba9-9e66-b00861a4d112 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:26.342216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b1062645-1c54-4ba9-9e66-b00861a4d112 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:26.350726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b1062645-1c54-4ba9-9e66-b00861a4d112 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098686 Sep 05 17:11:26.351286 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 541/1097] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:26 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:26.707531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-12563110-96b7-40ab-9cff-02d090818cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:26.709754 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-12563110-96b7-40ab-9cff-02d090818cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:26.716409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12563110-96b7-40ab-9cff-02d090818cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:26.716668 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b1fec050-71d7-4060-9765-fcbc00a3d062 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:26.717139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12563110-96b7-40ab-9cff-02d090818cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:26.717264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12563110-96b7-40ab-9cff-02d090818cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:26.717998 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12563110-96b7-40ab-9cff-02d090818cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:26.718450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12563110-96b7-40ab-9cff-02d090818cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:26.718871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-12563110-96b7-40ab-9cff-02d090818cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:26.719013 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b1fec050-71d7-4060-9765-fcbc00a3d062 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:26.726263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1fec050-71d7-4060-9765-fcbc00a3d062 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:26.726767 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1fec050-71d7-4060-9765-fcbc00a3d062 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:26.727190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1fec050-71d7-4060-9765-fcbc00a3d062 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:26.727877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1fec050-71d7-4060-9765-fcbc00a3d062 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:26.728362 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1fec050-71d7-4060-9765-fcbc00a3d062 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:26.728776 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b1fec050-71d7-4060-9765-fcbc00a3d062 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:26.749717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-12563110-96b7-40ab-9cff-02d090818cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046320 Sep 05 17:11:26.750294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 557/1098] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:26 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:26.760266 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b1fec050-71d7-4060-9765-fcbc00a3d062 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047346 Sep 05 17:11:26.760840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 542/1099] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:26 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:27.377200 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6c66336e-4382-4d59-83e1-3f773cb23ed1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:27.378893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6c66336e-4382-4d59-83e1-3f773cb23ed1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:27.389608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c66336e-4382-4d59-83e1-3f773cb23ed1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:27.390431 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c66336e-4382-4d59-83e1-3f773cb23ed1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:27.391107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c66336e-4382-4d59-83e1-3f773cb23ed1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:27.392235 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c66336e-4382-4d59-83e1-3f773cb23ed1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:27.393018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c66336e-4382-4d59-83e1-3f773cb23ed1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:27.393715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c66336e-4382-4d59-83e1-3f773cb23ed1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:27.467066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6c66336e-4382-4d59-83e1-3f773cb23ed1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:27.477330 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6c66336e-4382-4d59-83e1-3f773cb23ed1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.106956 Sep 05 17:11:27.478074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 558/1100] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:27 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:27.766950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e3fefed0-f4ec-4a60-884a-64fae321ed91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:27.770103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e3fefed0-f4ec-4a60-884a-64fae321ed91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:27.778454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9848fd2c-def8-44fc-be9f-bec09d3b3d6e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:27.780350 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3fefed0-f4ec-4a60-884a-64fae321ed91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:27.781105 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3fefed0-f4ec-4a60-884a-64fae321ed91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:27.781772 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3fefed0-f4ec-4a60-884a-64fae321ed91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:27.781961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9848fd2c-def8-44fc-be9f-bec09d3b3d6e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:27.782847 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3fefed0-f4ec-4a60-884a-64fae321ed91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:27.783591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3fefed0-f4ec-4a60-884a-64fae321ed91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:27.784282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3fefed0-f4ec-4a60-884a-64fae321ed91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:27.789338 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9848fd2c-def8-44fc-be9f-bec09d3b3d6e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:27.789843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9848fd2c-def8-44fc-be9f-bec09d3b3d6e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:27.790276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9848fd2c-def8-44fc-be9f-bec09d3b3d6e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:27.790958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9848fd2c-def8-44fc-be9f-bec09d3b3d6e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:27.791402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9848fd2c-def8-44fc-be9f-bec09d3b3d6e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:27.791815 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9848fd2c-def8-44fc-be9f-bec09d3b3d6e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:27.814010 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e3fefed0-f4ec-4a60-884a-64fae321ed91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053439 Sep 05 17:11:27.814561 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 543/1101] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:27 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:27.821697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9848fd2c-def8-44fc-be9f-bec09d3b3d6e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049575 Sep 05 17:11:27.822260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 559/1102] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:27 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:28.504047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d2902777-73db-4aeb-93e4-c81a10eb16b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:28.504739 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d2902777-73db-4aeb-93e4-c81a10eb16b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:28.511495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2902777-73db-4aeb-93e4-c81a10eb16b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:28.512004 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2902777-73db-4aeb-93e4-c81a10eb16b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:28.512485 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2902777-73db-4aeb-93e4-c81a10eb16b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:28.513230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2902777-73db-4aeb-93e4-c81a10eb16b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:28.513682 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2902777-73db-4aeb-93e4-c81a10eb16b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:28.514126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2902777-73db-4aeb-93e4-c81a10eb16b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:28.639577 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d2902777-73db-4aeb-93e4-c81a10eb16b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:28.647855 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d2902777-73db-4aeb-93e4-c81a10eb16b6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.150356 Sep 05 17:11:28.648452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 544/1103] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:28 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:28.828712 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2296d418-d75f-4986-8988-d2f5823adbfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:28.831132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2296d418-d75f-4986-8988-d2f5823adbfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:28.834595 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7dc92efb-efba-44a2-b630-1436d3efcdda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:28.836726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7dc92efb-efba-44a2-b630-1436d3efcdda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:28.838123 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2296d418-d75f-4986-8988-d2f5823adbfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:28.838682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2296d418-d75f-4986-8988-d2f5823adbfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:28.839244 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2296d418-d75f-4986-8988-d2f5823adbfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:28.840072 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2296d418-d75f-4986-8988-d2f5823adbfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:28.840341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2296d418-d75f-4986-8988-d2f5823adbfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:28.840975 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2296d418-d75f-4986-8988-d2f5823adbfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:28.843480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dc92efb-efba-44a2-b630-1436d3efcdda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:28.843961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dc92efb-efba-44a2-b630-1436d3efcdda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:28.844418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dc92efb-efba-44a2-b630-1436d3efcdda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:28.845107 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dc92efb-efba-44a2-b630-1436d3efcdda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:28.845555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dc92efb-efba-44a2-b630-1436d3efcdda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:28.845943 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dc92efb-efba-44a2-b630-1436d3efcdda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:28.872034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2296d418-d75f-4986-8988-d2f5823adbfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047880 Sep 05 17:11:28.872645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 560/1104] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:28 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:28.876775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7dc92efb-efba-44a2-b630-1436d3efcdda tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046373 Sep 05 17:11:28.877407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 545/1105] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:28 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:29.674944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-30a71fe8-9c5c-482e-87eb-5afbe53dc11a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:29.675784 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-30a71fe8-9c5c-482e-87eb-5afbe53dc11a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:29.682983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30a71fe8-9c5c-482e-87eb-5afbe53dc11a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:29.683561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30a71fe8-9c5c-482e-87eb-5afbe53dc11a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:29.684041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30a71fe8-9c5c-482e-87eb-5afbe53dc11a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:29.684848 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30a71fe8-9c5c-482e-87eb-5afbe53dc11a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:29.685345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30a71fe8-9c5c-482e-87eb-5afbe53dc11a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:29.685816 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30a71fe8-9c5c-482e-87eb-5afbe53dc11a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:29.808772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-30a71fe8-9c5c-482e-87eb-5afbe53dc11a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:29.817148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-30a71fe8-9c5c-482e-87eb-5afbe53dc11a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.148862 Sep 05 17:11:29.817517 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 561/1106] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:29 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:29.887443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-77547421-195d-4ca8-8016-5d61f0a93177 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:29.890701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-77547421-195d-4ca8-8016-5d61f0a93177 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:29.892844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3cc98cda-aaa1-4c87-baa9-605bd4806fe6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:29.896935 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3cc98cda-aaa1-4c87-baa9-605bd4806fe6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:29.901320 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77547421-195d-4ca8-8016-5d61f0a93177 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:29.902084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77547421-195d-4ca8-8016-5d61f0a93177 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:29.902739 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77547421-195d-4ca8-8016-5d61f0a93177 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:29.903782 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77547421-195d-4ca8-8016-5d61f0a93177 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:29.904507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77547421-195d-4ca8-8016-5d61f0a93177 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:29.905146 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77547421-195d-4ca8-8016-5d61f0a93177 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:29.907491 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3cc98cda-aaa1-4c87-baa9-605bd4806fe6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:29.908408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3cc98cda-aaa1-4c87-baa9-605bd4806fe6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:29.909116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3cc98cda-aaa1-4c87-baa9-605bd4806fe6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:29.910310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3cc98cda-aaa1-4c87-baa9-605bd4806fe6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:29.910760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3cc98cda-aaa1-4c87-baa9-605bd4806fe6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:29.911176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3cc98cda-aaa1-4c87-baa9-605bd4806fe6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:29.936550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-77547421-195d-4ca8-8016-5d61f0a93177 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055384 Sep 05 17:11:29.937057 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 546/1107] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:29 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:29.941817 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3cc98cda-aaa1-4c87-baa9-605bd4806fe6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054829 Sep 05 17:11:29.942371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 562/1108] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:29 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:30.843951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d3eaa039-8d58-484b-bd6d-756687e9706f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:30.844997 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d3eaa039-8d58-484b-bd6d-756687e9706f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:30.855817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3eaa039-8d58-484b-bd6d-756687e9706f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:30.856680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3eaa039-8d58-484b-bd6d-756687e9706f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:30.857398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3eaa039-8d58-484b-bd6d-756687e9706f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:30.858536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3eaa039-8d58-484b-bd6d-756687e9706f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:30.859303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3eaa039-8d58-484b-bd6d-756687e9706f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:30.860049 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d3eaa039-8d58-484b-bd6d-756687e9706f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:30.923111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d3eaa039-8d58-484b-bd6d-756687e9706f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:30.931610 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d3eaa039-8d58-484b-bd6d-756687e9706f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.094227 Sep 05 17:11:30.932180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 547/1109] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:30 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:30.949387 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1f978681-d022-4880-8f37-40249aaf243e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:30.951884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1f978681-d022-4880-8f37-40249aaf243e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:30.954051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d106b1bb-c7aa-43c3-b7d1-cc3f95bc7f97 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:30.954221 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=86 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:11:30.956397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d106b1bb-c7aa-43c3-b7d1-cc3f95bc7f97 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:30.960075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f978681-d022-4880-8f37-40249aaf243e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:30.960578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f978681-d022-4880-8f37-40249aaf243e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:30.960999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f978681-d022-4880-8f37-40249aaf243e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:30.961684 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f978681-d022-4880-8f37-40249aaf243e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:30.962126 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f978681-d022-4880-8f37-40249aaf243e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:30.962535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f978681-d022-4880-8f37-40249aaf243e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:30.962684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d106b1bb-c7aa-43c3-b7d1-cc3f95bc7f97 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:30.963132 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d106b1bb-c7aa-43c3-b7d1-cc3f95bc7f97 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:30.963559 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d106b1bb-c7aa-43c3-b7d1-cc3f95bc7f97 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:30.964273 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d106b1bb-c7aa-43c3-b7d1-cc3f95bc7f97 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:30.964721 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d106b1bb-c7aa-43c3-b7d1-cc3f95bc7f97 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:30.965137 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d106b1bb-c7aa-43c3-b7d1-cc3f95bc7f97 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:30.992300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1f978681-d022-4880-8f37-40249aaf243e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046926 Sep 05 17:11:30.992870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 563/1110] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:30 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:30.995665 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d106b1bb-c7aa-43c3-b7d1-cc3f95bc7f97 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045433 Sep 05 17:11:30.996251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 548/1111] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:30 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 17:11:31.959157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-51ff6ef0-032c-4f1b-9d1a-3bfc824af2da tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:31.959818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-51ff6ef0-032c-4f1b-9d1a-3bfc824af2da tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:31.966651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51ff6ef0-032c-4f1b-9d1a-3bfc824af2da tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:31.967122 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51ff6ef0-032c-4f1b-9d1a-3bfc824af2da tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:31.967549 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51ff6ef0-032c-4f1b-9d1a-3bfc824af2da tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:31.968260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51ff6ef0-032c-4f1b-9d1a-3bfc824af2da tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:31.968696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51ff6ef0-032c-4f1b-9d1a-3bfc824af2da tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:31.969117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51ff6ef0-032c-4f1b-9d1a-3bfc824af2da tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:32.005549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e3820478-60d3-4d75-87f5-87c4dbddb103 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:32.007716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e3820478-60d3-4d75-87f5-87c4dbddb103 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:32.014696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3820478-60d3-4d75-87f5-87c4dbddb103 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:32.015149 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3820478-60d3-4d75-87f5-87c4dbddb103 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:32.015578 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3820478-60d3-4d75-87f5-87c4dbddb103 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:32.016315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3820478-60d3-4d75-87f5-87c4dbddb103 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:32.016768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3820478-60d3-4d75-87f5-87c4dbddb103 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:32.017192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3820478-60d3-4d75-87f5-87c4dbddb103 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:32.030244 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-51ff6ef0-032c-4f1b-9d1a-3bfc824af2da tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:32.038358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-51ff6ef0-032c-4f1b-9d1a-3bfc824af2da tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.084664 Sep 05 17:11:32.038925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 564/1112] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:31 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:32.043635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-446a2e6c-75f8-475a-8954-896945630322 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:32.045761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-446a2e6c-75f8-475a-8954-896945630322 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:32.049099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e3820478-60d3-4d75-87f5-87c4dbddb103 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047814 Sep 05 17:11:32.049831 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 549/1113] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:32 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:32.051619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-446a2e6c-75f8-475a-8954-896945630322 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:32.052168 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-446a2e6c-75f8-475a-8954-896945630322 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:32.052680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-446a2e6c-75f8-475a-8954-896945630322 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:32.053434 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-446a2e6c-75f8-475a-8954-896945630322 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:32.053969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-446a2e6c-75f8-475a-8954-896945630322 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:32.054409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-446a2e6c-75f8-475a-8954-896945630322 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:32.056946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:11:32.085920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-446a2e6c-75f8-475a-8954-896945630322 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045975 Sep 05 17:11:32.086481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 565/1114] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:32 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:33.065445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b955e8cd-27cc-4162-b507-f4d199a98574 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:33.066455 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0a99e6b9-0a68-4762-899e-b3f03188e4d6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:33.066824 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b955e8cd-27cc-4162-b507-f4d199a98574 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:33.068310 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0a99e6b9-0a68-4762-899e-b3f03188e4d6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:33.073428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b955e8cd-27cc-4162-b507-f4d199a98574 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:33.073919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b955e8cd-27cc-4162-b507-f4d199a98574 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:33.074354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b955e8cd-27cc-4162-b507-f4d199a98574 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:33.075054 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b955e8cd-27cc-4162-b507-f4d199a98574 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:33.075216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a99e6b9-0a68-4762-899e-b3f03188e4d6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:33.075506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b955e8cd-27cc-4162-b507-f4d199a98574 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:33.075654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a99e6b9-0a68-4762-899e-b3f03188e4d6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:33.075928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b955e8cd-27cc-4162-b507-f4d199a98574 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:33.076075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a99e6b9-0a68-4762-899e-b3f03188e4d6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:33.076652 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a99e6b9-0a68-4762-899e-b3f03188e4d6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:33.077095 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a99e6b9-0a68-4762-899e-b3f03188e4d6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:33.077502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a99e6b9-0a68-4762-899e-b3f03188e4d6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:33.095268 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:11:33.109544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0a99e6b9-0a68-4762-899e-b3f03188e4d6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050406 Sep 05 17:11:33.110116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 550/1115] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:33 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:33.114910 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f0160d57-aec7-4ccf-bdb1-62cc12f45e03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:33.117033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f0160d57-aec7-4ccf-bdb1-62cc12f45e03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:33.123566 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0160d57-aec7-4ccf-bdb1-62cc12f45e03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:33.124048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0160d57-aec7-4ccf-bdb1-62cc12f45e03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:33.124501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0160d57-aec7-4ccf-bdb1-62cc12f45e03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:33.125193 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0160d57-aec7-4ccf-bdb1-62cc12f45e03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:33.125627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0160d57-aec7-4ccf-bdb1-62cc12f45e03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:33.126032 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0160d57-aec7-4ccf-bdb1-62cc12f45e03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:33.138692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b955e8cd-27cc-4162-b507-f4d199a98574 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:33.146787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b955e8cd-27cc-4162-b507-f4d199a98574 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087664 Sep 05 17:11:33.147365 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 566/1116] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:33 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:33.165978 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f0160d57-aec7-4ccf-bdb1-62cc12f45e03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054844 Sep 05 17:11:33.166538 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 551/1117] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:33 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:34.126687 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6fd6f863-a27d-4f99-a439-035f5a645d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:34.130687 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6fd6f863-a27d-4f99-a439-035f5a645d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:34.141497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fd6f863-a27d-4f99-a439-035f5a645d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:34.142288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fd6f863-a27d-4f99-a439-035f5a645d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:34.142992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fd6f863-a27d-4f99-a439-035f5a645d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:34.144270 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fd6f863-a27d-4f99-a439-035f5a645d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:34.144877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fd6f863-a27d-4f99-a439-035f5a645d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:34.145295 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fd6f863-a27d-4f99-a439-035f5a645d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:34.169299 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b3e5fb64-200a-4f47-b346-782360c2b03b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:34.169871 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b3e5fb64-200a-4f47-b346-782360c2b03b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:34.172394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=84 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:11:34.175958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6fd6f863-a27d-4f99-a439-035f5a645d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055956 Sep 05 17:11:34.178312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 567/1118] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:34 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:34.179925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3e5fb64-200a-4f47-b346-782360c2b03b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:34.180440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3e5fb64-200a-4f47-b346-782360c2b03b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:34.180867 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3e5fb64-200a-4f47-b346-782360c2b03b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:34.181556 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3e5fb64-200a-4f47-b346-782360c2b03b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:34.181995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3e5fb64-200a-4f47-b346-782360c2b03b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:34.182406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3e5fb64-200a-4f47-b346-782360c2b03b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:34.190259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c4c25a97-9e88-4667-82a4-943d2dd61cc3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:34.192549 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c4c25a97-9e88-4667-82a4-943d2dd61cc3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:34.198819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4c25a97-9e88-4667-82a4-943d2dd61cc3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:34.199290 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4c25a97-9e88-4667-82a4-943d2dd61cc3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:34.199712 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4c25a97-9e88-4667-82a4-943d2dd61cc3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:34.200428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4c25a97-9e88-4667-82a4-943d2dd61cc3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:34.200873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4c25a97-9e88-4667-82a4-943d2dd61cc3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:34.201285 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4c25a97-9e88-4667-82a4-943d2dd61cc3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:34.233226 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c4c25a97-9e88-4667-82a4-943d2dd61cc3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055574 Sep 05 17:11:34.233840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 568/1119] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:34 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:34.248619 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b3e5fb64-200a-4f47-b346-782360c2b03b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:34.256547 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b3e5fb64-200a-4f47-b346-782360c2b03b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091058 Sep 05 17:11:34.257071 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 552/1120] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:34 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:35.192439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-936fb7a5-62da-48a8-a1c9-4cfc1a422a8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:35.194584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-936fb7a5-62da-48a8-a1c9-4cfc1a422a8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:35.201615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-936fb7a5-62da-48a8-a1c9-4cfc1a422a8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:35.202087 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-936fb7a5-62da-48a8-a1c9-4cfc1a422a8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:35.202613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-936fb7a5-62da-48a8-a1c9-4cfc1a422a8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:35.203300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-936fb7a5-62da-48a8-a1c9-4cfc1a422a8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:35.203742 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-936fb7a5-62da-48a8-a1c9-4cfc1a422a8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:35.204174 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-936fb7a5-62da-48a8-a1c9-4cfc1a422a8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:35.233411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-936fb7a5-62da-48a8-a1c9-4cfc1a422a8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046908 Sep 05 17:11:35.233957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 569/1121] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:35 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:35.250021 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-95831e7c-3106-4ac7-af89-62910a7a911e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:35.253517 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-95831e7c-3106-4ac7-af89-62910a7a911e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:35.260545 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95831e7c-3106-4ac7-af89-62910a7a911e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:35.261024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95831e7c-3106-4ac7-af89-62910a7a911e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:35.261459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95831e7c-3106-4ac7-af89-62910a7a911e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:35.262147 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95831e7c-3106-4ac7-af89-62910a7a911e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:35.262600 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95831e7c-3106-4ac7-af89-62910a7a911e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:35.263020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95831e7c-3106-4ac7-af89-62910a7a911e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:35.278727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8e947718-35cc-4970-897b-5434c85a249d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:35.279329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8e947718-35cc-4970-897b-5434c85a249d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:35.285721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e947718-35cc-4970-897b-5434c85a249d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:35.286197 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e947718-35cc-4970-897b-5434c85a249d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:35.286625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e947718-35cc-4970-897b-5434c85a249d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:35.287309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e947718-35cc-4970-897b-5434c85a249d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:35.287743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e947718-35cc-4970-897b-5434c85a249d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:35.288171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e947718-35cc-4970-897b-5434c85a249d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:35.294516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-95831e7c-3106-4ac7-af89-62910a7a911e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051172 Sep 05 17:11:35.295099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 553/1122] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:35 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:35.349149 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8e947718-35cc-4970-897b-5434c85a249d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:35.357752 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8e947718-35cc-4970-897b-5434c85a249d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.082816 Sep 05 17:11:35.358309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 570/1123] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:35 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:11:36.250142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5b9ec785-bfe0-4300-b337-301129a22d4e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:36.253753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5b9ec785-bfe0-4300-b337-301129a22d4e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:36.264554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b9ec785-bfe0-4300-b337-301129a22d4e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:36.265345 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b9ec785-bfe0-4300-b337-301129a22d4e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:36.266044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b9ec785-bfe0-4300-b337-301129a22d4e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:36.267156 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b9ec785-bfe0-4300-b337-301129a22d4e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:36.267890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b9ec785-bfe0-4300-b337-301129a22d4e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:36.268632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b9ec785-bfe0-4300-b337-301129a22d4e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:36.298130 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5b9ec785-bfe0-4300-b337-301129a22d4e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054670 Sep 05 17:11:36.298671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 554/1124] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:36 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:36.309308 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3cc2e45f-47b2-47c5-a021-5dd24486115f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:36.312503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3cc2e45f-47b2-47c5-a021-5dd24486115f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:36.322510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3cc2e45f-47b2-47c5-a021-5dd24486115f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:36.323188 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3cc2e45f-47b2-47c5-a021-5dd24486115f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:36.323830 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3cc2e45f-47b2-47c5-a021-5dd24486115f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:36.324974 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3cc2e45f-47b2-47c5-a021-5dd24486115f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:36.325628 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3cc2e45f-47b2-47c5-a021-5dd24486115f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:36.326195 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3cc2e45f-47b2-47c5-a021-5dd24486115f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:36.358196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3cc2e45f-47b2-47c5-a021-5dd24486115f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054982 Sep 05 17:11:36.358637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 571/1125] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:36 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:36.379550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c8346dc5-7545-426a-ae09-faa8f65007fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:36.380191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c8346dc5-7545-426a-ae09-faa8f65007fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:36.386450 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8346dc5-7545-426a-ae09-faa8f65007fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:36.386928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8346dc5-7545-426a-ae09-faa8f65007fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:36.387356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8346dc5-7545-426a-ae09-faa8f65007fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:36.388032 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8346dc5-7545-426a-ae09-faa8f65007fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:36.388514 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8346dc5-7545-426a-ae09-faa8f65007fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:36.388939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8346dc5-7545-426a-ae09-faa8f65007fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:36.453119 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c8346dc5-7545-426a-ae09-faa8f65007fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:36.461095 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c8346dc5-7545-426a-ae09-faa8f65007fe tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.085654 Sep 05 17:11:36.461668 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 555/1126] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:36 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:37.315165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7f7c4603-4ce5-4db5-85b8-562217f0b05e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:37.317637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7f7c4603-4ce5-4db5-85b8-562217f0b05e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:37.324551 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f7c4603-4ce5-4db5-85b8-562217f0b05e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:37.325033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f7c4603-4ce5-4db5-85b8-562217f0b05e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:37.325468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f7c4603-4ce5-4db5-85b8-562217f0b05e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:37.326164 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f7c4603-4ce5-4db5-85b8-562217f0b05e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:37.326614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f7c4603-4ce5-4db5-85b8-562217f0b05e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:37.327034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f7c4603-4ce5-4db5-85b8-562217f0b05e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:37.356620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7f7c4603-4ce5-4db5-85b8-562217f0b05e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048399 Sep 05 17:11:37.357177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 572/1127] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:37 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:37.373752 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c27143be-c784-4881-998d-753e72a7277f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:37.375909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c27143be-c784-4881-998d-753e72a7277f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:37.383108 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c27143be-c784-4881-998d-753e72a7277f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:37.383586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c27143be-c784-4881-998d-753e72a7277f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:37.384005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c27143be-c784-4881-998d-753e72a7277f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:37.384716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c27143be-c784-4881-998d-753e72a7277f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:37.385155 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c27143be-c784-4881-998d-753e72a7277f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:37.385563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c27143be-c784-4881-998d-753e72a7277f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:37.415656 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c27143be-c784-4881-998d-753e72a7277f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048301 Sep 05 17:11:37.416235 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 556/1128] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:37 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:37.488124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-da48d406-1fda-4cfe-91b3-171c36d6544b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:37.489171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-da48d406-1fda-4cfe-91b3-171c36d6544b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:37.498745 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da48d406-1fda-4cfe-91b3-171c36d6544b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:37.499487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da48d406-1fda-4cfe-91b3-171c36d6544b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:37.500209 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da48d406-1fda-4cfe-91b3-171c36d6544b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:37.501254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da48d406-1fda-4cfe-91b3-171c36d6544b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:37.501947 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da48d406-1fda-4cfe-91b3-171c36d6544b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:37.502600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da48d406-1fda-4cfe-91b3-171c36d6544b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:37.564765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-da48d406-1fda-4cfe-91b3-171c36d6544b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:37.573362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-da48d406-1fda-4cfe-91b3-171c36d6544b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091287 Sep 05 17:11:37.573930 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 573/1129] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:37 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:38.370176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fbb3ad9c-414f-4cb0-b5b6-1c4324494da2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:38.372382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fbb3ad9c-414f-4cb0-b5b6-1c4324494da2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:38.378790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fbb3ad9c-414f-4cb0-b5b6-1c4324494da2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:38.379376 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fbb3ad9c-414f-4cb0-b5b6-1c4324494da2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:38.379800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fbb3ad9c-414f-4cb0-b5b6-1c4324494da2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:38.380526 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fbb3ad9c-414f-4cb0-b5b6-1c4324494da2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:38.380983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fbb3ad9c-414f-4cb0-b5b6-1c4324494da2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:38.381406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fbb3ad9c-414f-4cb0-b5b6-1c4324494da2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:38.412019 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fbb3ad9c-414f-4cb0-b5b6-1c4324494da2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045902 Sep 05 17:11:38.412495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 557/1130] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:38 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:38.429007 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ee0f01ef-9cf8-4d7b-9391-3dc873042844 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:38.431260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ee0f01ef-9cf8-4d7b-9391-3dc873042844 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:38.438096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee0f01ef-9cf8-4d7b-9391-3dc873042844 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:38.438568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee0f01ef-9cf8-4d7b-9391-3dc873042844 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:38.438992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee0f01ef-9cf8-4d7b-9391-3dc873042844 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:38.439678 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee0f01ef-9cf8-4d7b-9391-3dc873042844 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:38.440117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee0f01ef-9cf8-4d7b-9391-3dc873042844 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:38.440591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee0f01ef-9cf8-4d7b-9391-3dc873042844 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:38.470906 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ee0f01ef-9cf8-4d7b-9391-3dc873042844 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046400 Sep 05 17:11:38.471462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 574/1131] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:38 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:38.605474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-72b1386d-e4a6-409c-897d-923b07b5c2bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:38.606434 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-72b1386d-e4a6-409c-897d-923b07b5c2bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:38.615519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72b1386d-e4a6-409c-897d-923b07b5c2bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:38.615977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72b1386d-e4a6-409c-897d-923b07b5c2bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:38.616493 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72b1386d-e4a6-409c-897d-923b07b5c2bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:38.617262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72b1386d-e4a6-409c-897d-923b07b5c2bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:38.617759 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72b1386d-e4a6-409c-897d-923b07b5c2bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:38.618224 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72b1386d-e4a6-409c-897d-923b07b5c2bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:38.692475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-72b1386d-e4a6-409c-897d-923b07b5c2bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:38.700393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-72b1386d-e4a6-409c-897d-923b07b5c2bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.105720 Sep 05 17:11:38.700960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 558/1132] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:38 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:11:39.425878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a32c0251-1f48-4a87-9d86-20e4456344f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:39.428051 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a32c0251-1f48-4a87-9d86-20e4456344f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:39.434217 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a32c0251-1f48-4a87-9d86-20e4456344f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:39.434826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a32c0251-1f48-4a87-9d86-20e4456344f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:39.435104 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a32c0251-1f48-4a87-9d86-20e4456344f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:39.435787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a32c0251-1f48-4a87-9d86-20e4456344f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:39.436250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a32c0251-1f48-4a87-9d86-20e4456344f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:39.436653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a32c0251-1f48-4a87-9d86-20e4456344f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:39.467458 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a32c0251-1f48-4a87-9d86-20e4456344f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046598 Sep 05 17:11:39.468041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 575/1133] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:39 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:39.484011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-99bed4ff-a64b-453b-b7bb-f85e899dc27d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:39.486434 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-99bed4ff-a64b-453b-b7bb-f85e899dc27d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:39.492972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99bed4ff-a64b-453b-b7bb-f85e899dc27d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:39.493524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99bed4ff-a64b-453b-b7bb-f85e899dc27d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:39.493927 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99bed4ff-a64b-453b-b7bb-f85e899dc27d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:39.494719 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99bed4ff-a64b-453b-b7bb-f85e899dc27d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:39.495157 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99bed4ff-a64b-453b-b7bb-f85e899dc27d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:39.495568 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99bed4ff-a64b-453b-b7bb-f85e899dc27d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:39.526586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-99bed4ff-a64b-453b-b7bb-f85e899dc27d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046511 Sep 05 17:11:39.527140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 559/1134] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:39 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:39.728541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fce89c55-defe-4c9a-8307-46f345e8b62f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:39.729452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fce89c55-defe-4c9a-8307-46f345e8b62f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:39.739799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fce89c55-defe-4c9a-8307-46f345e8b62f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:39.740646 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fce89c55-defe-4c9a-8307-46f345e8b62f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:39.741364 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fce89c55-defe-4c9a-8307-46f345e8b62f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:39.742494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fce89c55-defe-4c9a-8307-46f345e8b62f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:39.743244 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fce89c55-defe-4c9a-8307-46f345e8b62f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:39.743943 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fce89c55-defe-4c9a-8307-46f345e8b62f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:39.810012 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fce89c55-defe-4c9a-8307-46f345e8b62f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:39.818024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fce89c55-defe-4c9a-8307-46f345e8b62f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.096874 Sep 05 17:11:39.818593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 576/1135] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:39 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:40.481891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-811e48eb-5cab-4004-9460-e7959c1b2244 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:40.484022 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-811e48eb-5cab-4004-9460-e7959c1b2244 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:40.490648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-811e48eb-5cab-4004-9460-e7959c1b2244 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:40.491120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-811e48eb-5cab-4004-9460-e7959c1b2244 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:40.491541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-811e48eb-5cab-4004-9460-e7959c1b2244 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:40.492251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-811e48eb-5cab-4004-9460-e7959c1b2244 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:40.492680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-811e48eb-5cab-4004-9460-e7959c1b2244 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:40.493094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-811e48eb-5cab-4004-9460-e7959c1b2244 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:40.523046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-811e48eb-5cab-4004-9460-e7959c1b2244 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045240 Sep 05 17:11:40.523605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 560/1136] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:40 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:40.539430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f30257f8-62b6-4131-8e04-2a9e80314a34 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:40.541642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f30257f8-62b6-4131-8e04-2a9e80314a34 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:40.543662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:11:40.543810 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments (ip 10.222.0.23) !!! Sep 05 17:11:40.549893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f30257f8-62b6-4131-8e04-2a9e80314a34 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:40.550409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f30257f8-62b6-4131-8e04-2a9e80314a34 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:40.550839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f30257f8-62b6-4131-8e04-2a9e80314a34 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:40.551534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f30257f8-62b6-4131-8e04-2a9e80314a34 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:40.551977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f30257f8-62b6-4131-8e04-2a9e80314a34 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:40.552411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f30257f8-62b6-4131-8e04-2a9e80314a34 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:40.583199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f30257f8-62b6-4131-8e04-2a9e80314a34 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047843 Sep 05 17:11:40.583751 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 577/1137] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:40 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:40.842382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-008828f9-f2f9-434b-88c9-7407a6a68b12 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:40.842985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-008828f9-f2f9-434b-88c9-7407a6a68b12 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:40.846025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:11:40.846170 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f (ip 10.222.0.23) !!! Sep 05 17:11:40.853168 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-008828f9-f2f9-434b-88c9-7407a6a68b12 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:40.853651 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-008828f9-f2f9-434b-88c9-7407a6a68b12 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:40.854085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-008828f9-f2f9-434b-88c9-7407a6a68b12 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:40.854779 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-008828f9-f2f9-434b-88c9-7407a6a68b12 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:40.855229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-008828f9-f2f9-434b-88c9-7407a6a68b12 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:40.855672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-008828f9-f2f9-434b-88c9-7407a6a68b12 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:40.922809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-008828f9-f2f9-434b-88c9-7407a6a68b12 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:40.931870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-008828f9-f2f9-434b-88c9-7407a6a68b12 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.094584 Sep 05 17:11:40.932510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 561/1138] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:40 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:41.541863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-005e2bb1-e427-4756-981d-729e3a263d75 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:41.545259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-005e2bb1-e427-4756-981d-729e3a263d75 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:41.554276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-005e2bb1-e427-4756-981d-729e3a263d75 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:41.554757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-005e2bb1-e427-4756-981d-729e3a263d75 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:41.555187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-005e2bb1-e427-4756-981d-729e3a263d75 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:41.555886 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-005e2bb1-e427-4756-981d-729e3a263d75 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:41.556385 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-005e2bb1-e427-4756-981d-729e3a263d75 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:41.556800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-005e2bb1-e427-4756-981d-729e3a263d75 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:41.587218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-005e2bb1-e427-4756-981d-729e3a263d75 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053608 Sep 05 17:11:41.587761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 578/1139] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:41 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:41.595106 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-22b970f7-5707-4757-ad26-68b931d16112 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:41.597787 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-22b970f7-5707-4757-ad26-68b931d16112 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:41.605041 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22b970f7-5707-4757-ad26-68b931d16112 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:41.605510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22b970f7-5707-4757-ad26-68b931d16112 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:41.605934 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22b970f7-5707-4757-ad26-68b931d16112 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:41.606612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22b970f7-5707-4757-ad26-68b931d16112 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:41.607056 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22b970f7-5707-4757-ad26-68b931d16112 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:41.607467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22b970f7-5707-4757-ad26-68b931d16112 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:41.637209 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-22b970f7-5707-4757-ad26-68b931d16112 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046145 Sep 05 17:11:41.637752 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 562/1140] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:41 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:41.958735 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e4aa3061-d2bb-499d-aed9-d24d750c3ea8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:41.959733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e4aa3061-d2bb-499d-aed9-d24d750c3ea8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:41.970216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4aa3061-d2bb-499d-aed9-d24d750c3ea8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:41.971006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4aa3061-d2bb-499d-aed9-d24d750c3ea8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:41.971708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4aa3061-d2bb-499d-aed9-d24d750c3ea8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:41.972854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4aa3061-d2bb-499d-aed9-d24d750c3ea8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:41.973159 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4aa3061-d2bb-499d-aed9-d24d750c3ea8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:41.973574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4aa3061-d2bb-499d-aed9-d24d750c3ea8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:42.035101 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e4aa3061-d2bb-499d-aed9-d24d750c3ea8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:42.043210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e4aa3061-d2bb-499d-aed9-d24d750c3ea8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091292 Sep 05 17:11:42.043807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 579/1141] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:41 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:42.602983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-06d63056-1686-4fd3-8fea-5c7dffb32f2e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:42.605524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-06d63056-1686-4fd3-8fea-5c7dffb32f2e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:42.614092 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-06d63056-1686-4fd3-8fea-5c7dffb32f2e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:42.614660 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-06d63056-1686-4fd3-8fea-5c7dffb32f2e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:42.615167 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-06d63056-1686-4fd3-8fea-5c7dffb32f2e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:42.615980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-06d63056-1686-4fd3-8fea-5c7dffb32f2e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:42.616544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-06d63056-1686-4fd3-8fea-5c7dffb32f2e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:42.617029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-06d63056-1686-4fd3-8fea-5c7dffb32f2e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:42.650084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-06d63056-1686-4fd3-8fea-5c7dffb32f2e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053310 Sep 05 17:11:42.650294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c91f70a4-6d73-47cd-88f7-b9685a03e99f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:42.650861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 563/1142] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:42 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:42.652655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c91f70a4-6d73-47cd-88f7-b9685a03e99f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:42.661329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c91f70a4-6d73-47cd-88f7-b9685a03e99f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:42.661813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c91f70a4-6d73-47cd-88f7-b9685a03e99f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:42.662250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c91f70a4-6d73-47cd-88f7-b9685a03e99f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:42.662933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c91f70a4-6d73-47cd-88f7-b9685a03e99f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:42.663394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c91f70a4-6d73-47cd-88f7-b9685a03e99f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:42.663822 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c91f70a4-6d73-47cd-88f7-b9685a03e99f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:42.694702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c91f70a4-6d73-47cd-88f7-b9685a03e99f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048515 Sep 05 17:11:42.695269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 580/1143] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:42 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:43.071164 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1ade358d-1112-4d57-896a-09ebcc0ef4ff tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:43.072043 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1ade358d-1112-4d57-896a-09ebcc0ef4ff tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:43.082508 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ade358d-1112-4d57-896a-09ebcc0ef4ff tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:43.083048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ade358d-1112-4d57-896a-09ebcc0ef4ff tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:43.083470 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ade358d-1112-4d57-896a-09ebcc0ef4ff tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:43.084172 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ade358d-1112-4d57-896a-09ebcc0ef4ff tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:43.084615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ade358d-1112-4d57-896a-09ebcc0ef4ff tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:43.085026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ade358d-1112-4d57-896a-09ebcc0ef4ff tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:43.160612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1ade358d-1112-4d57-896a-09ebcc0ef4ff tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:43.171846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1ade358d-1112-4d57-896a-09ebcc0ef4ff tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.107289 Sep 05 17:11:43.172565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 564/1144] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:43 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:43.667460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0e03991e-8dc1-4769-849d-a93e42981ddd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:43.670994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0e03991e-8dc1-4769-849d-a93e42981ddd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:43.679718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e03991e-8dc1-4769-849d-a93e42981ddd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:43.680241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e03991e-8dc1-4769-849d-a93e42981ddd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:43.680672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e03991e-8dc1-4769-849d-a93e42981ddd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:43.681403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e03991e-8dc1-4769-849d-a93e42981ddd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:43.681891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e03991e-8dc1-4769-849d-a93e42981ddd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:43.682313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e03991e-8dc1-4769-849d-a93e42981ddd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:43.707368 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5318b363-ff7a-444b-9ac0-518ba2698a32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:43.708032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:11:43.709687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5318b363-ff7a-444b-9ac0-518ba2698a32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:43.714795 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0e03991e-8dc1-4769-849d-a93e42981ddd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054207 Sep 05 17:11:43.715376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 581/1145] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:43 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:43.715982 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5318b363-ff7a-444b-9ac0-518ba2698a32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:43.716624 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5318b363-ff7a-444b-9ac0-518ba2698a32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:43.717061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5318b363-ff7a-444b-9ac0-518ba2698a32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:43.717758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5318b363-ff7a-444b-9ac0-518ba2698a32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:43.718286 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5318b363-ff7a-444b-9ac0-518ba2698a32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:43.718709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5318b363-ff7a-444b-9ac0-518ba2698a32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:43.749719 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5318b363-ff7a-444b-9ac0-518ba2698a32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046489 Sep 05 17:11:43.750263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 565/1146] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:43 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:44.195679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-945d9cec-b4c4-43f3-a7c7-5c82b98943f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:44.197032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-945d9cec-b4c4-43f3-a7c7-5c82b98943f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:44.203779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-945d9cec-b4c4-43f3-a7c7-5c82b98943f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:44.204290 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-945d9cec-b4c4-43f3-a7c7-5c82b98943f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:44.204722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-945d9cec-b4c4-43f3-a7c7-5c82b98943f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:44.205420 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-945d9cec-b4c4-43f3-a7c7-5c82b98943f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:44.205875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-945d9cec-b4c4-43f3-a7c7-5c82b98943f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:44.206298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-945d9cec-b4c4-43f3-a7c7-5c82b98943f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:44.267829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-945d9cec-b4c4-43f3-a7c7-5c82b98943f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:44.275898 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-945d9cec-b4c4-43f3-a7c7-5c82b98943f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.084270 Sep 05 17:11:44.276514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 582/1147] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:44 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:44.732014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-41d5e245-12da-4bf5-bd2a-55c9c34393d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:44.735434 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-41d5e245-12da-4bf5-bd2a-55c9c34393d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:44.746492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-41d5e245-12da-4bf5-bd2a-55c9c34393d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:44.747270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-41d5e245-12da-4bf5-bd2a-55c9c34393d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:44.747974 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-41d5e245-12da-4bf5-bd2a-55c9c34393d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:44.749148 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-41d5e245-12da-4bf5-bd2a-55c9c34393d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:44.749888 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-41d5e245-12da-4bf5-bd2a-55c9c34393d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:44.750573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-41d5e245-12da-4bf5-bd2a-55c9c34393d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:44.762541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-acb6746e-7dd4-4195-a410-c019abb68797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:44.764742 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-acb6746e-7dd4-4195-a410-c019abb68797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:44.766730 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:11:44.766876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:11:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments (ip 10.222.0.23) !!! Sep 05 17:11:44.773899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acb6746e-7dd4-4195-a410-c019abb68797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:44.774381 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acb6746e-7dd4-4195-a410-c019abb68797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:44.774813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acb6746e-7dd4-4195-a410-c019abb68797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:44.775505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acb6746e-7dd4-4195-a410-c019abb68797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:44.775952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acb6746e-7dd4-4195-a410-c019abb68797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:44.776394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acb6746e-7dd4-4195-a410-c019abb68797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:44.785990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-41d5e245-12da-4bf5-bd2a-55c9c34393d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061007 Sep 05 17:11:44.786576 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 566/1148] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:44 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:44.807727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-acb6746e-7dd4-4195-a410-c019abb68797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049223 Sep 05 17:11:44.808316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 583/1149] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:44 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:45.302530 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d4533d35-ad29-43a9-b5a6-e2e7971db6bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:45.303281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d4533d35-ad29-43a9-b5a6-e2e7971db6bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:45.311177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d4533d35-ad29-43a9-b5a6-e2e7971db6bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:45.311784 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d4533d35-ad29-43a9-b5a6-e2e7971db6bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:45.312398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d4533d35-ad29-43a9-b5a6-e2e7971db6bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:45.313287 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d4533d35-ad29-43a9-b5a6-e2e7971db6bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:45.313848 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d4533d35-ad29-43a9-b5a6-e2e7971db6bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:45.314405 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d4533d35-ad29-43a9-b5a6-e2e7971db6bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:45.319897 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:11:45.380977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d4533d35-ad29-43a9-b5a6-e2e7971db6bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:45.389173 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d4533d35-ad29-43a9-b5a6-e2e7971db6bd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093002 Sep 05 17:11:45.389744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 567/1150] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:45 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:45.803860 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-20130da0-85ee-491e-a2b6-1d90cb37d665 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:45.807329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-20130da0-85ee-491e-a2b6-1d90cb37d665 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:45.818326 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20130da0-85ee-491e-a2b6-1d90cb37d665 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:45.818805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20130da0-85ee-491e-a2b6-1d90cb37d665 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:45.819236 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20130da0-85ee-491e-a2b6-1d90cb37d665 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:45.819928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20130da0-85ee-491e-a2b6-1d90cb37d665 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:45.820406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20130da0-85ee-491e-a2b6-1d90cb37d665 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:45.820829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20130da0-85ee-491e-a2b6-1d90cb37d665 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:45.822559 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-669e9897-3b96-4000-8f5a-57a912dc9be1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:45.824718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-669e9897-3b96-4000-8f5a-57a912dc9be1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:45.831482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-669e9897-3b96-4000-8f5a-57a912dc9be1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:45.832494 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-669e9897-3b96-4000-8f5a-57a912dc9be1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:45.832976 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-669e9897-3b96-4000-8f5a-57a912dc9be1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:45.833655 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-669e9897-3b96-4000-8f5a-57a912dc9be1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:45.834093 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-669e9897-3b96-4000-8f5a-57a912dc9be1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:45.834511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-669e9897-3b96-4000-8f5a-57a912dc9be1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:45.852612 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-20130da0-85ee-491e-a2b6-1d90cb37d665 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056351 Sep 05 17:11:45.853448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 584/1151] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:45 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:45.864752 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-669e9897-3b96-4000-8f5a-57a912dc9be1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046732 Sep 05 17:11:45.865304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 568/1152] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:45 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:46.412661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3891d494-0c61-4be6-b1bc-3429b27edf7d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:46.413269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3891d494-0c61-4be6-b1bc-3429b27edf7d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:46.421991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3891d494-0c61-4be6-b1bc-3429b27edf7d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:46.422504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3891d494-0c61-4be6-b1bc-3429b27edf7d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:46.422935 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3891d494-0c61-4be6-b1bc-3429b27edf7d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:46.423631 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3891d494-0c61-4be6-b1bc-3429b27edf7d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:46.424081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3891d494-0c61-4be6-b1bc-3429b27edf7d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:46.424563 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3891d494-0c61-4be6-b1bc-3429b27edf7d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:46.487095 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3891d494-0c61-4be6-b1bc-3429b27edf7d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:46.495402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3891d494-0c61-4be6-b1bc-3429b27edf7d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086949 Sep 05 17:11:46.495976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 585/1153] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:46 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:46.867735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-77a0f0e1-317f-426e-8777-4141b493b0f4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:46.870874 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-77a0f0e1-317f-426e-8777-4141b493b0f4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:46.881269 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77a0f0e1-317f-426e-8777-4141b493b0f4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:46.881771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-979fc4cf-cfa8-4ada-9083-1e71fc2ea19c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:46.882267 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77a0f0e1-317f-426e-8777-4141b493b0f4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:46.882436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77a0f0e1-317f-426e-8777-4141b493b0f4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:46.883409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77a0f0e1-317f-426e-8777-4141b493b0f4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:46.884122 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77a0f0e1-317f-426e-8777-4141b493b0f4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:46.884908 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77a0f0e1-317f-426e-8777-4141b493b0f4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:46.885134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-979fc4cf-cfa8-4ada-9083-1e71fc2ea19c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:46.895230 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-979fc4cf-cfa8-4ada-9083-1e71fc2ea19c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:46.895819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-979fc4cf-cfa8-4ada-9083-1e71fc2ea19c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:46.896294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-979fc4cf-cfa8-4ada-9083-1e71fc2ea19c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:46.896984 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-979fc4cf-cfa8-4ada-9083-1e71fc2ea19c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:46.897429 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-979fc4cf-cfa8-4ada-9083-1e71fc2ea19c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:46.897866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-979fc4cf-cfa8-4ada-9083-1e71fc2ea19c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:46.919698 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-77a0f0e1-317f-426e-8777-4141b493b0f4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056767 Sep 05 17:11:46.920272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 569/1154] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:46 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:46.936662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-979fc4cf-cfa8-4ada-9083-1e71fc2ea19c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061669 Sep 05 17:11:46.937497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 586/1155] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:46 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:47.530813 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-318d42ff-fafe-4a6c-a1ef-cb8fd083e71e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:47.531773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-318d42ff-fafe-4a6c-a1ef-cb8fd083e71e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:47.542142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-318d42ff-fafe-4a6c-a1ef-cb8fd083e71e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:47.543025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-318d42ff-fafe-4a6c-a1ef-cb8fd083e71e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:47.543801 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-318d42ff-fafe-4a6c-a1ef-cb8fd083e71e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:47.544992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-318d42ff-fafe-4a6c-a1ef-cb8fd083e71e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:47.545771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-318d42ff-fafe-4a6c-a1ef-cb8fd083e71e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:47.546608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-318d42ff-fafe-4a6c-a1ef-cb8fd083e71e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:47.613749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-318d42ff-fafe-4a6c-a1ef-cb8fd083e71e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:47.621632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-318d42ff-fafe-4a6c-a1ef-cb8fd083e71e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.097746 Sep 05 17:11:47.622198 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 570/1156] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:47 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:47.936865 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-41d87d3c-3d56-49ae-9c49-53850b4132f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:47.940363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-41d87d3c-3d56-49ae-9c49-53850b4132f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:47.948180 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41d87d3c-3d56-49ae-9c49-53850b4132f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:47.948697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41d87d3c-3d56-49ae-9c49-53850b4132f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:47.949132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41d87d3c-3d56-49ae-9c49-53850b4132f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:47.949824 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41d87d3c-3d56-49ae-9c49-53850b4132f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:47.950272 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41d87d3c-3d56-49ae-9c49-53850b4132f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:47.950690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41d87d3c-3d56-49ae-9c49-53850b4132f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:47.951056 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-11c2c851-cf86-4c5f-adc1-b23469af79fa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:47.953298 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-11c2c851-cf86-4c5f-adc1-b23469af79fa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:47.959816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11c2c851-cf86-4c5f-adc1-b23469af79fa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:47.960341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11c2c851-cf86-4c5f-adc1-b23469af79fa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:47.960765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11c2c851-cf86-4c5f-adc1-b23469af79fa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:47.961447 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11c2c851-cf86-4c5f-adc1-b23469af79fa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:47.961890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11c2c851-cf86-4c5f-adc1-b23469af79fa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:47.962302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11c2c851-cf86-4c5f-adc1-b23469af79fa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:47.982082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-41d87d3c-3d56-49ae-9c49-53850b4132f5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051936 Sep 05 17:11:47.982649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 587/1157] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:47 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:47.992017 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-11c2c851-cf86-4c5f-adc1-b23469af79fa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044923 Sep 05 17:11:47.992592 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 571/1158] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:47 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:48.646994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-18d543d3-7bb9-4dc9-81ed-5cbb79a1e1ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:48.647717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-18d543d3-7bb9-4dc9-81ed-5cbb79a1e1ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:48.656198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18d543d3-7bb9-4dc9-81ed-5cbb79a1e1ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:48.656961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18d543d3-7bb9-4dc9-81ed-5cbb79a1e1ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:48.657538 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18d543d3-7bb9-4dc9-81ed-5cbb79a1e1ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:48.658448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18d543d3-7bb9-4dc9-81ed-5cbb79a1e1ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:48.659063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18d543d3-7bb9-4dc9-81ed-5cbb79a1e1ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:48.659620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18d543d3-7bb9-4dc9-81ed-5cbb79a1e1ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:48.736435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-18d543d3-7bb9-4dc9-81ed-5cbb79a1e1ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:48.746418 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-18d543d3-7bb9-4dc9-81ed-5cbb79a1e1ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.105090 Sep 05 17:11:48.746985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 588/1159] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:48 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:48.995365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5aea4b04-e96e-4129-aaff-07891ebaae32 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:48.997468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5aea4b04-e96e-4129-aaff-07891ebaae32 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:49.004609 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5aea4b04-e96e-4129-aaff-07891ebaae32 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:49.005099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5aea4b04-e96e-4129-aaff-07891ebaae32 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:49.005275 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e3d6a74d-6018-4cef-8b82-3ae598195590 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:49.005762 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5aea4b04-e96e-4129-aaff-07891ebaae32 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:49.006514 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5aea4b04-e96e-4129-aaff-07891ebaae32 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:49.006971 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5aea4b04-e96e-4129-aaff-07891ebaae32 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:49.007374 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5aea4b04-e96e-4129-aaff-07891ebaae32 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:49.008128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e3d6a74d-6018-4cef-8b82-3ae598195590 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:49.015296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3d6a74d-6018-4cef-8b82-3ae598195590 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:49.015777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3d6a74d-6018-4cef-8b82-3ae598195590 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:49.016231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3d6a74d-6018-4cef-8b82-3ae598195590 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:49.016967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3d6a74d-6018-4cef-8b82-3ae598195590 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:49.017403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3d6a74d-6018-4cef-8b82-3ae598195590 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:49.017828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3d6a74d-6018-4cef-8b82-3ae598195590 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:49.039991 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5aea4b04-e96e-4129-aaff-07891ebaae32 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048841 Sep 05 17:11:49.040603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 572/1160] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:48 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:49.048809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e3d6a74d-6018-4cef-8b82-3ae598195590 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047677 Sep 05 17:11:49.049399 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 589/1161] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:48 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:49.774304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2a914d06-7d06-438a-9697-56feb17b52e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:49.774851 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2a914d06-7d06-438a-9697-56feb17b52e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:49.781677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a914d06-7d06-438a-9697-56feb17b52e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:49.782182 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a914d06-7d06-438a-9697-56feb17b52e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:49.782633 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a914d06-7d06-438a-9697-56feb17b52e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:49.783349 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a914d06-7d06-438a-9697-56feb17b52e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:49.783854 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a914d06-7d06-438a-9697-56feb17b52e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:49.784329 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a914d06-7d06-438a-9697-56feb17b52e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:49.846964 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2a914d06-7d06-438a-9697-56feb17b52e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:49.856042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2a914d06-7d06-438a-9697-56feb17b52e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.088647 Sep 05 17:11:49.856644 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 573/1162] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:49 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:50.058457 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a940e01e-e480-499d-8dd6-5630bb97c347 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:50.061871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a940e01e-e480-499d-8dd6-5630bb97c347 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:50.065094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e99e70a4-3d56-48a8-b210-b97998f0ce58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:50.068540 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e99e70a4-3d56-48a8-b210-b97998f0ce58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:50.071801 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a940e01e-e480-499d-8dd6-5630bb97c347 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:50.072273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a940e01e-e480-499d-8dd6-5630bb97c347 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:50.072737 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a940e01e-e480-499d-8dd6-5630bb97c347 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:50.073433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a940e01e-e480-499d-8dd6-5630bb97c347 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:50.073917 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a940e01e-e480-499d-8dd6-5630bb97c347 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:50.074313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a940e01e-e480-499d-8dd6-5630bb97c347 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:50.075618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e99e70a4-3d56-48a8-b210-b97998f0ce58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:50.076174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e99e70a4-3d56-48a8-b210-b97998f0ce58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:50.076659 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e99e70a4-3d56-48a8-b210-b97998f0ce58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:50.077349 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e99e70a4-3d56-48a8-b210-b97998f0ce58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:50.077786 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e99e70a4-3d56-48a8-b210-b97998f0ce58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:50.078237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e99e70a4-3d56-48a8-b210-b97998f0ce58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:50.106113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a940e01e-e480-499d-8dd6-5630bb97c347 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055229 Sep 05 17:11:50.106689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 590/1163] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:50 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:50.109767 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e99e70a4-3d56-48a8-b210-b97998f0ce58 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051751 Sep 05 17:11:50.110363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 574/1164] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:50 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:50.883288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3a763fdc-eedb-46b2-9bb0-849225a0b600 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:50.884011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3a763fdc-eedb-46b2-9bb0-849225a0b600 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:50.891450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a763fdc-eedb-46b2-9bb0-849225a0b600 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:50.892022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a763fdc-eedb-46b2-9bb0-849225a0b600 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:50.892571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a763fdc-eedb-46b2-9bb0-849225a0b600 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:50.893413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a763fdc-eedb-46b2-9bb0-849225a0b600 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:50.893937 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a763fdc-eedb-46b2-9bb0-849225a0b600 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:50.894432 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a763fdc-eedb-46b2-9bb0-849225a0b600 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:50.959662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3a763fdc-eedb-46b2-9bb0-849225a0b600 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:50.968057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3a763fdc-eedb-46b2-9bb0-849225a0b600 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.090844 Sep 05 17:11:50.968673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 591/1165] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:50 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:51.122313 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2e7f3e0c-0ed6-4b87-9817-c52b0b23f303 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:51.124652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0768351e-d734-4843-a239-f32fb537fdc2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:51.125179 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2e7f3e0c-0ed6-4b87-9817-c52b0b23f303 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:51.127254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0768351e-d734-4843-a239-f32fb537fdc2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:51.134614 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2e7f3e0c-0ed6-4b87-9817-c52b0b23f303 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:51.135130 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2e7f3e0c-0ed6-4b87-9817-c52b0b23f303 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:51.135653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2e7f3e0c-0ed6-4b87-9817-c52b0b23f303 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:51.135835 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0768351e-d734-4843-a239-f32fb537fdc2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:51.136485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0768351e-d734-4843-a239-f32fb537fdc2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:51.136639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2e7f3e0c-0ed6-4b87-9817-c52b0b23f303 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:51.137026 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0768351e-d734-4843-a239-f32fb537fdc2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:51.137186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2e7f3e0c-0ed6-4b87-9817-c52b0b23f303 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:51.137633 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2e7f3e0c-0ed6-4b87-9817-c52b0b23f303 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:51.137885 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0768351e-d734-4843-a239-f32fb537fdc2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:51.138439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0768351e-d734-4843-a239-f32fb537fdc2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:51.138963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0768351e-d734-4843-a239-f32fb537fdc2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:51.171134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2e7f3e0c-0ed6-4b87-9817-c52b0b23f303 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055095 Sep 05 17:11:51.171844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0768351e-d734-4843-a239-f32fb537fdc2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052132 Sep 05 17:11:51.172044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 575/1166] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:51 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:51.172442 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 592/1167] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:51 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:51.996482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-44f97c9a-cd5c-4793-b235-e9fef87187a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:51.997487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-44f97c9a-cd5c-4793-b235-e9fef87187a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:52.007655 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-44f97c9a-cd5c-4793-b235-e9fef87187a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:52.008536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-44f97c9a-cd5c-4793-b235-e9fef87187a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:52.009251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-44f97c9a-cd5c-4793-b235-e9fef87187a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:52.010401 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-44f97c9a-cd5c-4793-b235-e9fef87187a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:52.011117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-44f97c9a-cd5c-4793-b235-e9fef87187a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:52.011859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-44f97c9a-cd5c-4793-b235-e9fef87187a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:52.081073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-44f97c9a-cd5c-4793-b235-e9fef87187a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:52.089556 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-44f97c9a-cd5c-4793-b235-e9fef87187a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.100246 Sep 05 17:11:52.090133 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 576/1168] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:51 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:52.189263 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3eaaf254-95a5-423f-9fc9-de8f019281af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:52.190203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4a95b732-dadc-4896-b894-442442d64733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:52.192755 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3eaaf254-95a5-423f-9fc9-de8f019281af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:52.193022 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4a95b732-dadc-4896-b894-442442d64733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:52.200389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3eaaf254-95a5-423f-9fc9-de8f019281af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:52.200576 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a95b732-dadc-4896-b894-442442d64733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:52.200863 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a95b732-dadc-4896-b894-442442d64733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:52.201016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3eaaf254-95a5-423f-9fc9-de8f019281af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:52.201285 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a95b732-dadc-4896-b894-442442d64733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:52.201441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3eaaf254-95a5-423f-9fc9-de8f019281af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:52.201969 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a95b732-dadc-4896-b894-442442d64733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:52.202114 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3eaaf254-95a5-423f-9fc9-de8f019281af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:52.202395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a95b732-dadc-4896-b894-442442d64733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:52.202543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3eaaf254-95a5-423f-9fc9-de8f019281af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:52.202806 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a95b732-dadc-4896-b894-442442d64733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:52.202919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3eaaf254-95a5-423f-9fc9-de8f019281af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:52.233151 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4a95b732-dadc-4896-b894-442442d64733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050095 Sep 05 17:11:52.233418 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3eaaf254-95a5-423f-9fc9-de8f019281af tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050851 Sep 05 17:11:52.237396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 577/1169] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:52 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:52.237577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 593/1170] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:52 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:53.117641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a0d1f333-6060-470a-8076-317e8ad9f6de tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:53.119016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a0d1f333-6060-470a-8076-317e8ad9f6de tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:53.129211 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0d1f333-6060-470a-8076-317e8ad9f6de tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:53.130046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0d1f333-6060-470a-8076-317e8ad9f6de tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:53.130818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0d1f333-6060-470a-8076-317e8ad9f6de tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:53.131998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0d1f333-6060-470a-8076-317e8ad9f6de tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:53.132790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0d1f333-6060-470a-8076-317e8ad9f6de tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:53.133508 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a0d1f333-6060-470a-8076-317e8ad9f6de tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:53.195392 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a0d1f333-6060-470a-8076-317e8ad9f6de tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:53.204359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a0d1f333-6060-470a-8076-317e8ad9f6de tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093331 Sep 05 17:11:53.204932 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 578/1171] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:53 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:53.245811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e639fb27-4ec0-4495-9841-faa53e2f466c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:53.246354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c4735057-0df9-4cf8-81d9-d0fb3473f32e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:53.248080 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e639fb27-4ec0-4495-9841-faa53e2f466c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:53.248223 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c4735057-0df9-4cf8-81d9-d0fb3473f32e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:53.254253 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4735057-0df9-4cf8-81d9-d0fb3473f32e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:53.254596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e639fb27-4ec0-4495-9841-faa53e2f466c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:53.254736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4735057-0df9-4cf8-81d9-d0fb3473f32e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:53.255094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e639fb27-4ec0-4495-9841-faa53e2f466c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:53.255272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4735057-0df9-4cf8-81d9-d0fb3473f32e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:53.255510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e639fb27-4ec0-4495-9841-faa53e2f466c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:53.255826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4735057-0df9-4cf8-81d9-d0fb3473f32e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:53.256218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e639fb27-4ec0-4495-9841-faa53e2f466c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:53.256342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4735057-0df9-4cf8-81d9-d0fb3473f32e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:53.256671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e639fb27-4ec0-4495-9841-faa53e2f466c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:53.256785 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4735057-0df9-4cf8-81d9-d0fb3473f32e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:53.257090 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e639fb27-4ec0-4495-9841-faa53e2f466c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:53.287474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c4735057-0df9-4cf8-81d9-d0fb3473f32e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045644 Sep 05 17:11:53.287743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e639fb27-4ec0-4495-9841-faa53e2f466c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046565 Sep 05 17:11:53.288037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 579/1172] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:53 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:53.288515 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 594/1173] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:53 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:54.227940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-69638dc8-9f06-4fbb-8eda-573c4b67d315 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:54.228599 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-69638dc8-9f06-4fbb-8eda-573c4b67d315 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:54.235676 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-69638dc8-9f06-4fbb-8eda-573c4b67d315 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:54.236188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-69638dc8-9f06-4fbb-8eda-573c4b67d315 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:54.236618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-69638dc8-9f06-4fbb-8eda-573c4b67d315 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:54.237309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-69638dc8-9f06-4fbb-8eda-573c4b67d315 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:54.237792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-69638dc8-9f06-4fbb-8eda-573c4b67d315 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:54.238209 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-69638dc8-9f06-4fbb-8eda-573c4b67d315 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:54.300250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cdd00ca1-cbb1-476a-a7d1-3460668cb8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:54.300971 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-69638dc8-9f06-4fbb-8eda-573c4b67d315 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:54.302470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cdd00ca1-cbb1-476a-a7d1-3460668cb8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:54.309418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-69638dc8-9f06-4fbb-8eda-573c4b67d315 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086032 Sep 05 17:11:54.309615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdd00ca1-cbb1-476a-a7d1-3460668cb8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:54.309892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdd00ca1-cbb1-476a-a7d1-3460668cb8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:54.310006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 580/1174] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:54 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:54.310319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdd00ca1-cbb1-476a-a7d1-3460668cb8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:54.311011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdd00ca1-cbb1-476a-a7d1-3460668cb8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:54.311455 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdd00ca1-cbb1-476a-a7d1-3460668cb8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:54.311958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdd00ca1-cbb1-476a-a7d1-3460668cb8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:54.318277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-18b33af1-d1bf-45d8-bb90-b340ade195e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:54.320745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-18b33af1-d1bf-45d8-bb90-b340ade195e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:54.326780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18b33af1-d1bf-45d8-bb90-b340ade195e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:54.327259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18b33af1-d1bf-45d8-bb90-b340ade195e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:54.327823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18b33af1-d1bf-45d8-bb90-b340ade195e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:54.328583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18b33af1-d1bf-45d8-bb90-b340ade195e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:54.329028 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18b33af1-d1bf-45d8-bb90-b340ade195e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:54.329429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18b33af1-d1bf-45d8-bb90-b340ade195e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:54.342862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cdd00ca1-cbb1-476a-a7d1-3460668cb8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046672 Sep 05 17:11:54.343466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 595/1175] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:54 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:54.359532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-18b33af1-d1bf-45d8-bb90-b340ade195e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048501 Sep 05 17:11:54.360061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 581/1176] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:54 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:55.337633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b1191e5b-d4c8-43d4-bb27-6ae9a7a1f630 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:55.338593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b1191e5b-d4c8-43d4-bb27-6ae9a7a1f630 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:55.350149 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1191e5b-d4c8-43d4-bb27-6ae9a7a1f630 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:55.350931 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1191e5b-d4c8-43d4-bb27-6ae9a7a1f630 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:55.351647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1191e5b-d4c8-43d4-bb27-6ae9a7a1f630 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:55.352537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1191e5b-d4c8-43d4-bb27-6ae9a7a1f630 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:55.352995 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1191e5b-d4c8-43d4-bb27-6ae9a7a1f630 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:55.353412 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1191e5b-d4c8-43d4-bb27-6ae9a7a1f630 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:55.357763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-871fd784-95f9-43a3-8d8a-bc3b699a08e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:55.359991 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-871fd784-95f9-43a3-8d8a-bc3b699a08e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:55.373815 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-871fd784-95f9-43a3-8d8a-bc3b699a08e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:55.374753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-871fd784-95f9-43a3-8d8a-bc3b699a08e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:55.374753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-871fd784-95f9-43a3-8d8a-bc3b699a08e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:55.375413 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-871fd784-95f9-43a3-8d8a-bc3b699a08e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:55.375859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-871fd784-95f9-43a3-8d8a-bc3b699a08e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:55.376276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-871fd784-95f9-43a3-8d8a-bc3b699a08e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:55.408522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-871fd784-95f9-43a3-8d8a-bc3b699a08e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054710 Sep 05 17:11:55.409436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 582/1177] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:55 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:55.416794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-62172c30-4666-435e-8b8a-a1b8c6b66b7b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:55.418743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-62172c30-4666-435e-8b8a-a1b8c6b66b7b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:55.419113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b1191e5b-d4c8-43d4-bb27-6ae9a7a1f630 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:55.424850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-62172c30-4666-435e-8b8a-a1b8c6b66b7b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:55.425328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-62172c30-4666-435e-8b8a-a1b8c6b66b7b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:55.425756 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-62172c30-4666-435e-8b8a-a1b8c6b66b7b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:55.426442 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-62172c30-4666-435e-8b8a-a1b8c6b66b7b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:55.426889 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-62172c30-4666-435e-8b8a-a1b8c6b66b7b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:55.427161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b1191e5b-d4c8-43d4-bb27-6ae9a7a1f630 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.097034 Sep 05 17:11:55.427316 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-62172c30-4666-435e-8b8a-a1b8c6b66b7b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:55.427733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 596/1178] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:55 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:55.453639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:11:55.458647 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-62172c30-4666-435e-8b8a-a1b8c6b66b7b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047504 Sep 05 17:11:55.459198 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 583/1179] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:55 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:56.421679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b1e8b3a6-cbf5-43b4-ad44-e9609a224894 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:56.423831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b1e8b3a6-cbf5-43b4-ad44-e9609a224894 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:56.431010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1e8b3a6-cbf5-43b4-ad44-e9609a224894 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:56.431489 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1e8b3a6-cbf5-43b4-ad44-e9609a224894 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:56.431908 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1e8b3a6-cbf5-43b4-ad44-e9609a224894 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:56.432638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1e8b3a6-cbf5-43b4-ad44-e9609a224894 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:56.433088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1e8b3a6-cbf5-43b4-ad44-e9609a224894 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:56.433499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1e8b3a6-cbf5-43b4-ad44-e9609a224894 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:56.449953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ca3c9ef6-83ea-4543-8bd4-be43a425077e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:56.450651 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ca3c9ef6-83ea-4543-8bd4-be43a425077e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:56.457570 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca3c9ef6-83ea-4543-8bd4-be43a425077e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:56.458188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca3c9ef6-83ea-4543-8bd4-be43a425077e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:56.458622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca3c9ef6-83ea-4543-8bd4-be43a425077e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:56.459321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca3c9ef6-83ea-4543-8bd4-be43a425077e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:56.459784 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca3c9ef6-83ea-4543-8bd4-be43a425077e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:56.460188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca3c9ef6-83ea-4543-8bd4-be43a425077e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:56.463623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b1e8b3a6-cbf5-43b4-ad44-e9609a224894 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045998 Sep 05 17:11:56.468605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 597/1180] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:56 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:56.472349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b416cc9e-9992-458c-a850-4246f1e2bed4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:56.474492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b416cc9e-9992-458c-a850-4246f1e2bed4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:56.481173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b416cc9e-9992-458c-a850-4246f1e2bed4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:56.481663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b416cc9e-9992-458c-a850-4246f1e2bed4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:56.482089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b416cc9e-9992-458c-a850-4246f1e2bed4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:56.482783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b416cc9e-9992-458c-a850-4246f1e2bed4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:56.483231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b416cc9e-9992-458c-a850-4246f1e2bed4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:56.483649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b416cc9e-9992-458c-a850-4246f1e2bed4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:56.498260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:11:56.514584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b416cc9e-9992-458c-a850-4246f1e2bed4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047375 Sep 05 17:11:56.515149 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 598/1181] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:56 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:56.528222 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ca3c9ef6-83ea-4543-8bd4-be43a425077e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:56.537877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ca3c9ef6-83ea-4543-8bd4-be43a425077e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092116 Sep 05 17:11:56.538444 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 584/1182] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:56 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:57.479572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b3c6177a-988c-49a8-ab54-c585dcc922bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:57.481805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b3c6177a-988c-49a8-ab54-c585dcc922bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:57.488796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3c6177a-988c-49a8-ab54-c585dcc922bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:57.489284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3c6177a-988c-49a8-ab54-c585dcc922bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:57.489712 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3c6177a-988c-49a8-ab54-c585dcc922bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:57.490409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3c6177a-988c-49a8-ab54-c585dcc922bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:57.490836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3c6177a-988c-49a8-ab54-c585dcc922bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:57.491332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3c6177a-988c-49a8-ab54-c585dcc922bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:57.521906 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b3c6177a-988c-49a8-ab54-c585dcc922bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049486 Sep 05 17:11:57.522654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 599/1183] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:57 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:57.527523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-174052df-5a0d-45ee-984f-c7eb5cfb3733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:57.529713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-174052df-5a0d-45ee-984f-c7eb5cfb3733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:57.536769 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174052df-5a0d-45ee-984f-c7eb5cfb3733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:57.537290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174052df-5a0d-45ee-984f-c7eb5cfb3733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:57.537718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174052df-5a0d-45ee-984f-c7eb5cfb3733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:57.538509 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174052df-5a0d-45ee-984f-c7eb5cfb3733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:57.539022 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174052df-5a0d-45ee-984f-c7eb5cfb3733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:57.540186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174052df-5a0d-45ee-984f-c7eb5cfb3733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:57.561598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b161e2fe-d5e7-4b2c-8a60-6ed9479ba8a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:57.562207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b161e2fe-d5e7-4b2c-8a60-6ed9479ba8a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:57.568436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b161e2fe-d5e7-4b2c-8a60-6ed9479ba8a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:57.568913 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b161e2fe-d5e7-4b2c-8a60-6ed9479ba8a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:57.569344 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b161e2fe-d5e7-4b2c-8a60-6ed9479ba8a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:57.570012 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b161e2fe-d5e7-4b2c-8a60-6ed9479ba8a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:57.570529 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b161e2fe-d5e7-4b2c-8a60-6ed9479ba8a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:57.570950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-174052df-5a0d-45ee-984f-c7eb5cfb3733 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047655 Sep 05 17:11:57.571074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b161e2fe-d5e7-4b2c-8a60-6ed9479ba8a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:57.571632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 585/1184] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:57 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:57.644849 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b161e2fe-d5e7-4b2c-8a60-6ed9479ba8a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:57.658084 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b161e2fe-d5e7-4b2c-8a60-6ed9479ba8a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.100486 Sep 05 17:11:57.658666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 600/1185] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:57 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:11:58.540975 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-df635295-7a0d-471d-bea5-800054fd8b95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:58.544370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-df635295-7a0d-471d-bea5-800054fd8b95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:58.555378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df635295-7a0d-471d-bea5-800054fd8b95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:58.555864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df635295-7a0d-471d-bea5-800054fd8b95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:58.556298 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df635295-7a0d-471d-bea5-800054fd8b95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:58.557014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df635295-7a0d-471d-bea5-800054fd8b95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:58.557462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df635295-7a0d-471d-bea5-800054fd8b95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:58.557879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df635295-7a0d-471d-bea5-800054fd8b95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:58.583399 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c6808f4e-97c3-466a-a828-79345fb6b9a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:58.585595 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c6808f4e-97c3-466a-a828-79345fb6b9a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:58.588262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-df635295-7a0d-471d-bea5-800054fd8b95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055810 Sep 05 17:11:58.588822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 586/1186] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:58 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:58.591642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6808f4e-97c3-466a-a828-79345fb6b9a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:58.592203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6808f4e-97c3-466a-a828-79345fb6b9a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:58.592751 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6808f4e-97c3-466a-a828-79345fb6b9a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:58.593512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6808f4e-97c3-466a-a828-79345fb6b9a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:58.593957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6808f4e-97c3-466a-a828-79345fb6b9a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:58.594371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6808f4e-97c3-466a-a828-79345fb6b9a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:58.624654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c6808f4e-97c3-466a-a828-79345fb6b9a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045316 Sep 05 17:11:58.625203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 601/1187] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:58 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:58.686052 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0b44cc1b-d3d2-4fa2-a5f3-0325d87b152e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:58.687012 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0b44cc1b-d3d2-4fa2-a5f3-0325d87b152e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:58.697229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b44cc1b-d3d2-4fa2-a5f3-0325d87b152e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:58.698051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b44cc1b-d3d2-4fa2-a5f3-0325d87b152e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:58.698776 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b44cc1b-d3d2-4fa2-a5f3-0325d87b152e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:58.699887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b44cc1b-d3d2-4fa2-a5f3-0325d87b152e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:58.700684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b44cc1b-d3d2-4fa2-a5f3-0325d87b152e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:58.701966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b44cc1b-d3d2-4fa2-a5f3-0325d87b152e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:58.772071 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0b44cc1b-d3d2-4fa2-a5f3-0325d87b152e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:58.780695 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0b44cc1b-d3d2-4fa2-a5f3-0325d87b152e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.101252 Sep 05 17:11:58.781269 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 587/1188] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:58 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:11:59.604428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-17acdc0c-243e-455c-95ee-3074c3059b55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:59.606560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-17acdc0c-243e-455c-95ee-3074c3059b55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:59.608612 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:11:59.608781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:11:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments (ip 10.222.0.23) !!! Sep 05 17:11:59.615294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17acdc0c-243e-455c-95ee-3074c3059b55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:59.615776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17acdc0c-243e-455c-95ee-3074c3059b55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:59.616247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17acdc0c-243e-455c-95ee-3074c3059b55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:59.616925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17acdc0c-243e-455c-95ee-3074c3059b55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:59.617524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17acdc0c-243e-455c-95ee-3074c3059b55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:59.618046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17acdc0c-243e-455c-95ee-3074c3059b55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:59.637607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1b343ef0-555e-4538-897c-15ff94d06f85 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:59.639732 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1b343ef0-555e-4538-897c-15ff94d06f85 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:59.646962 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b343ef0-555e-4538-897c-15ff94d06f85 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:59.647454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b343ef0-555e-4538-897c-15ff94d06f85 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:59.647881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b343ef0-555e-4538-897c-15ff94d06f85 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:59.648616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b343ef0-555e-4538-897c-15ff94d06f85 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:59.649036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b343ef0-555e-4538-897c-15ff94d06f85 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:59.649451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b343ef0-555e-4538-897c-15ff94d06f85 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:59.651041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-17acdc0c-243e-455c-95ee-3074c3059b55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052683 Sep 05 17:11:59.651636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 602/1189] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:11:59 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:11:59.678777 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1b343ef0-555e-4538-897c-15ff94d06f85 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045235 Sep 05 17:11:59.679324 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 588/1190] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:11:59 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:11:59.807063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f8913d0f-45f0-4b2b-b9cd-3c23f9dd350f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:11:59.808126 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f8913d0f-45f0-4b2b-b9cd-3c23f9dd350f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:11:59.818275 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8913d0f-45f0-4b2b-b9cd-3c23f9dd350f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:59.819076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8913d0f-45f0-4b2b-b9cd-3c23f9dd350f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:59.819794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8913d0f-45f0-4b2b-b9cd-3c23f9dd350f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:59.820858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8913d0f-45f0-4b2b-b9cd-3c23f9dd350f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:11:59.821369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8913d0f-45f0-4b2b-b9cd-3c23f9dd350f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:11:59.821793 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8913d0f-45f0-4b2b-b9cd-3c23f9dd350f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:11:59.894606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f8913d0f-45f0-4b2b-b9cd-3c23f9dd350f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:11:59.906291 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f8913d0f-45f0-4b2b-b9cd-3c23f9dd350f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.105702 Sep 05 17:11:59.907076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 603/1191] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:11:59 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:00.667731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9410de51-2a0d-4a68-a5e8-da4fba957dbb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:00.670419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9410de51-2a0d-4a68-a5e8-da4fba957dbb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:00.679200 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9410de51-2a0d-4a68-a5e8-da4fba957dbb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:00.679900 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9410de51-2a0d-4a68-a5e8-da4fba957dbb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:00.680534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9410de51-2a0d-4a68-a5e8-da4fba957dbb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:00.681441 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9410de51-2a0d-4a68-a5e8-da4fba957dbb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:00.682038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9410de51-2a0d-4a68-a5e8-da4fba957dbb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:00.682587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9410de51-2a0d-4a68-a5e8-da4fba957dbb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:00.693755 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-34328fd7-5d7e-4dab-ba26-a953523f865d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:00.696773 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-34328fd7-5d7e-4dab-ba26-a953523f865d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:00.703517 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34328fd7-5d7e-4dab-ba26-a953523f865d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:00.703994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34328fd7-5d7e-4dab-ba26-a953523f865d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:00.704442 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34328fd7-5d7e-4dab-ba26-a953523f865d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:00.705128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34328fd7-5d7e-4dab-ba26-a953523f865d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:00.705575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34328fd7-5d7e-4dab-ba26-a953523f865d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:00.705953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34328fd7-5d7e-4dab-ba26-a953523f865d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:00.716936 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9410de51-2a0d-4a68-a5e8-da4fba957dbb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055385 Sep 05 17:12:00.717758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 589/1192] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:00 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:00.735701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-34328fd7-5d7e-4dab-ba26-a953523f865d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047452 Sep 05 17:12:00.736311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 604/1193] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:00 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:00.935160 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a32d9645-535d-44a2-ae49-3206ff8ce29f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:00.935752 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a32d9645-535d-44a2-ae49-3206ff8ce29f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:00.943939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a32d9645-535d-44a2-ae49-3206ff8ce29f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:00.944602 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a32d9645-535d-44a2-ae49-3206ff8ce29f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:00.945146 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a32d9645-535d-44a2-ae49-3206ff8ce29f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:00.946574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a32d9645-535d-44a2-ae49-3206ff8ce29f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:00.947175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a32d9645-535d-44a2-ae49-3206ff8ce29f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:00.947695 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a32d9645-535d-44a2-ae49-3206ff8ce29f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:01.014821 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a32d9645-535d-44a2-ae49-3206ff8ce29f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:01.022742 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a32d9645-535d-44a2-ae49-3206ff8ce29f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093527 Sep 05 17:12:01.023300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 590/1194] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:00 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:01.735818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b0a521ac-a3af-4726-ab56-5c1218073704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:01.739192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b0a521ac-a3af-4726-ab56-5c1218073704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:01.742207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=84 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:12:01.748904 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b0a521ac-a3af-4726-ab56-5c1218073704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:01.749385 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b0a521ac-a3af-4726-ab56-5c1218073704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:01.749819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b0a521ac-a3af-4726-ab56-5c1218073704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:01.749978 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4045efb7-7f41-4e76-a3d9-1e29496edb53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:01.750479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b0a521ac-a3af-4726-ab56-5c1218073704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:01.750957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b0a521ac-a3af-4726-ab56-5c1218073704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:01.751375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b0a521ac-a3af-4726-ab56-5c1218073704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:01.751975 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4045efb7-7f41-4e76-a3d9-1e29496edb53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:01.758157 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4045efb7-7f41-4e76-a3d9-1e29496edb53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:01.758656 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4045efb7-7f41-4e76-a3d9-1e29496edb53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:01.759080 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4045efb7-7f41-4e76-a3d9-1e29496edb53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:01.759753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4045efb7-7f41-4e76-a3d9-1e29496edb53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:01.760341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4045efb7-7f41-4e76-a3d9-1e29496edb53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:01.760766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4045efb7-7f41-4e76-a3d9-1e29496edb53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:01.781727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b0a521ac-a3af-4726-ab56-5c1218073704 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053861 Sep 05 17:12:01.782302 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 605/1195] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:01 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:01.790183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4045efb7-7f41-4e76-a3d9-1e29496edb53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044846 Sep 05 17:12:01.790895 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 591/1196] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:01 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:02.050724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-81f9029c-430c-4c47-b00c-df7dd669de92 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:02.052619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-81f9029c-430c-4c47-b00c-df7dd669de92 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:02.062966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81f9029c-430c-4c47-b00c-df7dd669de92 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:02.063808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81f9029c-430c-4c47-b00c-df7dd669de92 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:02.064618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81f9029c-430c-4c47-b00c-df7dd669de92 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:02.065740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81f9029c-430c-4c47-b00c-df7dd669de92 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:02.066481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81f9029c-430c-4c47-b00c-df7dd669de92 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:02.067166 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81f9029c-430c-4c47-b00c-df7dd669de92 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:02.132733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-81f9029c-430c-4c47-b00c-df7dd669de92 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:02.141115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-81f9029c-430c-4c47-b00c-df7dd669de92 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.097039 Sep 05 17:12:02.141672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 606/1197] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:02 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:02.799435 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d143b87a-9ac1-4be6-a5e0-a37a524ee983 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:02.802621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d143b87a-9ac1-4be6-a5e0-a37a524ee983 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:02.806107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-25387981-deff-4c54-bd2e-5056c6d3c4b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:02.809755 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-25387981-deff-4c54-bd2e-5056c6d3c4b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:02.813151 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d143b87a-9ac1-4be6-a5e0-a37a524ee983 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:02.813862 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d143b87a-9ac1-4be6-a5e0-a37a524ee983 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:02.814594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d143b87a-9ac1-4be6-a5e0-a37a524ee983 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:02.815665 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d143b87a-9ac1-4be6-a5e0-a37a524ee983 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:02.816382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d143b87a-9ac1-4be6-a5e0-a37a524ee983 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:02.817024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d143b87a-9ac1-4be6-a5e0-a37a524ee983 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:02.819770 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25387981-deff-4c54-bd2e-5056c6d3c4b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:02.820816 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25387981-deff-4c54-bd2e-5056c6d3c4b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:02.821480 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25387981-deff-4c54-bd2e-5056c6d3c4b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:02.822637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25387981-deff-4c54-bd2e-5056c6d3c4b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:02.823093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25387981-deff-4c54-bd2e-5056c6d3c4b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:02.823507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25387981-deff-4c54-bd2e-5056c6d3c4b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:02.854986 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d143b87a-9ac1-4be6-a5e0-a37a524ee983 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062735 Sep 05 17:12:02.855557 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 592/1198] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:02 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:02.856546 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-25387981-deff-4c54-bd2e-5056c6d3c4b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056335 Sep 05 17:12:02.857113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 607/1199] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:02 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:03.163011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4c2e343c-35da-400c-a83e-32753302584f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:03.163611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4c2e343c-35da-400c-a83e-32753302584f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:03.169667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c2e343c-35da-400c-a83e-32753302584f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:03.170135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c2e343c-35da-400c-a83e-32753302584f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:03.170553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c2e343c-35da-400c-a83e-32753302584f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:03.171225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c2e343c-35da-400c-a83e-32753302584f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:03.171658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c2e343c-35da-400c-a83e-32753302584f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:03.172065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c2e343c-35da-400c-a83e-32753302584f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:03.236417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4c2e343c-35da-400c-a83e-32753302584f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:03.244344 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4c2e343c-35da-400c-a83e-32753302584f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.085288 Sep 05 17:12:03.244940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 593/1200] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:03 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:03.870994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8a38410e-0bb1-4e2c-87a1-0c59c2f1f7ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:03.871992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a408ab44-e6d4-4385-8977-ee1c528059b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:03.873158 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8a38410e-0bb1-4e2c-87a1-0c59c2f1f7ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:03.874114 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a408ab44-e6d4-4385-8977-ee1c528059b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:03.879984 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a38410e-0bb1-4e2c-87a1-0c59c2f1f7ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:03.880493 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a38410e-0bb1-4e2c-87a1-0c59c2f1f7ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:03.880852 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a408ab44-e6d4-4385-8977-ee1c528059b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:03.880969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a38410e-0bb1-4e2c-87a1-0c59c2f1f7ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:03.881328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a408ab44-e6d4-4385-8977-ee1c528059b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:03.881590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a38410e-0bb1-4e2c-87a1-0c59c2f1f7ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:03.881750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a408ab44-e6d4-4385-8977-ee1c528059b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:03.882032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a38410e-0bb1-4e2c-87a1-0c59c2f1f7ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:03.882431 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a408ab44-e6d4-4385-8977-ee1c528059b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:03.882535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a38410e-0bb1-4e2c-87a1-0c59c2f1f7ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:03.882871 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a408ab44-e6d4-4385-8977-ee1c528059b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:03.883626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a408ab44-e6d4-4385-8977-ee1c528059b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:03.912503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8a38410e-0bb1-4e2c-87a1-0c59c2f1f7ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046926 Sep 05 17:12:03.913053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 608/1201] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:03 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:03.913647 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a408ab44-e6d4-4385-8977-ee1c528059b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046938 Sep 05 17:12:03.914203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 594/1202] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:03 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:04.268647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-10aaa7e4-b688-4b44-b8ec-fa677708a8db tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:04.269161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-10aaa7e4-b688-4b44-b8ec-fa677708a8db tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:04.277844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10aaa7e4-b688-4b44-b8ec-fa677708a8db tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:04.278330 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10aaa7e4-b688-4b44-b8ec-fa677708a8db tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:04.278766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10aaa7e4-b688-4b44-b8ec-fa677708a8db tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:04.279458 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10aaa7e4-b688-4b44-b8ec-fa677708a8db tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:04.279908 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10aaa7e4-b688-4b44-b8ec-fa677708a8db tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:04.280512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10aaa7e4-b688-4b44-b8ec-fa677708a8db tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:04.345141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-10aaa7e4-b688-4b44-b8ec-fa677708a8db tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:04.353856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-10aaa7e4-b688-4b44-b8ec-fa677708a8db tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089741 Sep 05 17:12:04.354434 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 609/1203] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:04 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:04.927686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ffd65b7b-84ec-4178-a0c1-410323981cae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:04.928473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a24ff0e8-439a-47bc-8148-8b723a188aa4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:04.930298 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ffd65b7b-84ec-4178-a0c1-410323981cae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:04.930758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a24ff0e8-439a-47bc-8148-8b723a188aa4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:04.933374 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=86 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:12:04.939002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a24ff0e8-439a-47bc-8148-8b723a188aa4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:04.939603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a24ff0e8-439a-47bc-8148-8b723a188aa4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:04.940140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a24ff0e8-439a-47bc-8148-8b723a188aa4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:04.941029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a24ff0e8-439a-47bc-8148-8b723a188aa4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:04.941586 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a24ff0e8-439a-47bc-8148-8b723a188aa4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:04.942103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a24ff0e8-439a-47bc-8148-8b723a188aa4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:04.943263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ffd65b7b-84ec-4178-a0c1-410323981cae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:04.943860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ffd65b7b-84ec-4178-a0c1-410323981cae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:04.944451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ffd65b7b-84ec-4178-a0c1-410323981cae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:04.945303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ffd65b7b-84ec-4178-a0c1-410323981cae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:04.945855 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ffd65b7b-84ec-4178-a0c1-410323981cae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:04.946367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ffd65b7b-84ec-4178-a0c1-410323981cae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:04.973811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a24ff0e8-439a-47bc-8148-8b723a188aa4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050977 Sep 05 17:12:04.974950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 610/1204] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:04 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:12:04.976926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ffd65b7b-84ec-4178-a0c1-410323981cae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054403 Sep 05 17:12:04.977489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 595/1205] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:04 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:05.381306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bee5ceff-e67e-4797-903d-08120c1d2de9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:05.382386 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bee5ceff-e67e-4797-903d-08120c1d2de9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:05.393989 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bee5ceff-e67e-4797-903d-08120c1d2de9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:05.394829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bee5ceff-e67e-4797-903d-08120c1d2de9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:05.395557 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bee5ceff-e67e-4797-903d-08120c1d2de9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:05.396803 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bee5ceff-e67e-4797-903d-08120c1d2de9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:05.397547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bee5ceff-e67e-4797-903d-08120c1d2de9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:05.398312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bee5ceff-e67e-4797-903d-08120c1d2de9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:05.467261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bee5ceff-e67e-4797-903d-08120c1d2de9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:05.481170 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bee5ceff-e67e-4797-903d-08120c1d2de9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.106454 Sep 05 17:12:05.481875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 611/1206] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:05 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:05.992238 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d8972fb8-f26e-4f3f-9cab-c17a458838e4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:05.993304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-154cbea2-334a-49ea-80f1-e92c6651ac48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:05.995355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d8972fb8-f26e-4f3f-9cab-c17a458838e4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:05.996171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-154cbea2-334a-49ea-80f1-e92c6651ac48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:06.002238 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d8972fb8-f26e-4f3f-9cab-c17a458838e4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:06.002407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-154cbea2-334a-49ea-80f1-e92c6651ac48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:06.002711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d8972fb8-f26e-4f3f-9cab-c17a458838e4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:06.002869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-154cbea2-334a-49ea-80f1-e92c6651ac48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:06.003131 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d8972fb8-f26e-4f3f-9cab-c17a458838e4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:06.003287 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-154cbea2-334a-49ea-80f1-e92c6651ac48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:06.003816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d8972fb8-f26e-4f3f-9cab-c17a458838e4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:06.003963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-154cbea2-334a-49ea-80f1-e92c6651ac48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:06.004300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d8972fb8-f26e-4f3f-9cab-c17a458838e4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:06.004464 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-154cbea2-334a-49ea-80f1-e92c6651ac48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:06.004709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d8972fb8-f26e-4f3f-9cab-c17a458838e4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:06.004855 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-154cbea2-334a-49ea-80f1-e92c6651ac48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:06.037195 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-154cbea2-334a-49ea-80f1-e92c6651ac48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050381 Sep 05 17:12:06.038070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 612/1207] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:05 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:06.188306 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d8972fb8-f26e-4f3f-9cab-c17a458838e4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202991 Sep 05 17:12:06.188890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 596/1208] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:05 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:06.507747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-54268ef4-a227-426e-8e14-00429650124c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:06.508713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-54268ef4-a227-426e-8e14-00429650124c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:06.515738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54268ef4-a227-426e-8e14-00429650124c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:06.516248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54268ef4-a227-426e-8e14-00429650124c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:06.516669 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54268ef4-a227-426e-8e14-00429650124c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:06.517350 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54268ef4-a227-426e-8e14-00429650124c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:06.517796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54268ef4-a227-426e-8e14-00429650124c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:06.518214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54268ef4-a227-426e-8e14-00429650124c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:06.579536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-54268ef4-a227-426e-8e14-00429650124c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:06.587557 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-54268ef4-a227-426e-8e14-00429650124c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.085849 Sep 05 17:12:06.588171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 613/1209] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:06 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:07.050035 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c876887d-b6bf-4b65-941b-92c3cf55064f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:07.052133 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c876887d-b6bf-4b65-941b-92c3cf55064f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:07.058911 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c876887d-b6bf-4b65-941b-92c3cf55064f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:07.059386 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c876887d-b6bf-4b65-941b-92c3cf55064f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:07.059808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c876887d-b6bf-4b65-941b-92c3cf55064f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:07.060530 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c876887d-b6bf-4b65-941b-92c3cf55064f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:07.060971 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c876887d-b6bf-4b65-941b-92c3cf55064f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:07.061365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c876887d-b6bf-4b65-941b-92c3cf55064f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:07.091233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c876887d-b6bf-4b65-941b-92c3cf55064f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045230 Sep 05 17:12:07.091767 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 597/1210] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:07 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:07.205294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f51d222b-32df-46ef-9784-da523701ddf6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:07.208796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f51d222b-32df-46ef-9784-da523701ddf6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:07.220199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f51d222b-32df-46ef-9784-da523701ddf6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:07.221000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f51d222b-32df-46ef-9784-da523701ddf6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:07.221702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f51d222b-32df-46ef-9784-da523701ddf6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:07.222824 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f51d222b-32df-46ef-9784-da523701ddf6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:07.223556 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f51d222b-32df-46ef-9784-da523701ddf6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:07.224249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f51d222b-32df-46ef-9784-da523701ddf6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:07.255721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f51d222b-32df-46ef-9784-da523701ddf6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057180 Sep 05 17:12:07.256292 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 614/1211] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:07 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:07.609718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-403e6672-5493-4d35-91af-2312ef0f6856 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:07.610325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-403e6672-5493-4d35-91af-2312ef0f6856 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:07.616861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-403e6672-5493-4d35-91af-2312ef0f6856 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:07.617340 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-403e6672-5493-4d35-91af-2312ef0f6856 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:07.617747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-403e6672-5493-4d35-91af-2312ef0f6856 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:07.618469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-403e6672-5493-4d35-91af-2312ef0f6856 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:07.618920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-403e6672-5493-4d35-91af-2312ef0f6856 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:07.619465 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-403e6672-5493-4d35-91af-2312ef0f6856 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:07.693733 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-403e6672-5493-4d35-91af-2312ef0f6856 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:07.705760 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-403e6672-5493-4d35-91af-2312ef0f6856 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.099744 Sep 05 17:12:07.706507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 598/1212] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:07 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:08.108172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3aa9eb01-8968-48c5-b641-a82b43a1f22f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:08.111067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3aa9eb01-8968-48c5-b641-a82b43a1f22f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:08.119524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3aa9eb01-8968-48c5-b641-a82b43a1f22f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:08.120340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3aa9eb01-8968-48c5-b641-a82b43a1f22f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:08.120920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3aa9eb01-8968-48c5-b641-a82b43a1f22f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:08.121843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3aa9eb01-8968-48c5-b641-a82b43a1f22f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:08.122446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3aa9eb01-8968-48c5-b641-a82b43a1f22f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:08.123009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3aa9eb01-8968-48c5-b641-a82b43a1f22f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:08.126197 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:12:08.157068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3aa9eb01-8968-48c5-b641-a82b43a1f22f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054814 Sep 05 17:12:08.157624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 615/1213] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:08 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:08.272468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-11f455aa-5dfe-403e-9b4e-5987f365248f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:08.276063 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-11f455aa-5dfe-403e-9b4e-5987f365248f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:08.283399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11f455aa-5dfe-403e-9b4e-5987f365248f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:08.283856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11f455aa-5dfe-403e-9b4e-5987f365248f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:08.284328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11f455aa-5dfe-403e-9b4e-5987f365248f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:08.285018 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11f455aa-5dfe-403e-9b4e-5987f365248f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:08.285467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11f455aa-5dfe-403e-9b4e-5987f365248f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:08.285885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11f455aa-5dfe-403e-9b4e-5987f365248f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:08.317282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-11f455aa-5dfe-403e-9b4e-5987f365248f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051589 Sep 05 17:12:08.317822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 599/1214] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:08 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:08.734481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cf1eed70-4273-4cb1-b694-0d39303e19bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:08.735210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cf1eed70-4273-4cb1-b694-0d39303e19bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:08.743623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf1eed70-4273-4cb1-b694-0d39303e19bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:08.744587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf1eed70-4273-4cb1-b694-0d39303e19bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:08.745162 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf1eed70-4273-4cb1-b694-0d39303e19bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:08.746074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf1eed70-4273-4cb1-b694-0d39303e19bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:08.746663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf1eed70-4273-4cb1-b694-0d39303e19bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:08.747261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf1eed70-4273-4cb1-b694-0d39303e19bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:08.815151 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cf1eed70-4273-4cb1-b694-0d39303e19bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:08.823668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cf1eed70-4273-4cb1-b694-0d39303e19bb tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095484 Sep 05 17:12:08.824259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 616/1215] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:08 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:09.177492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8da41a65-ba8f-4815-ad72-b03d741d86fb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:09.180932 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8da41a65-ba8f-4815-ad72-b03d741d86fb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:09.187710 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8da41a65-ba8f-4815-ad72-b03d741d86fb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:09.188199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8da41a65-ba8f-4815-ad72-b03d741d86fb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:09.188652 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8da41a65-ba8f-4815-ad72-b03d741d86fb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:09.189341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8da41a65-ba8f-4815-ad72-b03d741d86fb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:09.189792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8da41a65-ba8f-4815-ad72-b03d741d86fb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:09.190216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8da41a65-ba8f-4815-ad72-b03d741d86fb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:09.207916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:12:09.221446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8da41a65-ba8f-4815-ad72-b03d741d86fb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050845 Sep 05 17:12:09.222318 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 600/1216] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:09 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:09.334307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f94ced73-86f3-4ca1-923b-0f64c9ea7fbd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:09.338195 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f94ced73-86f3-4ca1-923b-0f64c9ea7fbd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:09.348493 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f94ced73-86f3-4ca1-923b-0f64c9ea7fbd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:09.349264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f94ced73-86f3-4ca1-923b-0f64c9ea7fbd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:09.350353 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f94ced73-86f3-4ca1-923b-0f64c9ea7fbd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:09.351468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f94ced73-86f3-4ca1-923b-0f64c9ea7fbd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:09.352213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f94ced73-86f3-4ca1-923b-0f64c9ea7fbd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:09.352925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f94ced73-86f3-4ca1-923b-0f64c9ea7fbd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:09.386388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f94ced73-86f3-4ca1-923b-0f64c9ea7fbd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058740 Sep 05 17:12:09.386932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 617/1217] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:09 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:09.850908 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ac23f51c-601c-4a5b-bc0a-507b67b03ac1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:09.851941 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ac23f51c-601c-4a5b-bc0a-507b67b03ac1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:09.863110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac23f51c-601c-4a5b-bc0a-507b67b03ac1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:09.863925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac23f51c-601c-4a5b-bc0a-507b67b03ac1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:09.864699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac23f51c-601c-4a5b-bc0a-507b67b03ac1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:09.865795 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac23f51c-601c-4a5b-bc0a-507b67b03ac1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:09.866596 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac23f51c-601c-4a5b-bc0a-507b67b03ac1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:09.867346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac23f51c-601c-4a5b-bc0a-507b67b03ac1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:09.933667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ac23f51c-601c-4a5b-bc0a-507b67b03ac1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:09.946239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ac23f51c-601c-4a5b-bc0a-507b67b03ac1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.102154 Sep 05 17:12:09.947062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 601/1218] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:09 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:10.239471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-50516b1b-c38a-439e-b945-b0ae099f3d38 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:10.242878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-50516b1b-c38a-439e-b945-b0ae099f3d38 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:10.253802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50516b1b-c38a-439e-b945-b0ae099f3d38 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:10.254602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50516b1b-c38a-439e-b945-b0ae099f3d38 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:10.255325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50516b1b-c38a-439e-b945-b0ae099f3d38 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:10.256623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50516b1b-c38a-439e-b945-b0ae099f3d38 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:10.257378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50516b1b-c38a-439e-b945-b0ae099f3d38 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:10.258086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50516b1b-c38a-439e-b945-b0ae099f3d38 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:10.289470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-50516b1b-c38a-439e-b945-b0ae099f3d38 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056880 Sep 05 17:12:10.290031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 618/1219] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:10 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:10.399492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5d2a85c0-8dba-4989-b69c-219e8cc5c3d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:10.401832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5d2a85c0-8dba-4989-b69c-219e8cc5c3d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:10.408403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d2a85c0-8dba-4989-b69c-219e8cc5c3d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:10.408880 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d2a85c0-8dba-4989-b69c-219e8cc5c3d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:10.409304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d2a85c0-8dba-4989-b69c-219e8cc5c3d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:10.409980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d2a85c0-8dba-4989-b69c-219e8cc5c3d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:10.410426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d2a85c0-8dba-4989-b69c-219e8cc5c3d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:10.410835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d2a85c0-8dba-4989-b69c-219e8cc5c3d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:10.442248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5d2a85c0-8dba-4989-b69c-219e8cc5c3d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046836 Sep 05 17:12:10.442813 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 602/1220] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:10 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:10.973953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-83a70fdd-0729-4c82-a47c-9f09c383c8a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:10.975550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-83a70fdd-0729-4c82-a47c-9f09c383c8a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:10.982935 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83a70fdd-0729-4c82-a47c-9f09c383c8a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:10.983415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83a70fdd-0729-4c82-a47c-9f09c383c8a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:10.983847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83a70fdd-0729-4c82-a47c-9f09c383c8a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:10.984605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83a70fdd-0729-4c82-a47c-9f09c383c8a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:10.985058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83a70fdd-0729-4c82-a47c-9f09c383c8a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:10.985475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83a70fdd-0729-4c82-a47c-9f09c383c8a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:11.045542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-83a70fdd-0729-4c82-a47c-9f09c383c8a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:11.053774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-83a70fdd-0729-4c82-a47c-9f09c383c8a1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086557 Sep 05 17:12:11.054339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 619/1221] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:10 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:11.307116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-11fb98d4-1b13-4c44-80d8-c3cc72becca7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:11.309349 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-11fb98d4-1b13-4c44-80d8-c3cc72becca7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:11.316573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11fb98d4-1b13-4c44-80d8-c3cc72becca7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:11.317074 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11fb98d4-1b13-4c44-80d8-c3cc72becca7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:11.317514 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11fb98d4-1b13-4c44-80d8-c3cc72becca7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:11.318218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11fb98d4-1b13-4c44-80d8-c3cc72becca7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:11.318686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11fb98d4-1b13-4c44-80d8-c3cc72becca7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:11.319121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-11fb98d4-1b13-4c44-80d8-c3cc72becca7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:11.350359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-11fb98d4-1b13-4c44-80d8-c3cc72becca7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050221 Sep 05 17:12:11.350927 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 603/1222] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:11 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:11.459515 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8b10ef25-7b40-41c4-9b7f-d75ebc01f0a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:11.463142 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8b10ef25-7b40-41c4-9b7f-d75ebc01f0a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:11.470600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b10ef25-7b40-41c4-9b7f-d75ebc01f0a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:11.471082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b10ef25-7b40-41c4-9b7f-d75ebc01f0a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:11.471512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b10ef25-7b40-41c4-9b7f-d75ebc01f0a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:11.472298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b10ef25-7b40-41c4-9b7f-d75ebc01f0a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:11.472760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b10ef25-7b40-41c4-9b7f-d75ebc01f0a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:11.473177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b10ef25-7b40-41c4-9b7f-d75ebc01f0a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:11.503811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8b10ef25-7b40-41c4-9b7f-d75ebc01f0a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051262 Sep 05 17:12:11.504404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 620/1223] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:11 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:12.080706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f87e02b3-eeff-4dcd-a550-2dba34f6efd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:12.081736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f87e02b3-eeff-4dcd-a550-2dba34f6efd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:12.090554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f87e02b3-eeff-4dcd-a550-2dba34f6efd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:12.091030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f87e02b3-eeff-4dcd-a550-2dba34f6efd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:12.091440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f87e02b3-eeff-4dcd-a550-2dba34f6efd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:12.092133 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f87e02b3-eeff-4dcd-a550-2dba34f6efd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:12.092609 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f87e02b3-eeff-4dcd-a550-2dba34f6efd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:12.093034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f87e02b3-eeff-4dcd-a550-2dba34f6efd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:12.164559 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f87e02b3-eeff-4dcd-a550-2dba34f6efd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:12.172306 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f87e02b3-eeff-4dcd-a550-2dba34f6efd2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098288 Sep 05 17:12:12.172834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 604/1224] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:12 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:12.365056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1cecb5bd-d8a3-4e00-9f94-7dbfb2b5e1bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:12.367185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1cecb5bd-d8a3-4e00-9f94-7dbfb2b5e1bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:12.373800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cecb5bd-d8a3-4e00-9f94-7dbfb2b5e1bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:12.374293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cecb5bd-d8a3-4e00-9f94-7dbfb2b5e1bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:12.374718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cecb5bd-d8a3-4e00-9f94-7dbfb2b5e1bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:12.375379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cecb5bd-d8a3-4e00-9f94-7dbfb2b5e1bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:12.375852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cecb5bd-d8a3-4e00-9f94-7dbfb2b5e1bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:12.376296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cecb5bd-d8a3-4e00-9f94-7dbfb2b5e1bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:12.406765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1cecb5bd-d8a3-4e00-9f94-7dbfb2b5e1bb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045918 Sep 05 17:12:12.407304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 621/1225] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:12 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:12.524118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3cbb1b48-8282-43cf-9599-f966a35407c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:12.528749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3cbb1b48-8282-43cf-9599-f966a35407c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:12.540214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cbb1b48-8282-43cf-9599-f966a35407c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:12.541169 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cbb1b48-8282-43cf-9599-f966a35407c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:12.541624 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cbb1b48-8282-43cf-9599-f966a35407c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:12.542326 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cbb1b48-8282-43cf-9599-f966a35407c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:12.542802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cbb1b48-8282-43cf-9599-f966a35407c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:12.543196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cbb1b48-8282-43cf-9599-f966a35407c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:12.573239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3cbb1b48-8282-43cf-9599-f966a35407c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056409 Sep 05 17:12:12.573800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 605/1226] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:12 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:13.196109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9d35b4b8-fc70-42f8-b8d8-9d0e201ae4af tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:13.196745 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9d35b4b8-fc70-42f8-b8d8-9d0e201ae4af tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:13.203355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d35b4b8-fc70-42f8-b8d8-9d0e201ae4af tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:13.203835 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d35b4b8-fc70-42f8-b8d8-9d0e201ae4af tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:13.204329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d35b4b8-fc70-42f8-b8d8-9d0e201ae4af tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:13.205023 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d35b4b8-fc70-42f8-b8d8-9d0e201ae4af tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:13.205473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d35b4b8-fc70-42f8-b8d8-9d0e201ae4af tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:13.205887 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d35b4b8-fc70-42f8-b8d8-9d0e201ae4af tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:13.269357 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9d35b4b8-fc70-42f8-b8d8-9d0e201ae4af tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:13.277784 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9d35b4b8-fc70-42f8-b8d8-9d0e201ae4af tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.085696 Sep 05 17:12:13.278346 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 622/1227] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:13 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:13.423578 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-25f0a259-3801-453d-9979-38814d63e612 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:13.426679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-25f0a259-3801-453d-9979-38814d63e612 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:13.434870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25f0a259-3801-453d-9979-38814d63e612 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:13.435350 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25f0a259-3801-453d-9979-38814d63e612 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:13.435777 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25f0a259-3801-453d-9979-38814d63e612 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:13.436503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25f0a259-3801-453d-9979-38814d63e612 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:13.436947 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25f0a259-3801-453d-9979-38814d63e612 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:13.437363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25f0a259-3801-453d-9979-38814d63e612 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:13.468142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-25f0a259-3801-453d-9979-38814d63e612 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051516 Sep 05 17:12:13.468935 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 606/1228] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:13 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:13.589790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7db37754-b0b3-41d6-a350-93438a1d3cce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:13.592391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7db37754-b0b3-41d6-a350-93438a1d3cce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:13.600076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7db37754-b0b3-41d6-a350-93438a1d3cce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:13.600694 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7db37754-b0b3-41d6-a350-93438a1d3cce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:13.601199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7db37754-b0b3-41d6-a350-93438a1d3cce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:13.602008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7db37754-b0b3-41d6-a350-93438a1d3cce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:13.602540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7db37754-b0b3-41d6-a350-93438a1d3cce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:13.603038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7db37754-b0b3-41d6-a350-93438a1d3cce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:13.635025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7db37754-b0b3-41d6-a350-93438a1d3cce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051544 Sep 05 17:12:13.635568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 623/1229] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:13 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:14.308103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9ec7ff3a-ee29-42fc-b04c-06b2e76e3196 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:14.308718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9ec7ff3a-ee29-42fc-b04c-06b2e76e3196 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:14.315092 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ec7ff3a-ee29-42fc-b04c-06b2e76e3196 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:14.315585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ec7ff3a-ee29-42fc-b04c-06b2e76e3196 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:14.316018 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ec7ff3a-ee29-42fc-b04c-06b2e76e3196 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:14.316753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ec7ff3a-ee29-42fc-b04c-06b2e76e3196 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:14.317241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ec7ff3a-ee29-42fc-b04c-06b2e76e3196 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:14.317648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ec7ff3a-ee29-42fc-b04c-06b2e76e3196 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:14.382189 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9ec7ff3a-ee29-42fc-b04c-06b2e76e3196 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:14.390175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9ec7ff3a-ee29-42fc-b04c-06b2e76e3196 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087949 Sep 05 17:12:14.390743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 607/1230] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:14 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:14.483338 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6bd78e53-8cef-4b6b-b0bf-d83e3aa7c343 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:14.485529 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6bd78e53-8cef-4b6b-b0bf-d83e3aa7c343 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:14.492337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6bd78e53-8cef-4b6b-b0bf-d83e3aa7c343 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:14.492811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6bd78e53-8cef-4b6b-b0bf-d83e3aa7c343 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:14.493245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6bd78e53-8cef-4b6b-b0bf-d83e3aa7c343 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:14.493925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6bd78e53-8cef-4b6b-b0bf-d83e3aa7c343 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:14.494416 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6bd78e53-8cef-4b6b-b0bf-d83e3aa7c343 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:14.494827 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6bd78e53-8cef-4b6b-b0bf-d83e3aa7c343 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:14.524910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6bd78e53-8cef-4b6b-b0bf-d83e3aa7c343 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045642 Sep 05 17:12:14.525555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 624/1231] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:14 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:14.652653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a8dbc351-71ea-4499-a517-d5cc36069c3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:14.656069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a8dbc351-71ea-4499-a517-d5cc36069c3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:14.666726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8dbc351-71ea-4499-a517-d5cc36069c3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:14.667202 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8dbc351-71ea-4499-a517-d5cc36069c3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:14.667625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8dbc351-71ea-4499-a517-d5cc36069c3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:14.668340 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8dbc351-71ea-4499-a517-d5cc36069c3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:14.668780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8dbc351-71ea-4499-a517-d5cc36069c3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:14.669197 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8dbc351-71ea-4499-a517-d5cc36069c3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:14.698195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a8dbc351-71ea-4499-a517-d5cc36069c3a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052221 Sep 05 17:12:14.698727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 608/1232] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:14 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:15.413577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ecc84d77-6792-4cf7-95f1-34ff4776d644 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:15.414187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ecc84d77-6792-4cf7-95f1-34ff4776d644 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:15.420642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecc84d77-6792-4cf7-95f1-34ff4776d644 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:15.421124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecc84d77-6792-4cf7-95f1-34ff4776d644 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:15.421554 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecc84d77-6792-4cf7-95f1-34ff4776d644 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:15.422243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecc84d77-6792-4cf7-95f1-34ff4776d644 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:15.422697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecc84d77-6792-4cf7-95f1-34ff4776d644 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:15.423117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecc84d77-6792-4cf7-95f1-34ff4776d644 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:15.493550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ecc84d77-6792-4cf7-95f1-34ff4776d644 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:15.502305 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ecc84d77-6792-4cf7-95f1-34ff4776d644 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092765 Sep 05 17:12:15.502875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 625/1233] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:15 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:15.538575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d1cc858d-ef20-455d-bf2a-44323dcecace tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:15.540858 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d1cc858d-ef20-455d-bf2a-44323dcecace tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:15.547963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1cc858d-ef20-455d-bf2a-44323dcecace tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:15.548476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1cc858d-ef20-455d-bf2a-44323dcecace tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:15.548902 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1cc858d-ef20-455d-bf2a-44323dcecace tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:15.549586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1cc858d-ef20-455d-bf2a-44323dcecace tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:15.550033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1cc858d-ef20-455d-bf2a-44323dcecace tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:15.550449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1cc858d-ef20-455d-bf2a-44323dcecace tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:15.583952 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d1cc858d-ef20-455d-bf2a-44323dcecace tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049703 Sep 05 17:12:15.584529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 609/1234] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:15 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:15.715449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c9f928d7-5b34-4227-8f72-1c0e779302d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:15.717649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c9f928d7-5b34-4227-8f72-1c0e779302d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:15.724175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9f928d7-5b34-4227-8f72-1c0e779302d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:15.724988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9f928d7-5b34-4227-8f72-1c0e779302d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:15.725409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9f928d7-5b34-4227-8f72-1c0e779302d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:15.726082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9f928d7-5b34-4227-8f72-1c0e779302d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:15.726529 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9f928d7-5b34-4227-8f72-1c0e779302d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:15.726943 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9f928d7-5b34-4227-8f72-1c0e779302d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:15.763404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c9f928d7-5b34-4227-8f72-1c0e779302d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054828 Sep 05 17:12:15.763965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 626/1235] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:15 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:16.529193 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-04661a8a-b9ff-416e-8d01-dd1d37cb0371 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:16.529903 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-04661a8a-b9ff-416e-8d01-dd1d37cb0371 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:16.537684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04661a8a-b9ff-416e-8d01-dd1d37cb0371 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:16.538328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04661a8a-b9ff-416e-8d01-dd1d37cb0371 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:16.538815 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04661a8a-b9ff-416e-8d01-dd1d37cb0371 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:16.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04661a8a-b9ff-416e-8d01-dd1d37cb0371 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:16.540080 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04661a8a-b9ff-416e-8d01-dd1d37cb0371 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:16.540588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04661a8a-b9ff-416e-8d01-dd1d37cb0371 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:16.597369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0d1ef78f-e296-4ea2-bca2-d27865d25b30 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:16.599906 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0d1ef78f-e296-4ea2-bca2-d27865d25b30 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:16.607686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d1ef78f-e296-4ea2-bca2-d27865d25b30 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:16.607686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d1ef78f-e296-4ea2-bca2-d27865d25b30 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:16.607946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d1ef78f-e296-4ea2-bca2-d27865d25b30 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:16.608690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d1ef78f-e296-4ea2-bca2-d27865d25b30 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:16.609132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d1ef78f-e296-4ea2-bca2-d27865d25b30 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:16.609544 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d1ef78f-e296-4ea2-bca2-d27865d25b30 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:16.609686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-04661a8a-b9ff-416e-8d01-dd1d37cb0371 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:16.617674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-04661a8a-b9ff-416e-8d01-dd1d37cb0371 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.094974 Sep 05 17:12:16.618297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 610/1236] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:16 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:16.639597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0d1ef78f-e296-4ea2-bca2-d27865d25b30 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046174 Sep 05 17:12:16.640062 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 627/1237] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:16 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:16.776630 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e3f8a530-bf35-4303-aac9-dfe413f41d62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:16.778816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e3f8a530-bf35-4303-aac9-dfe413f41d62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:16.785636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f8a530-bf35-4303-aac9-dfe413f41d62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:16.786120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f8a530-bf35-4303-aac9-dfe413f41d62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:16.786550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f8a530-bf35-4303-aac9-dfe413f41d62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:16.787245 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f8a530-bf35-4303-aac9-dfe413f41d62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:16.787697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f8a530-bf35-4303-aac9-dfe413f41d62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:16.788115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3f8a530-bf35-4303-aac9-dfe413f41d62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:16.817232 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e3f8a530-bf35-4303-aac9-dfe413f41d62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Sep 05 17:12:16.817773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 611/1238] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:16 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:17.640654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-130bd58d-e7a5-4255-a77f-aa98351bfb8a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:17.641271 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-130bd58d-e7a5-4255-a77f-aa98351bfb8a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:17.648108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130bd58d-e7a5-4255-a77f-aa98351bfb8a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:17.648656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130bd58d-e7a5-4255-a77f-aa98351bfb8a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:17.649091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130bd58d-e7a5-4255-a77f-aa98351bfb8a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:17.649790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130bd58d-e7a5-4255-a77f-aa98351bfb8a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:17.650243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130bd58d-e7a5-4255-a77f-aa98351bfb8a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:17.650665 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130bd58d-e7a5-4255-a77f-aa98351bfb8a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:17.651555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-78406eab-397e-40e2-a11e-b618701baa49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:17.653876 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-78406eab-397e-40e2-a11e-b618701baa49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:17.660405 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-78406eab-397e-40e2-a11e-b618701baa49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:17.660883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-78406eab-397e-40e2-a11e-b618701baa49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:17.661299 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-78406eab-397e-40e2-a11e-b618701baa49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:17.662011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-78406eab-397e-40e2-a11e-b618701baa49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:17.662452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-78406eab-397e-40e2-a11e-b618701baa49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:17.662860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-78406eab-397e-40e2-a11e-b618701baa49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:17.693434 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-78406eab-397e-40e2-a11e-b618701baa49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045902 Sep 05 17:12:17.694234 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 612/1239] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:17 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:17.713059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-130bd58d-e7a5-4255-a77f-aa98351bfb8a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:17.720907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-130bd58d-e7a5-4255-a77f-aa98351bfb8a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.084449 Sep 05 17:12:17.721450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 628/1240] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:17 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:17.834177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a9a44613-ff1c-4813-9e87-6fb39ce506ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:17.837679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a9a44613-ff1c-4813-9e87-6fb39ce506ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:17.844891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a9a44613-ff1c-4813-9e87-6fb39ce506ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:17.845361 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a9a44613-ff1c-4813-9e87-6fb39ce506ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:17.845783 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a9a44613-ff1c-4813-9e87-6fb39ce506ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:17.846458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a9a44613-ff1c-4813-9e87-6fb39ce506ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:17.846913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a9a44613-ff1c-4813-9e87-6fb39ce506ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:17.847305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a9a44613-ff1c-4813-9e87-6fb39ce506ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:17.877708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a9a44613-ff1c-4813-9e87-6fb39ce506ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050228 Sep 05 17:12:17.878245 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 613/1241] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:17 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:18.710068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bb056fc0-d19d-462c-822b-e9c991008997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:18.713418 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bb056fc0-d19d-462c-822b-e9c991008997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:18.721249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb056fc0-d19d-462c-822b-e9c991008997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:18.721728 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb056fc0-d19d-462c-822b-e9c991008997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:18.722156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb056fc0-d19d-462c-822b-e9c991008997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:18.722850 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb056fc0-d19d-462c-822b-e9c991008997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:18.723300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb056fc0-d19d-462c-822b-e9c991008997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:18.723718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb056fc0-d19d-462c-822b-e9c991008997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:18.744100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a049a57b-d296-4a87-928e-b40b51aff735 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:18.744753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a049a57b-d296-4a87-928e-b40b51aff735 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:18.751556 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a049a57b-d296-4a87-928e-b40b51aff735 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:18.752079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a049a57b-d296-4a87-928e-b40b51aff735 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:18.752544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a049a57b-d296-4a87-928e-b40b51aff735 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:18.753241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a049a57b-d296-4a87-928e-b40b51aff735 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:18.753693 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a049a57b-d296-4a87-928e-b40b51aff735 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:18.753969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bb056fc0-d19d-462c-822b-e9c991008997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050954 Sep 05 17:12:18.754127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a049a57b-d296-4a87-928e-b40b51aff735 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:18.754523 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 629/1242] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:18 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:18.818224 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a049a57b-d296-4a87-928e-b40b51aff735 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:18.826136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a049a57b-d296-4a87-928e-b40b51aff735 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086000 Sep 05 17:12:18.826706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 614/1243] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:18 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:18.897830 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7136ee22-e70c-499b-b740-15d746073ba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:18.901376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7136ee22-e70c-499b-b740-15d746073ba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:18.908482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7136ee22-e70c-499b-b740-15d746073ba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:18.908959 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7136ee22-e70c-499b-b740-15d746073ba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:18.909393 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7136ee22-e70c-499b-b740-15d746073ba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:18.910081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7136ee22-e70c-499b-b740-15d746073ba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:18.910531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7136ee22-e70c-499b-b740-15d746073ba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:18.910958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7136ee22-e70c-499b-b740-15d746073ba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:18.941636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7136ee22-e70c-499b-b740-15d746073ba5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050719 Sep 05 17:12:18.942203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 630/1244] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:18 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:19.771386 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c59eeeca-397c-4768-8f8e-b3e1781c1b66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:19.774784 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c59eeeca-397c-4768-8f8e-b3e1781c1b66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:19.785880 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c59eeeca-397c-4768-8f8e-b3e1781c1b66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:19.786664 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c59eeeca-397c-4768-8f8e-b3e1781c1b66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:19.787370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c59eeeca-397c-4768-8f8e-b3e1781c1b66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:19.788562 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c59eeeca-397c-4768-8f8e-b3e1781c1b66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:19.789308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c59eeeca-397c-4768-8f8e-b3e1781c1b66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:19.790052 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c59eeeca-397c-4768-8f8e-b3e1781c1b66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:19.821764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c59eeeca-397c-4768-8f8e-b3e1781c1b66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057188 Sep 05 17:12:19.822304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 615/1245] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:19 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:19.850634 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1f10e497-45f7-4f95-befd-6efeed19be9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:19.851593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1f10e497-45f7-4f95-befd-6efeed19be9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:19.860093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f10e497-45f7-4f95-befd-6efeed19be9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:19.860613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f10e497-45f7-4f95-befd-6efeed19be9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:19.861046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f10e497-45f7-4f95-befd-6efeed19be9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:19.861736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f10e497-45f7-4f95-befd-6efeed19be9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:19.862187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f10e497-45f7-4f95-befd-6efeed19be9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:19.862607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f10e497-45f7-4f95-befd-6efeed19be9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:19.932506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1f10e497-45f7-4f95-befd-6efeed19be9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:19.934719 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:12:19.941742 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1f10e497-45f7-4f95-befd-6efeed19be9d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095712 Sep 05 17:12:19.942300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 631/1246] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:19 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:19.954510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e3092308-0802-454c-9a66-4c8c908d3116 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:19.956754 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e3092308-0802-454c-9a66-4c8c908d3116 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:19.965669 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3092308-0802-454c-9a66-4c8c908d3116 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:19.966322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3092308-0802-454c-9a66-4c8c908d3116 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:19.966892 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3092308-0802-454c-9a66-4c8c908d3116 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:19.967843 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3092308-0802-454c-9a66-4c8c908d3116 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:19.968484 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3092308-0802-454c-9a66-4c8c908d3116 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:19.969029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e3092308-0802-454c-9a66-4c8c908d3116 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:20.001845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e3092308-0802-454c-9a66-4c8c908d3116 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051286 Sep 05 17:12:20.002343 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 616/1247] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:19 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:20.839571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0d599dbe-b8f8-4752-96e1-e4731c02c8ac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:20.842332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0d599dbe-b8f8-4752-96e1-e4731c02c8ac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:20.848759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d599dbe-b8f8-4752-96e1-e4731c02c8ac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:20.849246 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d599dbe-b8f8-4752-96e1-e4731c02c8ac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:20.850023 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d599dbe-b8f8-4752-96e1-e4731c02c8ac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:20.850725 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d599dbe-b8f8-4752-96e1-e4731c02c8ac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:20.851324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d599dbe-b8f8-4752-96e1-e4731c02c8ac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:20.851581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d599dbe-b8f8-4752-96e1-e4731c02c8ac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:20.890207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0d599dbe-b8f8-4752-96e1-e4731c02c8ac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057479 Sep 05 17:12:20.891215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 632/1248] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:20 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:20.967235 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c4aae5d1-bb4c-4585-a85b-a031c2771c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:20.967766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c4aae5d1-bb4c-4585-a85b-a031c2771c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:20.974955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4aae5d1-bb4c-4585-a85b-a031c2771c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:20.975439 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4aae5d1-bb4c-4585-a85b-a031c2771c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:20.975871 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4aae5d1-bb4c-4585-a85b-a031c2771c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:20.976595 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4aae5d1-bb4c-4585-a85b-a031c2771c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:20.977052 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4aae5d1-bb4c-4585-a85b-a031c2771c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:20.977473 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4aae5d1-bb4c-4585-a85b-a031c2771c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:20.981468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:12:21.015282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0a881785-14b9-44d6-9745-2719710c7349 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:21.017473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0a881785-14b9-44d6-9745-2719710c7349 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:21.023608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a881785-14b9-44d6-9745-2719710c7349 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:21.024091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a881785-14b9-44d6-9745-2719710c7349 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:21.024553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a881785-14b9-44d6-9745-2719710c7349 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:21.025247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a881785-14b9-44d6-9745-2719710c7349 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:21.025694 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a881785-14b9-44d6-9745-2719710c7349 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:21.026109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a881785-14b9-44d6-9745-2719710c7349 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:21.041134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c4aae5d1-bb4c-4585-a85b-a031c2771c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:21.049111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c4aae5d1-bb4c-4585-a85b-a031c2771c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087711 Sep 05 17:12:21.049664 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 617/1249] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:20 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:21.056944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0a881785-14b9-44d6-9745-2719710c7349 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046166 Sep 05 17:12:21.057488 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 633/1250] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:21 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:21.906700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7dbe5119-9b2c-4eb1-a1d3-7c54b1e5b1bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:21.909206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7dbe5119-9b2c-4eb1-a1d3-7c54b1e5b1bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:21.916567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dbe5119-9b2c-4eb1-a1d3-7c54b1e5b1bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:21.917126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dbe5119-9b2c-4eb1-a1d3-7c54b1e5b1bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:21.917625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dbe5119-9b2c-4eb1-a1d3-7c54b1e5b1bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:21.918512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dbe5119-9b2c-4eb1-a1d3-7c54b1e5b1bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:21.919040 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dbe5119-9b2c-4eb1-a1d3-7c54b1e5b1bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:21.919523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dbe5119-9b2c-4eb1-a1d3-7c54b1e5b1bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:21.951261 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7dbe5119-9b2c-4eb1-a1d3-7c54b1e5b1bc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050033 Sep 05 17:12:21.951805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 618/1251] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:21 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:22.074336 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fc73d0a5-a826-4cbf-a760-0e5525333773 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:22.075779 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d1c3dd5b-6e54-445d-b768-3742b6a114e9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:22.076288 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d1c3dd5b-6e54-445d-b768-3742b6a114e9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:22.076814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fc73d0a5-a826-4cbf-a760-0e5525333773 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:22.083243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1c3dd5b-6e54-445d-b768-3742b6a114e9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:22.083568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc73d0a5-a826-4cbf-a760-0e5525333773 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:22.083770 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1c3dd5b-6e54-445d-b768-3742b6a114e9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:22.084052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc73d0a5-a826-4cbf-a760-0e5525333773 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:22.084245 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1c3dd5b-6e54-445d-b768-3742b6a114e9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:22.084626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc73d0a5-a826-4cbf-a760-0e5525333773 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:22.084928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1c3dd5b-6e54-445d-b768-3742b6a114e9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:22.085323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc73d0a5-a826-4cbf-a760-0e5525333773 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:22.085471 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1c3dd5b-6e54-445d-b768-3742b6a114e9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:22.085772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc73d0a5-a826-4cbf-a760-0e5525333773 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:22.085939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1c3dd5b-6e54-445d-b768-3742b6a114e9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:22.086189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc73d0a5-a826-4cbf-a760-0e5525333773 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:22.118393 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fc73d0a5-a826-4cbf-a760-0e5525333773 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051006 Sep 05 17:12:22.119325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 634/1252] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:22 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:22.147815 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d1c3dd5b-6e54-445d-b768-3742b6a114e9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:22.155808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d1c3dd5b-6e54-445d-b768-3742b6a114e9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086714 Sep 05 17:12:22.156429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 619/1253] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:22 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:22.967856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e9f2797e-1faa-49ef-92f1-c408c956f31e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:22.971358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e9f2797e-1faa-49ef-92f1-c408c956f31e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:22.981801 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9f2797e-1faa-49ef-92f1-c408c956f31e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:22.982288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9f2797e-1faa-49ef-92f1-c408c956f31e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:22.982719 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9f2797e-1faa-49ef-92f1-c408c956f31e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:22.983416 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9f2797e-1faa-49ef-92f1-c408c956f31e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:22.983861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9f2797e-1faa-49ef-92f1-c408c956f31e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:22.984325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9f2797e-1faa-49ef-92f1-c408c956f31e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:23.015193 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e9f2797e-1faa-49ef-92f1-c408c956f31e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054140 Sep 05 17:12:23.015766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 635/1254] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:22 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:23.136369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8cf5d37f-fb32-4c83-81a6-9e1d192c3990 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:23.139793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8cf5d37f-fb32-4c83-81a6-9e1d192c3990 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:23.151034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8cf5d37f-fb32-4c83-81a6-9e1d192c3990 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:23.152090 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8cf5d37f-fb32-4c83-81a6-9e1d192c3990 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:23.153010 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8cf5d37f-fb32-4c83-81a6-9e1d192c3990 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:23.153938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8cf5d37f-fb32-4c83-81a6-9e1d192c3990 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:23.154545 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8cf5d37f-fb32-4c83-81a6-9e1d192c3990 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:23.154954 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8cf5d37f-fb32-4c83-81a6-9e1d192c3990 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:23.178968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2ae7b8cf-e7fe-4021-a956-2318d8eb481e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:23.179546 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2ae7b8cf-e7fe-4021-a956-2318d8eb481e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:23.185917 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8cf5d37f-fb32-4c83-81a6-9e1d192c3990 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057387 Sep 05 17:12:23.186298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ae7b8cf-e7fe-4021-a956-2318d8eb481e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:23.187609 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 620/1255] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:23 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:23.187824 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ae7b8cf-e7fe-4021-a956-2318d8eb481e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:23.187824 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ae7b8cf-e7fe-4021-a956-2318d8eb481e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:23.188111 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ae7b8cf-e7fe-4021-a956-2318d8eb481e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:23.188327 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ae7b8cf-e7fe-4021-a956-2318d8eb481e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:23.188753 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ae7b8cf-e7fe-4021-a956-2318d8eb481e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:23.254537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2ae7b8cf-e7fe-4021-a956-2318d8eb481e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:23.262544 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2ae7b8cf-e7fe-4021-a956-2318d8eb481e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087696 Sep 05 17:12:23.263107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 636/1256] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:23 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:24.035273 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c679770e-7dbe-4d2a-81b2-8e2597ac36b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:24.038742 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c679770e-7dbe-4d2a-81b2-8e2597ac36b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:24.049392 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c679770e-7dbe-4d2a-81b2-8e2597ac36b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:24.050190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c679770e-7dbe-4d2a-81b2-8e2597ac36b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:24.050957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c679770e-7dbe-4d2a-81b2-8e2597ac36b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:24.052100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c679770e-7dbe-4d2a-81b2-8e2597ac36b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:24.052909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c679770e-7dbe-4d2a-81b2-8e2597ac36b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:24.053617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c679770e-7dbe-4d2a-81b2-8e2597ac36b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:24.085680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c679770e-7dbe-4d2a-81b2-8e2597ac36b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057323 Sep 05 17:12:24.086236 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 621/1257] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:24 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:24.199902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6d1c608a-f677-4cfb-9b10-5e4eeb538370 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:24.202396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6d1c608a-f677-4cfb-9b10-5e4eeb538370 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:24.209810 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d1c608a-f677-4cfb-9b10-5e4eeb538370 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:24.210336 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d1c608a-f677-4cfb-9b10-5e4eeb538370 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:24.210838 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d1c608a-f677-4cfb-9b10-5e4eeb538370 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:24.211599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d1c608a-f677-4cfb-9b10-5e4eeb538370 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:24.212089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d1c608a-f677-4cfb-9b10-5e4eeb538370 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:24.212667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d1c608a-f677-4cfb-9b10-5e4eeb538370 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:24.243226 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6d1c608a-f677-4cfb-9b10-5e4eeb538370 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047682 Sep 05 17:12:24.243781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 637/1258] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:24 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:24.285717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cb5ef5e9-b078-4b20-b262-573242a61c65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:24.286236 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cb5ef5e9-b078-4b20-b262-573242a61c65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:24.293014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb5ef5e9-b078-4b20-b262-573242a61c65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:24.293555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb5ef5e9-b078-4b20-b262-573242a61c65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:24.293950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb5ef5e9-b078-4b20-b262-573242a61c65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:24.294931 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb5ef5e9-b078-4b20-b262-573242a61c65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:24.295375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb5ef5e9-b078-4b20-b262-573242a61c65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:24.295788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cb5ef5e9-b078-4b20-b262-573242a61c65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:24.360188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cb5ef5e9-b078-4b20-b262-573242a61c65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:24.368484 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cb5ef5e9-b078-4b20-b262-573242a61c65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086645 Sep 05 17:12:24.369042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 622/1259] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:24 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:25.103566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-487e3d32-4c73-4de5-b516-b4fd9ed74a9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:25.106999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-487e3d32-4c73-4de5-b516-b4fd9ed74a9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:25.113467 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-487e3d32-4c73-4de5-b516-b4fd9ed74a9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:25.113940 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-487e3d32-4c73-4de5-b516-b4fd9ed74a9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:25.114366 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-487e3d32-4c73-4de5-b516-b4fd9ed74a9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:25.115074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-487e3d32-4c73-4de5-b516-b4fd9ed74a9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:25.115514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-487e3d32-4c73-4de5-b516-b4fd9ed74a9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:25.115955 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-487e3d32-4c73-4de5-b516-b4fd9ed74a9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:25.145915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-487e3d32-4c73-4de5-b516-b4fd9ed74a9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049674 Sep 05 17:12:25.146475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 638/1260] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:25 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:25.260057 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-dbafa9c9-de70-44ae-b8f3-db38dbc65080 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:25.263007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-dbafa9c9-de70-44ae-b8f3-db38dbc65080 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:25.269439 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbafa9c9-de70-44ae-b8f3-db38dbc65080 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:25.269915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbafa9c9-de70-44ae-b8f3-db38dbc65080 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:25.270334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbafa9c9-de70-44ae-b8f3-db38dbc65080 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:25.271008 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbafa9c9-de70-44ae-b8f3-db38dbc65080 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:25.271446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbafa9c9-de70-44ae-b8f3-db38dbc65080 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:25.271856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbafa9c9-de70-44ae-b8f3-db38dbc65080 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:25.302209 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-dbafa9c9-de70-44ae-b8f3-db38dbc65080 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048757 Sep 05 17:12:25.302889 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 623/1261] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:25 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:25.395677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e1c74026-12b6-4d99-aa57-a71c1c15c065 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:25.396757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e1c74026-12b6-4d99-aa57-a71c1c15c065 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:25.405883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c74026-12b6-4d99-aa57-a71c1c15c065 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:25.406370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c74026-12b6-4d99-aa57-a71c1c15c065 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:25.406802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c74026-12b6-4d99-aa57-a71c1c15c065 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:25.407503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c74026-12b6-4d99-aa57-a71c1c15c065 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:25.407950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c74026-12b6-4d99-aa57-a71c1c15c065 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:25.408408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c74026-12b6-4d99-aa57-a71c1c15c065 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:25.471512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e1c74026-12b6-4d99-aa57-a71c1c15c065 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:25.484339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e1c74026-12b6-4d99-aa57-a71c1c15c065 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095069 Sep 05 17:12:25.485150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 639/1262] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:25 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:26.165681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9f76151d-39e2-45e0-92b6-76ba2480430a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:26.169913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9f76151d-39e2-45e0-92b6-76ba2480430a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:26.180891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9f76151d-39e2-45e0-92b6-76ba2480430a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:26.181708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9f76151d-39e2-45e0-92b6-76ba2480430a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:26.182506 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9f76151d-39e2-45e0-92b6-76ba2480430a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:26.183901 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9f76151d-39e2-45e0-92b6-76ba2480430a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:26.184708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9f76151d-39e2-45e0-92b6-76ba2480430a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:26.185007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9f76151d-39e2-45e0-92b6-76ba2480430a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:26.215816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9f76151d-39e2-45e0-92b6-76ba2480430a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057475 Sep 05 17:12:26.216397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 624/1263] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:26 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:26.319746 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6727e3d1-ed7c-4afc-b20c-2016c3bae291 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:26.323313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6727e3d1-ed7c-4afc-b20c-2016c3bae291 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:26.333407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6727e3d1-ed7c-4afc-b20c-2016c3bae291 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:26.334187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6727e3d1-ed7c-4afc-b20c-2016c3bae291 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:26.334891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6727e3d1-ed7c-4afc-b20c-2016c3bae291 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:26.336000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6727e3d1-ed7c-4afc-b20c-2016c3bae291 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:26.336776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6727e3d1-ed7c-4afc-b20c-2016c3bae291 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:26.337462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6727e3d1-ed7c-4afc-b20c-2016c3bae291 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:26.368543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6727e3d1-ed7c-4afc-b20c-2016c3bae291 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055516 Sep 05 17:12:26.369108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 640/1264] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:26 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:26.514117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8fabd400-1619-4035-8547-b5a22840c7b5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:26.514726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8fabd400-1619-4035-8547-b5a22840c7b5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:26.521628 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8fabd400-1619-4035-8547-b5a22840c7b5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:26.522107 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8fabd400-1619-4035-8547-b5a22840c7b5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:26.522531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8fabd400-1619-4035-8547-b5a22840c7b5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:26.523210 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8fabd400-1619-4035-8547-b5a22840c7b5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:26.523654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8fabd400-1619-4035-8547-b5a22840c7b5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:26.524065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8fabd400-1619-4035-8547-b5a22840c7b5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:26.587904 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8fabd400-1619-4035-8547-b5a22840c7b5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:26.598921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8fabd400-1619-4035-8547-b5a22840c7b5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.090084 Sep 05 17:12:26.599993 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 625/1265] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:26 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:27.232417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-289e5421-b6b7-4d9b-a3de-52bfcc6644be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:27.234577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-289e5421-b6b7-4d9b-a3de-52bfcc6644be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:27.241618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-289e5421-b6b7-4d9b-a3de-52bfcc6644be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:27.242095 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-289e5421-b6b7-4d9b-a3de-52bfcc6644be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:27.242523 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-289e5421-b6b7-4d9b-a3de-52bfcc6644be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:27.243213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-289e5421-b6b7-4d9b-a3de-52bfcc6644be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:27.243656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-289e5421-b6b7-4d9b-a3de-52bfcc6644be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:27.244077 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-289e5421-b6b7-4d9b-a3de-52bfcc6644be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:27.275502 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-289e5421-b6b7-4d9b-a3de-52bfcc6644be tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049027 Sep 05 17:12:27.276042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 641/1266] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:27 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:27.386393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-32c72eee-9624-4cec-9b4a-1979c32cefca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:27.388988 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-32c72eee-9624-4cec-9b4a-1979c32cefca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:27.395424 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32c72eee-9624-4cec-9b4a-1979c32cefca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:27.395904 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32c72eee-9624-4cec-9b4a-1979c32cefca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:27.396371 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32c72eee-9624-4cec-9b4a-1979c32cefca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:27.397063 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32c72eee-9624-4cec-9b4a-1979c32cefca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:27.397511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32c72eee-9624-4cec-9b4a-1979c32cefca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:27.397952 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32c72eee-9624-4cec-9b4a-1979c32cefca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:27.427225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-32c72eee-9624-4cec-9b4a-1979c32cefca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047694 Sep 05 17:12:27.427778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 626/1267] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:27 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:27.624550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c412f535-1091-4ff9-8b64-7b573852d798 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:27.625128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c412f535-1091-4ff9-8b64-7b573852d798 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:27.631606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c412f535-1091-4ff9-8b64-7b573852d798 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:27.632015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c412f535-1091-4ff9-8b64-7b573852d798 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:27.632552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c412f535-1091-4ff9-8b64-7b573852d798 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:27.633231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c412f535-1091-4ff9-8b64-7b573852d798 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:27.633674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c412f535-1091-4ff9-8b64-7b573852d798 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:27.634090 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c412f535-1091-4ff9-8b64-7b573852d798 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:27.697848 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c412f535-1091-4ff9-8b64-7b573852d798 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:27.705777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c412f535-1091-4ff9-8b64-7b573852d798 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086067 Sep 05 17:12:27.706349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 642/1268] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:27 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:28.293280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c7c501a3-c97d-4c3c-9f33-b56675f19155 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:28.295422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c7c501a3-c97d-4c3c-9f33-b56675f19155 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:28.302775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7c501a3-c97d-4c3c-9f33-b56675f19155 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:28.303278 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7c501a3-c97d-4c3c-9f33-b56675f19155 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:28.303739 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7c501a3-c97d-4c3c-9f33-b56675f19155 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:28.304500 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7c501a3-c97d-4c3c-9f33-b56675f19155 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:28.304977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7c501a3-c97d-4c3c-9f33-b56675f19155 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:28.305417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7c501a3-c97d-4c3c-9f33-b56675f19155 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:28.336764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c7c501a3-c97d-4c3c-9f33-b56675f19155 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050565 Sep 05 17:12:28.337306 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 627/1269] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:28 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:28.443641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e39df3b4-4364-4b05-9063-8aa866a1340e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:28.447277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e39df3b4-4364-4b05-9063-8aa866a1340e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:28.458284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e39df3b4-4364-4b05-9063-8aa866a1340e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:28.459108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e39df3b4-4364-4b05-9063-8aa866a1340e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:28.459839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e39df3b4-4364-4b05-9063-8aa866a1340e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:28.461055 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e39df3b4-4364-4b05-9063-8aa866a1340e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:28.461830 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e39df3b4-4364-4b05-9063-8aa866a1340e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:28.462549 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e39df3b4-4364-4b05-9063-8aa866a1340e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:28.493614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e39df3b4-4364-4b05-9063-8aa866a1340e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057372 Sep 05 17:12:28.494173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 643/1270] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:28 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:28.734371 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8b505339-7511-4d84-9696-23a9d8debc2b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:28.735005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8b505339-7511-4d84-9696-23a9d8debc2b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:28.741738 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b505339-7511-4d84-9696-23a9d8debc2b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:28.742237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b505339-7511-4d84-9696-23a9d8debc2b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:28.742682 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b505339-7511-4d84-9696-23a9d8debc2b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:28.743396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b505339-7511-4d84-9696-23a9d8debc2b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:28.743859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b505339-7511-4d84-9696-23a9d8debc2b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:28.744336 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b505339-7511-4d84-9696-23a9d8debc2b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:28.806615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8b505339-7511-4d84-9696-23a9d8debc2b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:28.814852 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8b505339-7511-4d84-9696-23a9d8debc2b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.085530 Sep 05 17:12:28.815407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 628/1271] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:28 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:29.350176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4b19867f-213e-4c3e-83fb-c9ed9f080888 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:29.352382 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4b19867f-213e-4c3e-83fb-c9ed9f080888 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:29.358909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b19867f-213e-4c3e-83fb-c9ed9f080888 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:29.359422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b19867f-213e-4c3e-83fb-c9ed9f080888 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:29.359856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b19867f-213e-4c3e-83fb-c9ed9f080888 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:29.360604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b19867f-213e-4c3e-83fb-c9ed9f080888 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:29.361057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b19867f-213e-4c3e-83fb-c9ed9f080888 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:29.361483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b19867f-213e-4c3e-83fb-c9ed9f080888 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:29.393607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4b19867f-213e-4c3e-83fb-c9ed9f080888 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047897 Sep 05 17:12:29.394172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 644/1272] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:29 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:29.508603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5dc97d92-d79c-4317-805f-279a34d37499 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:29.511781 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5dc97d92-d79c-4317-805f-279a34d37499 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:29.518820 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5dc97d92-d79c-4317-805f-279a34d37499 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:29.519297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5dc97d92-d79c-4317-805f-279a34d37499 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:29.519720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5dc97d92-d79c-4317-805f-279a34d37499 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:29.520440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5dc97d92-d79c-4317-805f-279a34d37499 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:29.520886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5dc97d92-d79c-4317-805f-279a34d37499 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:29.521299 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5dc97d92-d79c-4317-805f-279a34d37499 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:29.550605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5dc97d92-d79c-4317-805f-279a34d37499 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047819 Sep 05 17:12:29.551157 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 629/1273] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:29 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:29.839250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c2ac0cac-d2aa-4526-a507-ddab810a8d42 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:29.840088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c2ac0cac-d2aa-4526-a507-ddab810a8d42 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:29.846878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2ac0cac-d2aa-4526-a507-ddab810a8d42 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:29.847351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2ac0cac-d2aa-4526-a507-ddab810a8d42 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:29.847775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2ac0cac-d2aa-4526-a507-ddab810a8d42 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:29.848494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2ac0cac-d2aa-4526-a507-ddab810a8d42 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:29.848953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2ac0cac-d2aa-4526-a507-ddab810a8d42 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:29.849699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2ac0cac-d2aa-4526-a507-ddab810a8d42 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:29.915614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c2ac0cac-d2aa-4526-a507-ddab810a8d42 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:29.923903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c2ac0cac-d2aa-4526-a507-ddab810a8d42 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089535 Sep 05 17:12:29.924500 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 645/1274] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:29 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:30.407135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-74f863e3-a52f-47b4-8800-0437cbce3e1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:30.409334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-74f863e3-a52f-47b4-8800-0437cbce3e1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:30.416005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74f863e3-a52f-47b4-8800-0437cbce3e1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:30.416521 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74f863e3-a52f-47b4-8800-0437cbce3e1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:30.416955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74f863e3-a52f-47b4-8800-0437cbce3e1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:30.417645 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74f863e3-a52f-47b4-8800-0437cbce3e1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:30.418136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74f863e3-a52f-47b4-8800-0437cbce3e1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:30.418561 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74f863e3-a52f-47b4-8800-0437cbce3e1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:30.448557 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-74f863e3-a52f-47b4-8800-0437cbce3e1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045452 Sep 05 17:12:30.449539 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 630/1275] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:30 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:30.568730 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b7a9240c-9bf2-48c1-a7ca-4e13649cb3d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:30.572258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b7a9240c-9bf2-48c1-a7ca-4e13649cb3d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:30.580038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7a9240c-9bf2-48c1-a7ca-4e13649cb3d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:30.580552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7a9240c-9bf2-48c1-a7ca-4e13649cb3d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:30.580986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7a9240c-9bf2-48c1-a7ca-4e13649cb3d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:30.581676 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7a9240c-9bf2-48c1-a7ca-4e13649cb3d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:30.582124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7a9240c-9bf2-48c1-a7ca-4e13649cb3d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:30.582548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7a9240c-9bf2-48c1-a7ca-4e13649cb3d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:30.612547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b7a9240c-9bf2-48c1-a7ca-4e13649cb3d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050665 Sep 05 17:12:30.613106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 646/1276] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:30 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:30.952878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-33671dbc-85ee-48a2-8b93-9480e21fc8c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:30.953862 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-33671dbc-85ee-48a2-8b93-9480e21fc8c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:30.964176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33671dbc-85ee-48a2-8b93-9480e21fc8c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:30.965590 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33671dbc-85ee-48a2-8b93-9480e21fc8c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:30.966044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33671dbc-85ee-48a2-8b93-9480e21fc8c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:30.966731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33671dbc-85ee-48a2-8b93-9480e21fc8c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:30.967184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33671dbc-85ee-48a2-8b93-9480e21fc8c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:30.967605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33671dbc-85ee-48a2-8b93-9480e21fc8c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:31.035575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-33671dbc-85ee-48a2-8b93-9480e21fc8c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:31.044819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-33671dbc-85ee-48a2-8b93-9480e21fc8c1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.100411 Sep 05 17:12:31.045364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 631/1277] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:30 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:31.466833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aabbf74f-c00e-4e01-8090-11ce95d15e2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:31.469056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aabbf74f-c00e-4e01-8090-11ce95d15e2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:31.476374 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aabbf74f-c00e-4e01-8090-11ce95d15e2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:31.476893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aabbf74f-c00e-4e01-8090-11ce95d15e2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:31.477328 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aabbf74f-c00e-4e01-8090-11ce95d15e2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:31.478018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aabbf74f-c00e-4e01-8090-11ce95d15e2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:31.478469 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aabbf74f-c00e-4e01-8090-11ce95d15e2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:31.478892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aabbf74f-c00e-4e01-8090-11ce95d15e2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:31.509522 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aabbf74f-c00e-4e01-8090-11ce95d15e2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049069 Sep 05 17:12:31.510087 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 647/1278] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:31 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:31.629882 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7ac28150-5c32-4632-b8d4-6b87036fc199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:31.633396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7ac28150-5c32-4632-b8d4-6b87036fc199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:31.644098 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ac28150-5c32-4632-b8d4-6b87036fc199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:31.644969 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ac28150-5c32-4632-b8d4-6b87036fc199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:31.645685 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ac28150-5c32-4632-b8d4-6b87036fc199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:31.646817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ac28150-5c32-4632-b8d4-6b87036fc199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:31.647615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ac28150-5c32-4632-b8d4-6b87036fc199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:31.648323 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ac28150-5c32-4632-b8d4-6b87036fc199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:31.679799 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7ac28150-5c32-4632-b8d4-6b87036fc199 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056800 Sep 05 17:12:31.680379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 632/1279] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:31 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:32.071749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ace26e40-e882-4168-8b69-61f269b68181 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:32.072676 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ace26e40-e882-4168-8b69-61f269b68181 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:32.075417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=86 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:12:32.081135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ace26e40-e882-4168-8b69-61f269b68181 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:32.081609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ace26e40-e882-4168-8b69-61f269b68181 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:32.082033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ace26e40-e882-4168-8b69-61f269b68181 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:32.082713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ace26e40-e882-4168-8b69-61f269b68181 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:32.083162 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ace26e40-e882-4168-8b69-61f269b68181 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:32.083576 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ace26e40-e882-4168-8b69-61f269b68181 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:32.098918 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:12:32.149341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ace26e40-e882-4168-8b69-61f269b68181 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:32.157717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ace26e40-e882-4168-8b69-61f269b68181 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092627 Sep 05 17:12:32.158284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 648/1280] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:32 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:32.527357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f8d189bd-0329-43cd-905d-9c16a2e3e8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:32.530494 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f8d189bd-0329-43cd-905d-9c16a2e3e8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:32.539266 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d189bd-0329-43cd-905d-9c16a2e3e8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:32.539894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d189bd-0329-43cd-905d-9c16a2e3e8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:32.540507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d189bd-0329-43cd-905d-9c16a2e3e8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:32.541414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d189bd-0329-43cd-905d-9c16a2e3e8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:32.541999 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d189bd-0329-43cd-905d-9c16a2e3e8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:32.542549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d189bd-0329-43cd-905d-9c16a2e3e8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:32.568771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:12:32.574513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f8d189bd-0329-43cd-905d-9c16a2e3e8c9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052523 Sep 05 17:12:32.575160 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 633/1281] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:32 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:32.693499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6d681b78-269f-4a45-b013-bebb0bfb7192 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:32.695591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6d681b78-269f-4a45-b013-bebb0bfb7192 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:32.702786 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d681b78-269f-4a45-b013-bebb0bfb7192 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:32.703268 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d681b78-269f-4a45-b013-bebb0bfb7192 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:32.703703 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d681b78-269f-4a45-b013-bebb0bfb7192 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:32.704445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d681b78-269f-4a45-b013-bebb0bfb7192 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:32.704899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d681b78-269f-4a45-b013-bebb0bfb7192 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:32.705323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d681b78-269f-4a45-b013-bebb0bfb7192 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:32.736597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6d681b78-269f-4a45-b013-bebb0bfb7192 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047534 Sep 05 17:12:32.737147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 649/1282] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:32 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:33.180359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e9a3c5c1-eb03-4bea-a890-6d56aca4fb55 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:33.180959 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e9a3c5c1-eb03-4bea-a890-6d56aca4fb55 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:33.187588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9a3c5c1-eb03-4bea-a890-6d56aca4fb55 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:33.188075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9a3c5c1-eb03-4bea-a890-6d56aca4fb55 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:33.188517 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9a3c5c1-eb03-4bea-a890-6d56aca4fb55 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:33.189227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9a3c5c1-eb03-4bea-a890-6d56aca4fb55 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:33.189679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9a3c5c1-eb03-4bea-a890-6d56aca4fb55 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:33.190103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9a3c5c1-eb03-4bea-a890-6d56aca4fb55 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:33.256125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e9a3c5c1-eb03-4bea-a890-6d56aca4fb55 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:33.264378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e9a3c5c1-eb03-4bea-a890-6d56aca4fb55 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.088017 Sep 05 17:12:33.264963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 634/1283] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:33 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:33.591572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2c0fd69c-6631-4823-8c1b-c5996835ba52 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:33.593798 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2c0fd69c-6631-4823-8c1b-c5996835ba52 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:33.600604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c0fd69c-6631-4823-8c1b-c5996835ba52 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:33.601074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c0fd69c-6631-4823-8c1b-c5996835ba52 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:33.601505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c0fd69c-6631-4823-8c1b-c5996835ba52 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:33.602185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c0fd69c-6631-4823-8c1b-c5996835ba52 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:33.602640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c0fd69c-6631-4823-8c1b-c5996835ba52 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:33.603080 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c0fd69c-6631-4823-8c1b-c5996835ba52 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:33.633765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2c0fd69c-6631-4823-8c1b-c5996835ba52 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049135 Sep 05 17:12:33.634322 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 650/1284] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:33 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:33.753973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e1c32bc4-bf43-4251-b5df-fb50e155e8c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:33.757473 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e1c32bc4-bf43-4251-b5df-fb50e155e8c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:33.768232 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1c32bc4-bf43-4251-b5df-fb50e155e8c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:33.769065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1c32bc4-bf43-4251-b5df-fb50e155e8c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:33.769774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1c32bc4-bf43-4251-b5df-fb50e155e8c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:33.770885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1c32bc4-bf43-4251-b5df-fb50e155e8c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:33.771622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1c32bc4-bf43-4251-b5df-fb50e155e8c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:33.772355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1c32bc4-bf43-4251-b5df-fb50e155e8c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:33.803917 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e1c32bc4-bf43-4251-b5df-fb50e155e8c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057025 Sep 05 17:12:33.804719 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 635/1285] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:33 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:34.290376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bb7bb46a-01e1-4386-832e-23f53e29c28c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:34.290992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bb7bb46a-01e1-4386-832e-23f53e29c28c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:34.298953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb7bb46a-01e1-4386-832e-23f53e29c28c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:34.299439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb7bb46a-01e1-4386-832e-23f53e29c28c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:34.299867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb7bb46a-01e1-4386-832e-23f53e29c28c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:34.300606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb7bb46a-01e1-4386-832e-23f53e29c28c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:34.301055 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb7bb46a-01e1-4386-832e-23f53e29c28c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:34.301475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb7bb46a-01e1-4386-832e-23f53e29c28c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:34.363919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bb7bb46a-01e1-4386-832e-23f53e29c28c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:34.372137 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bb7bb46a-01e1-4386-832e-23f53e29c28c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087982 Sep 05 17:12:34.372761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 651/1286] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:34 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:34.654763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0f1be442-2c7b-4c5b-b2be-6dfc9bfcac81 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:34.657305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0f1be442-2c7b-4c5b-b2be-6dfc9bfcac81 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:34.664705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f1be442-2c7b-4c5b-b2be-6dfc9bfcac81 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:34.665265 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f1be442-2c7b-4c5b-b2be-6dfc9bfcac81 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:34.665795 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f1be442-2c7b-4c5b-b2be-6dfc9bfcac81 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:34.666596 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f1be442-2c7b-4c5b-b2be-6dfc9bfcac81 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:34.667122 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f1be442-2c7b-4c5b-b2be-6dfc9bfcac81 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:34.667606 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f1be442-2c7b-4c5b-b2be-6dfc9bfcac81 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:34.700586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0f1be442-2c7b-4c5b-b2be-6dfc9bfcac81 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052416 Sep 05 17:12:34.701136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 636/1287] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:34 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:34.820200 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-352e8806-1b9c-459c-9fd8-b364f0ed90e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:34.823740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-352e8806-1b9c-459c-9fd8-b364f0ed90e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:34.830775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352e8806-1b9c-459c-9fd8-b364f0ed90e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:34.831257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352e8806-1b9c-459c-9fd8-b364f0ed90e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:34.831713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352e8806-1b9c-459c-9fd8-b364f0ed90e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:34.832673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352e8806-1b9c-459c-9fd8-b364f0ed90e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:34.833135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352e8806-1b9c-459c-9fd8-b364f0ed90e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:34.833548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352e8806-1b9c-459c-9fd8-b364f0ed90e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:34.866062 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-352e8806-1b9c-459c-9fd8-b364f0ed90e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052499 Sep 05 17:12:34.867012 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 652/1288] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:34 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:35.399039 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c761409f-e1a4-4ba9-a50f-04ccff39610c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:35.400040 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c761409f-e1a4-4ba9-a50f-04ccff39610c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:35.403584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=84 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:12:35.409255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c761409f-e1a4-4ba9-a50f-04ccff39610c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:35.409729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c761409f-e1a4-4ba9-a50f-04ccff39610c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:35.410149 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c761409f-e1a4-4ba9-a50f-04ccff39610c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:35.410847 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c761409f-e1a4-4ba9-a50f-04ccff39610c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:35.411295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c761409f-e1a4-4ba9-a50f-04ccff39610c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:35.411704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c761409f-e1a4-4ba9-a50f-04ccff39610c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:35.491723 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c761409f-e1a4-4ba9-a50f-04ccff39610c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:35.502364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c761409f-e1a4-4ba9-a50f-04ccff39610c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.109611 Sep 05 17:12:35.503230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 637/1289] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:35 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:35.720917 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ebe18d75-ad77-4d38-80f5-174785c7cf7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:35.724730 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ebe18d75-ad77-4d38-80f5-174785c7cf7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:35.734376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ebe18d75-ad77-4d38-80f5-174785c7cf7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:35.734853 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ebe18d75-ad77-4d38-80f5-174785c7cf7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:35.735287 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ebe18d75-ad77-4d38-80f5-174785c7cf7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:35.735973 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ebe18d75-ad77-4d38-80f5-174785c7cf7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:35.736459 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ebe18d75-ad77-4d38-80f5-174785c7cf7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:35.736883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ebe18d75-ad77-4d38-80f5-174785c7cf7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:35.768963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ebe18d75-ad77-4d38-80f5-174785c7cf7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055702 Sep 05 17:12:35.769541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 653/1290] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:35 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:35.885635 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ff575b23-6a4a-43d2-a618-236f6e2a10d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:35.889188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ff575b23-6a4a-43d2-a618-236f6e2a10d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:35.899124 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff575b23-6a4a-43d2-a618-236f6e2a10d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:35.899918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff575b23-6a4a-43d2-a618-236f6e2a10d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:35.900683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff575b23-6a4a-43d2-a618-236f6e2a10d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:35.901811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff575b23-6a4a-43d2-a618-236f6e2a10d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:35.902554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff575b23-6a4a-43d2-a618-236f6e2a10d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:35.903254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff575b23-6a4a-43d2-a618-236f6e2a10d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:35.932607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ff575b23-6a4a-43d2-a618-236f6e2a10d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053646 Sep 05 17:12:35.933145 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 638/1291] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:35 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:36.533822 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dad2a069-ed54-4a6c-a8f4-1f9043ee4cde tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:36.534817 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dad2a069-ed54-4a6c-a8f4-1f9043ee4cde tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:36.544635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dad2a069-ed54-4a6c-a8f4-1f9043ee4cde tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:36.545110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dad2a069-ed54-4a6c-a8f4-1f9043ee4cde tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:36.545532 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dad2a069-ed54-4a6c-a8f4-1f9043ee4cde tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:36.546214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dad2a069-ed54-4a6c-a8f4-1f9043ee4cde tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:36.546657 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dad2a069-ed54-4a6c-a8f4-1f9043ee4cde tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:36.547071 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dad2a069-ed54-4a6c-a8f4-1f9043ee4cde tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:36.612824 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dad2a069-ed54-4a6c-a8f4-1f9043ee4cde tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:36.621307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dad2a069-ed54-4a6c-a8f4-1f9043ee4cde tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095137 Sep 05 17:12:36.622254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 654/1292] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:36 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:36.787014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6236a904-e2a5-4644-b127-1258772ae476 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:36.790393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6236a904-e2a5-4644-b127-1258772ae476 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:36.801489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6236a904-e2a5-4644-b127-1258772ae476 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:36.802305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6236a904-e2a5-4644-b127-1258772ae476 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:36.803020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6236a904-e2a5-4644-b127-1258772ae476 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:36.804187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6236a904-e2a5-4644-b127-1258772ae476 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:36.804932 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6236a904-e2a5-4644-b127-1258772ae476 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:36.805663 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6236a904-e2a5-4644-b127-1258772ae476 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:36.836619 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6236a904-e2a5-4644-b127-1258772ae476 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056526 Sep 05 17:12:36.837163 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 639/1293] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:36 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:36.951577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3f657b29-e669-4af8-8c56-3912c2c95ad9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:36.953742 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3f657b29-e669-4af8-8c56-3912c2c95ad9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:36.960512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f657b29-e669-4af8-8c56-3912c2c95ad9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:36.960983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f657b29-e669-4af8-8c56-3912c2c95ad9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:36.961407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f657b29-e669-4af8-8c56-3912c2c95ad9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:36.962082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f657b29-e669-4af8-8c56-3912c2c95ad9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:36.962520 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f657b29-e669-4af8-8c56-3912c2c95ad9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:36.962914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f657b29-e669-4af8-8c56-3912c2c95ad9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:36.992758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3f657b29-e669-4af8-8c56-3912c2c95ad9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047335 Sep 05 17:12:36.993304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 655/1294] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:36 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:37.648663 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cbf2871d-7706-4bf1-98f2-e5f9d1cd5802 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:37.649549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cbf2871d-7706-4bf1-98f2-e5f9d1cd5802 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:37.657470 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cbf2871d-7706-4bf1-98f2-e5f9d1cd5802 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:37.657946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cbf2871d-7706-4bf1-98f2-e5f9d1cd5802 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:37.658367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cbf2871d-7706-4bf1-98f2-e5f9d1cd5802 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:37.659043 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cbf2871d-7706-4bf1-98f2-e5f9d1cd5802 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:37.659486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cbf2871d-7706-4bf1-98f2-e5f9d1cd5802 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:37.659895 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cbf2871d-7706-4bf1-98f2-e5f9d1cd5802 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:37.723192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cbf2871d-7706-4bf1-98f2-e5f9d1cd5802 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:37.734682 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cbf2871d-7706-4bf1-98f2-e5f9d1cd5802 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092892 Sep 05 17:12:37.735257 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 640/1295] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:37 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:37.853674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f29e002e-0ee8-4adb-a5c5-7bf0f3b4ab0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:37.857189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f29e002e-0ee8-4adb-a5c5-7bf0f3b4ab0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:37.863649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f29e002e-0ee8-4adb-a5c5-7bf0f3b4ab0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:37.864126 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f29e002e-0ee8-4adb-a5c5-7bf0f3b4ab0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:37.864577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f29e002e-0ee8-4adb-a5c5-7bf0f3b4ab0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:37.865260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f29e002e-0ee8-4adb-a5c5-7bf0f3b4ab0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:37.865705 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f29e002e-0ee8-4adb-a5c5-7bf0f3b4ab0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:37.866121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f29e002e-0ee8-4adb-a5c5-7bf0f3b4ab0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:37.896576 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f29e002e-0ee8-4adb-a5c5-7bf0f3b4ab0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049958 Sep 05 17:12:37.897127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 656/1296] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:37 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:38.012220 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4e960d03-8a0d-407a-b495-26ff10670154 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:38.014923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4e960d03-8a0d-407a-b495-26ff10670154 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:38.022194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e960d03-8a0d-407a-b495-26ff10670154 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:38.022697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e960d03-8a0d-407a-b495-26ff10670154 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:38.023140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e960d03-8a0d-407a-b495-26ff10670154 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:38.023857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e960d03-8a0d-407a-b495-26ff10670154 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:38.024370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e960d03-8a0d-407a-b495-26ff10670154 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:38.024809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e960d03-8a0d-407a-b495-26ff10670154 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:38.055499 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4e960d03-8a0d-407a-b495-26ff10670154 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050010 Sep 05 17:12:38.056051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 641/1297] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:38 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:38.768884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6058fcb5-9ea8-45bb-a014-18d4344e1369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:38.769581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6058fcb5-9ea8-45bb-a014-18d4344e1369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:38.778388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6058fcb5-9ea8-45bb-a014-18d4344e1369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:38.779122 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6058fcb5-9ea8-45bb-a014-18d4344e1369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:38.779872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6058fcb5-9ea8-45bb-a014-18d4344e1369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:38.780819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6058fcb5-9ea8-45bb-a014-18d4344e1369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:38.781414 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6058fcb5-9ea8-45bb-a014-18d4344e1369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:38.781961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6058fcb5-9ea8-45bb-a014-18d4344e1369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:38.858319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6058fcb5-9ea8-45bb-a014-18d4344e1369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:38.866598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6058fcb5-9ea8-45bb-a014-18d4344e1369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.103220 Sep 05 17:12:38.867167 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 657/1298] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:38 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:38.913292 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d61192c0-7000-43f2-8941-b19b6a2de1a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:38.916542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d61192c0-7000-43f2-8941-b19b6a2de1a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:38.925150 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d61192c0-7000-43f2-8941-b19b6a2de1a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:38.925634 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d61192c0-7000-43f2-8941-b19b6a2de1a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:38.926064 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d61192c0-7000-43f2-8941-b19b6a2de1a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:38.926793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d61192c0-7000-43f2-8941-b19b6a2de1a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:38.927214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d61192c0-7000-43f2-8941-b19b6a2de1a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:38.927753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d61192c0-7000-43f2-8941-b19b6a2de1a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:38.960244 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d61192c0-7000-43f2-8941-b19b6a2de1a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053214 Sep 05 17:12:38.960806 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 642/1299] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:38 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:39.072507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bf6c227a-d949-4bc0-9fd8-55636fbc1fd0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:39.075859 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bf6c227a-d949-4bc0-9fd8-55636fbc1fd0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:39.085934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf6c227a-d949-4bc0-9fd8-55636fbc1fd0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:39.086781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf6c227a-d949-4bc0-9fd8-55636fbc1fd0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:39.087497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf6c227a-d949-4bc0-9fd8-55636fbc1fd0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:39.088711 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf6c227a-d949-4bc0-9fd8-55636fbc1fd0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:39.089456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf6c227a-d949-4bc0-9fd8-55636fbc1fd0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:39.090159 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf6c227a-d949-4bc0-9fd8-55636fbc1fd0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:39.121837 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bf6c227a-d949-4bc0-9fd8-55636fbc1fd0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055710 Sep 05 17:12:39.122079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 658/1300] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:39 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:39.893061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0a29420a-ddba-4ec5-bb90-91a621499f93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:39.894045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0a29420a-ddba-4ec5-bb90-91a621499f93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:39.904562 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a29420a-ddba-4ec5-bb90-91a621499f93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:39.905039 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a29420a-ddba-4ec5-bb90-91a621499f93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:39.905461 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a29420a-ddba-4ec5-bb90-91a621499f93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:39.906141 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a29420a-ddba-4ec5-bb90-91a621499f93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:39.906584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a29420a-ddba-4ec5-bb90-91a621499f93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:39.906998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a29420a-ddba-4ec5-bb90-91a621499f93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:39.968798 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0a29420a-ddba-4ec5-bb90-91a621499f93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:39.973637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1b4655dc-90d9-4c1f-ab1b-8ea31d31631d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:39.976312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1b4655dc-90d9-4c1f-ab1b-8ea31d31631d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:39.977459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0a29420a-ddba-4ec5-bb90-91a621499f93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091159 Sep 05 17:12:39.978023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 643/1301] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:39 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:39.983250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b4655dc-90d9-4c1f-ab1b-8ea31d31631d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:39.983731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b4655dc-90d9-4c1f-ab1b-8ea31d31631d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:39.984182 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b4655dc-90d9-4c1f-ab1b-8ea31d31631d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:39.984903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b4655dc-90d9-4c1f-ab1b-8ea31d31631d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:39.985354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b4655dc-90d9-4c1f-ab1b-8ea31d31631d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:39.985771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b4655dc-90d9-4c1f-ab1b-8ea31d31631d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:40.016232 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1b4655dc-90d9-4c1f-ab1b-8ea31d31631d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046923 Sep 05 17:12:40.016781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 659/1302] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:39 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:40.138479 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d0b5b63a-5d58-4e51-b22d-c185defee928 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:40.140861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d0b5b63a-5d58-4e51-b22d-c185defee928 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:40.147933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d0b5b63a-5d58-4e51-b22d-c185defee928 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:40.148416 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d0b5b63a-5d58-4e51-b22d-c185defee928 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:40.149126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d0b5b63a-5d58-4e51-b22d-c185defee928 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:40.149873 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d0b5b63a-5d58-4e51-b22d-c185defee928 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:40.150366 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d0b5b63a-5d58-4e51-b22d-c185defee928 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:40.150824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d0b5b63a-5d58-4e51-b22d-c185defee928 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:40.183170 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d0b5b63a-5d58-4e51-b22d-c185defee928 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051427 Sep 05 17:12:40.183717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 644/1303] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:40 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:41.000533 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c574c2ba-1932-49f7-bde5-b04837b13440 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:41.001162 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c574c2ba-1932-49f7-bde5-b04837b13440 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:41.007874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c574c2ba-1932-49f7-bde5-b04837b13440 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:41.008393 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c574c2ba-1932-49f7-bde5-b04837b13440 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:41.008828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c574c2ba-1932-49f7-bde5-b04837b13440 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:41.009516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c574c2ba-1932-49f7-bde5-b04837b13440 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:41.009963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c574c2ba-1932-49f7-bde5-b04837b13440 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:41.010381 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c574c2ba-1932-49f7-bde5-b04837b13440 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:41.029220 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-adbf96a5-3543-41b5-9e6b-a03605028cbd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:41.031556 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-adbf96a5-3543-41b5-9e6b-a03605028cbd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:41.038288 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-adbf96a5-3543-41b5-9e6b-a03605028cbd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:41.038764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-adbf96a5-3543-41b5-9e6b-a03605028cbd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:41.039169 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-adbf96a5-3543-41b5-9e6b-a03605028cbd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:41.039852 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-adbf96a5-3543-41b5-9e6b-a03605028cbd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:41.040333 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-adbf96a5-3543-41b5-9e6b-a03605028cbd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:41.040765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-adbf96a5-3543-41b5-9e6b-a03605028cbd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:41.071449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-adbf96a5-3543-41b5-9e6b-a03605028cbd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046308 Sep 05 17:12:41.072017 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 645/1304] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:41 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 17:12:41.076536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c574c2ba-1932-49f7-bde5-b04837b13440 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:41.088289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c574c2ba-1932-49f7-bde5-b04837b13440 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091501 Sep 05 17:12:41.089109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 660/1305] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:40 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:41.197013 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3335f679-70dd-4127-b066-063676848477 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:41.199352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3335f679-70dd-4127-b066-063676848477 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:41.208661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3335f679-70dd-4127-b066-063676848477 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:41.209359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3335f679-70dd-4127-b066-063676848477 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:41.210030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3335f679-70dd-4127-b066-063676848477 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:41.211115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3335f679-70dd-4127-b066-063676848477 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:41.211802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3335f679-70dd-4127-b066-063676848477 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:41.212446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3335f679-70dd-4127-b066-063676848477 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:41.244960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3335f679-70dd-4127-b066-063676848477 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052733 Sep 05 17:12:41.245509 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 646/1306] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:41 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:42.088668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-860d96a1-514e-42dd-87ba-91cf3a1339e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:42.092403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-860d96a1-514e-42dd-87ba-91cf3a1339e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:42.102814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-860d96a1-514e-42dd-87ba-91cf3a1339e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:42.103491 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-860d96a1-514e-42dd-87ba-91cf3a1339e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:42.104127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-860d96a1-514e-42dd-87ba-91cf3a1339e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:42.105211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-860d96a1-514e-42dd-87ba-91cf3a1339e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:42.105801 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-860d96a1-514e-42dd-87ba-91cf3a1339e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:42.106392 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-860d96a1-514e-42dd-87ba-91cf3a1339e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:42.114711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2ce78cc1-34e4-4268-86c0-ca2591816afa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:42.115390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2ce78cc1-34e4-4268-86c0-ca2591816afa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:42.124420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ce78cc1-34e4-4268-86c0-ca2591816afa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:42.125025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ce78cc1-34e4-4268-86c0-ca2591816afa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:42.125450 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ce78cc1-34e4-4268-86c0-ca2591816afa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:42.126165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ce78cc1-34e4-4268-86c0-ca2591816afa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:42.126607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ce78cc1-34e4-4268-86c0-ca2591816afa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:42.127006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ce78cc1-34e4-4268-86c0-ca2591816afa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:42.142067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-860d96a1-514e-42dd-87ba-91cf3a1339e8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060210 Sep 05 17:12:42.142615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 661/1307] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:42 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:42.192362 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2ce78cc1-34e4-4268-86c0-ca2591816afa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:42.203019 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2ce78cc1-34e4-4268-86c0-ca2591816afa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.094607 Sep 05 17:12:42.203602 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 647/1308] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:42 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:42.265230 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-abff1151-e243-47e5-81fa-539fc0163591 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:42.267708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-abff1151-e243-47e5-81fa-539fc0163591 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:42.274762 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abff1151-e243-47e5-81fa-539fc0163591 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:42.275298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abff1151-e243-47e5-81fa-539fc0163591 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:42.275776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abff1151-e243-47e5-81fa-539fc0163591 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:42.276581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abff1151-e243-47e5-81fa-539fc0163591 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:42.277076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abff1151-e243-47e5-81fa-539fc0163591 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:42.277547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abff1151-e243-47e5-81fa-539fc0163591 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:42.309749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-abff1151-e243-47e5-81fa-539fc0163591 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051881 Sep 05 17:12:42.310315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 662/1309] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:42 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:43.161754 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6789c53d-ceeb-423d-9b97-a56a84bffb48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:43.165337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6789c53d-ceeb-423d-9b97-a56a84bffb48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:43.175938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6789c53d-ceeb-423d-9b97-a56a84bffb48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:43.176439 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6789c53d-ceeb-423d-9b97-a56a84bffb48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:43.176865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6789c53d-ceeb-423d-9b97-a56a84bffb48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:43.177545 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6789c53d-ceeb-423d-9b97-a56a84bffb48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:43.177984 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6789c53d-ceeb-423d-9b97-a56a84bffb48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:43.178393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6789c53d-ceeb-423d-9b97-a56a84bffb48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:43.207562 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6789c53d-ceeb-423d-9b97-a56a84bffb48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053896 Sep 05 17:12:43.208365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 648/1310] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:43 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:43.226238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7344ea8c-8ccc-431f-98e7-d18bb329a5d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:43.226910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7344ea8c-8ccc-431f-98e7-d18bb329a5d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:43.234805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7344ea8c-8ccc-431f-98e7-d18bb329a5d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:43.235310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7344ea8c-8ccc-431f-98e7-d18bb329a5d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:43.235754 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7344ea8c-8ccc-431f-98e7-d18bb329a5d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:43.236455 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7344ea8c-8ccc-431f-98e7-d18bb329a5d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:43.236910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7344ea8c-8ccc-431f-98e7-d18bb329a5d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:43.237333 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7344ea8c-8ccc-431f-98e7-d18bb329a5d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:43.301227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7344ea8c-8ccc-431f-98e7-d18bb329a5d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:43.309661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7344ea8c-8ccc-431f-98e7-d18bb329a5d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087653 Sep 05 17:12:43.310232 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 663/1311] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:43 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:43.322677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2b08b8ca-2682-4dbb-af50-0c3a75220efa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:43.324895 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2b08b8ca-2682-4dbb-af50-0c3a75220efa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:43.331575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b08b8ca-2682-4dbb-af50-0c3a75220efa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:43.332047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b08b8ca-2682-4dbb-af50-0c3a75220efa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:43.332495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b08b8ca-2682-4dbb-af50-0c3a75220efa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:43.333175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b08b8ca-2682-4dbb-af50-0c3a75220efa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:43.333618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b08b8ca-2682-4dbb-af50-0c3a75220efa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:43.334030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b08b8ca-2682-4dbb-af50-0c3a75220efa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:43.363126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2b08b8ca-2682-4dbb-af50-0c3a75220efa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Sep 05 17:12:43.363679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 649/1312] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:43 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:44.222902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ce0bb89a-8076-44cb-9499-f7f5624df965 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:44.226304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ce0bb89a-8076-44cb-9499-f7f5624df965 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:44.235289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce0bb89a-8076-44cb-9499-f7f5624df965 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:44.235974 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce0bb89a-8076-44cb-9499-f7f5624df965 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:44.236650 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce0bb89a-8076-44cb-9499-f7f5624df965 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:44.237600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce0bb89a-8076-44cb-9499-f7f5624df965 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:44.238274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce0bb89a-8076-44cb-9499-f7f5624df965 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:44.238884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce0bb89a-8076-44cb-9499-f7f5624df965 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:44.271587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ce0bb89a-8076-44cb-9499-f7f5624df965 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054578 Sep 05 17:12:44.272141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 664/1313] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:44 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:44.336094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-636fbf4f-df18-464c-a3ca-6981f7f23755 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:44.337227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-636fbf4f-df18-464c-a3ca-6981f7f23755 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:44.345807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-636fbf4f-df18-464c-a3ca-6981f7f23755 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:44.346279 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-636fbf4f-df18-464c-a3ca-6981f7f23755 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:44.346702 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-636fbf4f-df18-464c-a3ca-6981f7f23755 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:44.347375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-636fbf4f-df18-464c-a3ca-6981f7f23755 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:44.347816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-636fbf4f-df18-464c-a3ca-6981f7f23755 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:44.348222 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-636fbf4f-df18-464c-a3ca-6981f7f23755 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:44.367511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:12:44.375902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-af7148a1-8c75-4938-ad42-8bca470314ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:44.378402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-af7148a1-8c75-4938-ad42-8bca470314ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:44.385491 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af7148a1-8c75-4938-ad42-8bca470314ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:44.385979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af7148a1-8c75-4938-ad42-8bca470314ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:44.386413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af7148a1-8c75-4938-ad42-8bca470314ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:44.387117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af7148a1-8c75-4938-ad42-8bca470314ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:44.387567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af7148a1-8c75-4938-ad42-8bca470314ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:44.387987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af7148a1-8c75-4938-ad42-8bca470314ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:44.390488 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:12:44.412116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-636fbf4f-df18-464c-a3ca-6981f7f23755 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:44.418472 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-af7148a1-8c75-4938-ad42-8bca470314ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046577 Sep 05 17:12:44.419006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 665/1314] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:44 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:44.420502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-636fbf4f-df18-464c-a3ca-6981f7f23755 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.090754 Sep 05 17:12:44.421235 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 650/1315] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:44 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:45.284535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-960ae697-a5c1-4b33-a6e3-c8e2c958645b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:45.287563 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-960ae697-a5c1-4b33-a6e3-c8e2c958645b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:45.294925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-960ae697-a5c1-4b33-a6e3-c8e2c958645b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:45.295402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-960ae697-a5c1-4b33-a6e3-c8e2c958645b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:45.295884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-960ae697-a5c1-4b33-a6e3-c8e2c958645b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:45.296637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-960ae697-a5c1-4b33-a6e3-c8e2c958645b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:45.297074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-960ae697-a5c1-4b33-a6e3-c8e2c958645b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:45.297484 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-960ae697-a5c1-4b33-a6e3-c8e2c958645b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:45.328071 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-960ae697-a5c1-4b33-a6e3-c8e2c958645b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047557 Sep 05 17:12:45.332710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 666/1316] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:45 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:45.433054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1943ce19-0558-4400-b661-f2bf87c102c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:45.435313 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1943ce19-0558-4400-b661-f2bf87c102c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:45.442252 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1943ce19-0558-4400-b661-f2bf87c102c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:45.442890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1943ce19-0558-4400-b661-f2bf87c102c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:45.443326 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1943ce19-0558-4400-b661-f2bf87c102c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:45.443463 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d54ad3d0-9f00-48d1-a9a9-bc3c56ee7fc9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:45.444023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1943ce19-0558-4400-b661-f2bf87c102c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:45.444240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d54ad3d0-9f00-48d1-a9a9-bc3c56ee7fc9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:45.444510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1943ce19-0558-4400-b661-f2bf87c102c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:45.444925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1943ce19-0558-4400-b661-f2bf87c102c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:45.450617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d54ad3d0-9f00-48d1-a9a9-bc3c56ee7fc9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:45.451389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d54ad3d0-9f00-48d1-a9a9-bc3c56ee7fc9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:45.451790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d54ad3d0-9f00-48d1-a9a9-bc3c56ee7fc9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:45.452523 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d54ad3d0-9f00-48d1-a9a9-bc3c56ee7fc9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:45.452997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d54ad3d0-9f00-48d1-a9a9-bc3c56ee7fc9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:45.453409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d54ad3d0-9f00-48d1-a9a9-bc3c56ee7fc9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:45.478839 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1943ce19-0558-4400-b661-f2bf87c102c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051002 Sep 05 17:12:45.482883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 651/1317] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:45 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:45.520692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d54ad3d0-9f00-48d1-a9a9-bc3c56ee7fc9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:45.528779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d54ad3d0-9f00-48d1-a9a9-bc3c56ee7fc9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.090028 Sep 05 17:12:45.530381 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 667/1318] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:45 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:46.341129 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2ffff541-857d-4d6f-9593-b3ca43fafaa1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:46.343425 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2ffff541-857d-4d6f-9593-b3ca43fafaa1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:46.350195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ffff541-857d-4d6f-9593-b3ca43fafaa1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:46.350670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ffff541-857d-4d6f-9593-b3ca43fafaa1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:46.351083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ffff541-857d-4d6f-9593-b3ca43fafaa1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:46.351757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ffff541-857d-4d6f-9593-b3ca43fafaa1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:46.352348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ffff541-857d-4d6f-9593-b3ca43fafaa1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:46.352771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ffff541-857d-4d6f-9593-b3ca43fafaa1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:46.383224 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2ffff541-857d-4d6f-9593-b3ca43fafaa1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046274 Sep 05 17:12:46.383790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 652/1319] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:46 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:46.491311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9a84bac4-e36d-4fb7-b7c3-657727ee15f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:46.493503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9a84bac4-e36d-4fb7-b7c3-657727ee15f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:46.500695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a84bac4-e36d-4fb7-b7c3-657727ee15f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:46.501168 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a84bac4-e36d-4fb7-b7c3-657727ee15f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:46.501591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a84bac4-e36d-4fb7-b7c3-657727ee15f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:46.502267 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a84bac4-e36d-4fb7-b7c3-657727ee15f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:46.502713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a84bac4-e36d-4fb7-b7c3-657727ee15f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:46.503131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a84bac4-e36d-4fb7-b7c3-657727ee15f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:46.533368 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9a84bac4-e36d-4fb7-b7c3-657727ee15f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046021 Sep 05 17:12:46.533833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 668/1320] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:46 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:46.552732 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-526533fa-1eec-42be-b757-b9fb8f9d58d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:46.553291 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-526533fa-1eec-42be-b757-b9fb8f9d58d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:46.559885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-526533fa-1eec-42be-b757-b9fb8f9d58d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:46.560574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-526533fa-1eec-42be-b757-b9fb8f9d58d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:46.561015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-526533fa-1eec-42be-b757-b9fb8f9d58d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:46.561695 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-526533fa-1eec-42be-b757-b9fb8f9d58d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:46.562134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-526533fa-1eec-42be-b757-b9fb8f9d58d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:46.562546 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-526533fa-1eec-42be-b757-b9fb8f9d58d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:46.629800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-526533fa-1eec-42be-b757-b9fb8f9d58d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:46.638113 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-526533fa-1eec-42be-b757-b9fb8f9d58d3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089269 Sep 05 17:12:46.638727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 653/1321] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:46 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:47.396643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5b3aae64-bb09-4042-be34-a50c91042797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:47.398785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5b3aae64-bb09-4042-be34-a50c91042797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:47.405143 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b3aae64-bb09-4042-be34-a50c91042797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:47.405645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b3aae64-bb09-4042-be34-a50c91042797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:47.406068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b3aae64-bb09-4042-be34-a50c91042797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:47.406748 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b3aae64-bb09-4042-be34-a50c91042797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:47.407190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b3aae64-bb09-4042-be34-a50c91042797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:47.407603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b3aae64-bb09-4042-be34-a50c91042797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:47.437424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5b3aae64-bb09-4042-be34-a50c91042797 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044948 Sep 05 17:12:47.437981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 669/1322] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:47 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:47.549507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-dcbe513f-100c-4400-a9aa-c3df3da45549 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:47.551667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-dcbe513f-100c-4400-a9aa-c3df3da45549 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:47.558471 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dcbe513f-100c-4400-a9aa-c3df3da45549 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:47.559079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dcbe513f-100c-4400-a9aa-c3df3da45549 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:47.559366 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dcbe513f-100c-4400-a9aa-c3df3da45549 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:47.560054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dcbe513f-100c-4400-a9aa-c3df3da45549 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:47.560536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dcbe513f-100c-4400-a9aa-c3df3da45549 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:47.560956 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dcbe513f-100c-4400-a9aa-c3df3da45549 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:47.590769 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-dcbe513f-100c-4400-a9aa-c3df3da45549 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046835 Sep 05 17:12:47.591328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 654/1323] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:47 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:47.671487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e2ffdbdd-a28f-464e-bc5c-604dce1f6064 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:47.672121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e2ffdbdd-a28f-464e-bc5c-604dce1f6064 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:47.678988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2ffdbdd-a28f-464e-bc5c-604dce1f6064 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:47.679462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2ffdbdd-a28f-464e-bc5c-604dce1f6064 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:47.679895 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2ffdbdd-a28f-464e-bc5c-604dce1f6064 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:47.680609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2ffdbdd-a28f-464e-bc5c-604dce1f6064 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:47.681050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2ffdbdd-a28f-464e-bc5c-604dce1f6064 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:47.681462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2ffdbdd-a28f-464e-bc5c-604dce1f6064 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:47.744171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e2ffdbdd-a28f-464e-bc5c-604dce1f6064 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:47.752406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e2ffdbdd-a28f-464e-bc5c-604dce1f6064 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087559 Sep 05 17:12:47.752959 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 670/1324] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:47 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:48.455757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3307a80b-108d-44ee-bd36-8a85e0c9be08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:48.458418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3307a80b-108d-44ee-bd36-8a85e0c9be08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:48.466266 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3307a80b-108d-44ee-bd36-8a85e0c9be08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:48.466857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3307a80b-108d-44ee-bd36-8a85e0c9be08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:48.467382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3307a80b-108d-44ee-bd36-8a85e0c9be08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:48.468282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3307a80b-108d-44ee-bd36-8a85e0c9be08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:48.468835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3307a80b-108d-44ee-bd36-8a85e0c9be08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:48.469353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3307a80b-108d-44ee-bd36-8a85e0c9be08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:48.502836 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3307a80b-108d-44ee-bd36-8a85e0c9be08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053075 Sep 05 17:12:48.503412 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 655/1325] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:48 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:48.605339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b267c956-1e10-4f0c-a399-d3a7021ddcd3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:48.607949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b267c956-1e10-4f0c-a399-d3a7021ddcd3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:48.616258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b267c956-1e10-4f0c-a399-d3a7021ddcd3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:48.616823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b267c956-1e10-4f0c-a399-d3a7021ddcd3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:48.617347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b267c956-1e10-4f0c-a399-d3a7021ddcd3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:48.618134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b267c956-1e10-4f0c-a399-d3a7021ddcd3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:48.618660 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b267c956-1e10-4f0c-a399-d3a7021ddcd3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:48.619155 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b267c956-1e10-4f0c-a399-d3a7021ddcd3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:48.650247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b267c956-1e10-4f0c-a399-d3a7021ddcd3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049574 Sep 05 17:12:48.650717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 671/1326] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:48 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:48.787187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a7e38729-f8ab-4162-808b-a8e00f2555c3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:48.787855 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a7e38729-f8ab-4162-808b-a8e00f2555c3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:48.797602 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7e38729-f8ab-4162-808b-a8e00f2555c3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:48.798308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7e38729-f8ab-4162-808b-a8e00f2555c3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:48.798934 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7e38729-f8ab-4162-808b-a8e00f2555c3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:48.800028 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7e38729-f8ab-4162-808b-a8e00f2555c3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:48.800779 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7e38729-f8ab-4162-808b-a8e00f2555c3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:48.801478 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7e38729-f8ab-4162-808b-a8e00f2555c3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:48.870899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a7e38729-f8ab-4162-808b-a8e00f2555c3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:48.883558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a7e38729-f8ab-4162-808b-a8e00f2555c3 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.102636 Sep 05 17:12:48.884311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 656/1327] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:48 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:49.520343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8cd47e5c-6015-4dd3-ae11-589f111df227 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:49.523818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8cd47e5c-6015-4dd3-ae11-589f111df227 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:49.533460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8cd47e5c-6015-4dd3-ae11-589f111df227 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:49.533941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8cd47e5c-6015-4dd3-ae11-589f111df227 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:49.534379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8cd47e5c-6015-4dd3-ae11-589f111df227 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:49.535058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8cd47e5c-6015-4dd3-ae11-589f111df227 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:49.536286 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8cd47e5c-6015-4dd3-ae11-589f111df227 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:49.536715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8cd47e5c-6015-4dd3-ae11-589f111df227 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:49.566221 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8cd47e5c-6015-4dd3-ae11-589f111df227 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053534 Sep 05 17:12:49.566778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 672/1328] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:49 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:49.667640 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b3740d20-3f5d-4221-b4c5-5c76fa91cd94 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:49.671081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b3740d20-3f5d-4221-b4c5-5c76fa91cd94 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:49.678212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3740d20-3f5d-4221-b4c5-5c76fa91cd94 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:49.678726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3740d20-3f5d-4221-b4c5-5c76fa91cd94 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:49.679180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3740d20-3f5d-4221-b4c5-5c76fa91cd94 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:49.679891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3740d20-3f5d-4221-b4c5-5c76fa91cd94 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:49.680448 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3740d20-3f5d-4221-b4c5-5c76fa91cd94 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:49.680851 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3740d20-3f5d-4221-b4c5-5c76fa91cd94 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:49.709979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b3740d20-3f5d-4221-b4c5-5c76fa91cd94 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049154 Sep 05 17:12:49.710521 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 657/1329] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:49 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:49.913069 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d1f8843e-ce16-4376-9bfc-6a8eb0d707cd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:49.914078 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d1f8843e-ce16-4376-9bfc-6a8eb0d707cd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:49.924122 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1f8843e-ce16-4376-9bfc-6a8eb0d707cd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:49.924723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1f8843e-ce16-4376-9bfc-6a8eb0d707cd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:49.925355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1f8843e-ce16-4376-9bfc-6a8eb0d707cd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:49.926346 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1f8843e-ce16-4376-9bfc-6a8eb0d707cd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:49.926967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1f8843e-ce16-4376-9bfc-6a8eb0d707cd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:49.927530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1f8843e-ce16-4376-9bfc-6a8eb0d707cd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:50.000873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d1f8843e-ce16-4376-9bfc-6a8eb0d707cd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:50.008954 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d1f8843e-ce16-4376-9bfc-6a8eb0d707cd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.103278 Sep 05 17:12:50.009531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 673/1330] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:49 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:50.581401 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-13ca66b4-8e8e-40cd-91e4-f850549e3440 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:50.583546 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-13ca66b4-8e8e-40cd-91e4-f850549e3440 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:50.590353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-13ca66b4-8e8e-40cd-91e4-f850549e3440 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:50.590885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-13ca66b4-8e8e-40cd-91e4-f850549e3440 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:50.591310 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-13ca66b4-8e8e-40cd-91e4-f850549e3440 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:50.591989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-13ca66b4-8e8e-40cd-91e4-f850549e3440 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:50.592466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-13ca66b4-8e8e-40cd-91e4-f850549e3440 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:50.592881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-13ca66b4-8e8e-40cd-91e4-f850549e3440 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:50.623647 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-13ca66b4-8e8e-40cd-91e4-f850549e3440 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047156 Sep 05 17:12:50.624193 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 658/1331] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:50 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:50.727000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e860cc52-fcbd-4fcb-b502-4b780283f47d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:50.730626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e860cc52-fcbd-4fcb-b502-4b780283f47d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:50.738903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e860cc52-fcbd-4fcb-b502-4b780283f47d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:50.739388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e860cc52-fcbd-4fcb-b502-4b780283f47d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:50.739835 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e860cc52-fcbd-4fcb-b502-4b780283f47d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:50.740589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e860cc52-fcbd-4fcb-b502-4b780283f47d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:50.741176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e860cc52-fcbd-4fcb-b502-4b780283f47d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:50.741686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e860cc52-fcbd-4fcb-b502-4b780283f47d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:50.772123 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e860cc52-fcbd-4fcb-b502-4b780283f47d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052295 Sep 05 17:12:50.772712 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 674/1332] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:50 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:51.034799 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9435de18-5ef6-4c58-bec2-7c203a66a154 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:51.035462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9435de18-5ef6-4c58-bec2-7c203a66a154 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:51.043715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9435de18-5ef6-4c58-bec2-7c203a66a154 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:51.044345 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9435de18-5ef6-4c58-bec2-7c203a66a154 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:51.044899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9435de18-5ef6-4c58-bec2-7c203a66a154 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:51.045751 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9435de18-5ef6-4c58-bec2-7c203a66a154 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:51.046294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9435de18-5ef6-4c58-bec2-7c203a66a154 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:51.046946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9435de18-5ef6-4c58-bec2-7c203a66a154 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:51.114119 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9435de18-5ef6-4c58-bec2-7c203a66a154 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:51.127893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9435de18-5ef6-4c58-bec2-7c203a66a154 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098868 Sep 05 17:12:51.128765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 659/1333] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:51 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:51.641843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8b1c1203-7e44-4963-af4a-6277980a7964 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:51.645311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8b1c1203-7e44-4963-af4a-6277980a7964 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:51.655541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b1c1203-7e44-4963-af4a-6277980a7964 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:51.656692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b1c1203-7e44-4963-af4a-6277980a7964 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:51.657439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b1c1203-7e44-4963-af4a-6277980a7964 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:51.658126 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b1c1203-7e44-4963-af4a-6277980a7964 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:51.658574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b1c1203-7e44-4963-af4a-6277980a7964 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:51.658992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b1c1203-7e44-4963-af4a-6277980a7964 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:51.689724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8b1c1203-7e44-4963-af4a-6277980a7964 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055594 Sep 05 17:12:51.690296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 675/1334] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:51 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:51.785837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4ece7131-6a37-4ef8-89ab-6dde6431b082 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:51.788005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4ece7131-6a37-4ef8-89ab-6dde6431b082 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:51.794915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ece7131-6a37-4ef8-89ab-6dde6431b082 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:51.795397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ece7131-6a37-4ef8-89ab-6dde6431b082 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:51.795829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ece7131-6a37-4ef8-89ab-6dde6431b082 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:51.796552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ece7131-6a37-4ef8-89ab-6dde6431b082 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:51.797515 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ece7131-6a37-4ef8-89ab-6dde6431b082 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:51.797939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4ece7131-6a37-4ef8-89ab-6dde6431b082 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:51.828697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4ece7131-6a37-4ef8-89ab-6dde6431b082 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047082 Sep 05 17:12:51.829248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 660/1335] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:51 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:52.156098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6560e414-95ec-406c-a28a-cb46ef5b0c03 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:52.156720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6560e414-95ec-406c-a28a-cb46ef5b0c03 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:52.165656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6560e414-95ec-406c-a28a-cb46ef5b0c03 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:52.166382 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6560e414-95ec-406c-a28a-cb46ef5b0c03 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:52.167087 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6560e414-95ec-406c-a28a-cb46ef5b0c03 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:52.168317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6560e414-95ec-406c-a28a-cb46ef5b0c03 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:52.168986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6560e414-95ec-406c-a28a-cb46ef5b0c03 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:52.169587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6560e414-95ec-406c-a28a-cb46ef5b0c03 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:52.234629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6560e414-95ec-406c-a28a-cb46ef5b0c03 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:52.242603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6560e414-95ec-406c-a28a-cb46ef5b0c03 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.090552 Sep 05 17:12:52.243165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 676/1336] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:52 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:52.712761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-72e579d4-333c-4c5e-8546-7cdb1d4956c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:52.716078 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-72e579d4-333c-4c5e-8546-7cdb1d4956c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:52.727123 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72e579d4-333c-4c5e-8546-7cdb1d4956c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:52.727920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72e579d4-333c-4c5e-8546-7cdb1d4956c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:52.728685 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72e579d4-333c-4c5e-8546-7cdb1d4956c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:52.729814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72e579d4-333c-4c5e-8546-7cdb1d4956c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:52.730559 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72e579d4-333c-4c5e-8546-7cdb1d4956c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:52.731258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72e579d4-333c-4c5e-8546-7cdb1d4956c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:52.769341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-72e579d4-333c-4c5e-8546-7cdb1d4956c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065219 Sep 05 17:12:52.769896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 661/1337] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:52 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:52.845886 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6489ce6e-4df8-4218-a565-f69374cb2fad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:52.849824 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6489ce6e-4df8-4218-a565-f69374cb2fad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:52.859895 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6489ce6e-4df8-4218-a565-f69374cb2fad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:52.860419 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6489ce6e-4df8-4218-a565-f69374cb2fad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:52.860867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6489ce6e-4df8-4218-a565-f69374cb2fad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:52.861521 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6489ce6e-4df8-4218-a565-f69374cb2fad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:52.861963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6489ce6e-4df8-4218-a565-f69374cb2fad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:52.862376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6489ce6e-4df8-4218-a565-f69374cb2fad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:52.892098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6489ce6e-4df8-4218-a565-f69374cb2fad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053142 Sep 05 17:12:52.892678 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 677/1338] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:52 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:53.270879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9ec8fa14-bc59-4f55-917c-2d5de79ccd4c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:53.271835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9ec8fa14-bc59-4f55-917c-2d5de79ccd4c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:53.282644 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ec8fa14-bc59-4f55-917c-2d5de79ccd4c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:53.283137 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ec8fa14-bc59-4f55-917c-2d5de79ccd4c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:53.283561 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ec8fa14-bc59-4f55-917c-2d5de79ccd4c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:53.284295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ec8fa14-bc59-4f55-917c-2d5de79ccd4c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:53.284754 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ec8fa14-bc59-4f55-917c-2d5de79ccd4c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:53.285163 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ec8fa14-bc59-4f55-917c-2d5de79ccd4c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:53.346307 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9ec8fa14-bc59-4f55-917c-2d5de79ccd4c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:53.354758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9ec8fa14-bc59-4f55-917c-2d5de79ccd4c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091444 Sep 05 17:12:53.355299 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 662/1339] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:53 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:53.785643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1f873850-ec70-4f0d-a7b7-d2492d06a950 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:53.788294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1f873850-ec70-4f0d-a7b7-d2492d06a950 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:53.796537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f873850-ec70-4f0d-a7b7-d2492d06a950 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:53.797159 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f873850-ec70-4f0d-a7b7-d2492d06a950 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:53.797685 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f873850-ec70-4f0d-a7b7-d2492d06a950 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:53.798540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f873850-ec70-4f0d-a7b7-d2492d06a950 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:53.799088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f873850-ec70-4f0d-a7b7-d2492d06a950 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:53.799599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f873850-ec70-4f0d-a7b7-d2492d06a950 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:53.832127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1f873850-ec70-4f0d-a7b7-d2492d06a950 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052444 Sep 05 17:12:53.832710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 678/1340] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:53 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:53.911470 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e9923cd6-42bc-4a04-969f-0cbd15747f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:53.915459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e9923cd6-42bc-4a04-969f-0cbd15747f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:53.925490 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9923cd6-42bc-4a04-969f-0cbd15747f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:53.926264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9923cd6-42bc-4a04-969f-0cbd15747f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:53.926972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9923cd6-42bc-4a04-969f-0cbd15747f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:53.928082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9923cd6-42bc-4a04-969f-0cbd15747f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:53.928865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9923cd6-42bc-4a04-969f-0cbd15747f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:53.929556 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e9923cd6-42bc-4a04-969f-0cbd15747f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:53.962346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e9923cd6-42bc-4a04-969f-0cbd15747f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057928 Sep 05 17:12:53.962888 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 663/1341] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:53 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:54.378273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-25a339ed-bd39-48ae-8c14-11a434cd7387 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:54.379063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-25a339ed-bd39-48ae-8c14-11a434cd7387 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:54.385251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25a339ed-bd39-48ae-8c14-11a434cd7387 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:54.385725 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25a339ed-bd39-48ae-8c14-11a434cd7387 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:54.386151 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25a339ed-bd39-48ae-8c14-11a434cd7387 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:54.386899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25a339ed-bd39-48ae-8c14-11a434cd7387 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:54.387345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25a339ed-bd39-48ae-8c14-11a434cd7387 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:54.387752 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25a339ed-bd39-48ae-8c14-11a434cd7387 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:54.455490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-25a339ed-bd39-48ae-8c14-11a434cd7387 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:54.463775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-25a339ed-bd39-48ae-8c14-11a434cd7387 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.090378 Sep 05 17:12:54.464372 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 679/1342] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:54 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:12:54.845994 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-02240840-4222-4428-a365-36f600b29b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:54.848262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-02240840-4222-4428-a365-36f600b29b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:54.855941 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02240840-4222-4428-a365-36f600b29b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:54.856467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02240840-4222-4428-a365-36f600b29b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:54.856942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02240840-4222-4428-a365-36f600b29b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:54.857658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02240840-4222-4428-a365-36f600b29b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:54.858125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02240840-4222-4428-a365-36f600b29b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:54.858556 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02240840-4222-4428-a365-36f600b29b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:54.888827 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-02240840-4222-4428-a365-36f600b29b4e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047332 Sep 05 17:12:54.889413 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 664/1343] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:54 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:54.978820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-08912536-a525-4346-8ebb-d9629fb4686b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:54.983028 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-08912536-a525-4346-8ebb-d9629fb4686b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:54.990618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08912536-a525-4346-8ebb-d9629fb4686b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:54.991102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08912536-a525-4346-8ebb-d9629fb4686b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:54.991540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08912536-a525-4346-8ebb-d9629fb4686b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:54.992269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08912536-a525-4346-8ebb-d9629fb4686b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:54.992722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08912536-a525-4346-8ebb-d9629fb4686b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:54.993145 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08912536-a525-4346-8ebb-d9629fb4686b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:55.023378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-08912536-a525-4346-8ebb-d9629fb4686b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051713 Sep 05 17:12:55.023952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 680/1344] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:54 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:55.487499 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0a224f02-8d41-41d5-9c6f-4f048477cb0f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:55.488126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0a224f02-8d41-41d5-9c6f-4f048477cb0f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:55.495029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a224f02-8d41-41d5-9c6f-4f048477cb0f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:55.495508 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a224f02-8d41-41d5-9c6f-4f048477cb0f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:55.495956 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a224f02-8d41-41d5-9c6f-4f048477cb0f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:55.496668 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a224f02-8d41-41d5-9c6f-4f048477cb0f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:55.497112 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a224f02-8d41-41d5-9c6f-4f048477cb0f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:55.497521 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0a224f02-8d41-41d5-9c6f-4f048477cb0f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:55.571833 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0a224f02-8d41-41d5-9c6f-4f048477cb0f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:55.584062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0a224f02-8d41-41d5-9c6f-4f048477cb0f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.100453 Sep 05 17:12:55.584914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 665/1345] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:55 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:55.987646 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-da267e5f-b588-4a5d-bb8a-e929dd8b85f9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:55.989827 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-da267e5f-b588-4a5d-bb8a-e929dd8b85f9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:55.996449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da267e5f-b588-4a5d-bb8a-e929dd8b85f9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:55.996924 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da267e5f-b588-4a5d-bb8a-e929dd8b85f9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:55.997463 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da267e5f-b588-4a5d-bb8a-e929dd8b85f9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:55.998099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da267e5f-b588-4a5d-bb8a-e929dd8b85f9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:55.998543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da267e5f-b588-4a5d-bb8a-e929dd8b85f9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:55.998957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da267e5f-b588-4a5d-bb8a-e929dd8b85f9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:56.025119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:12:56.033513 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-da267e5f-b588-4a5d-bb8a-e929dd8b85f9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.133856 Sep 05 17:12:56.034089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 681/1346] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:55 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:56.036736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-265c581c-d39e-4009-b879-ad0ebdc7a8a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:56.038937 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-265c581c-d39e-4009-b879-ad0ebdc7a8a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:56.045876 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-265c581c-d39e-4009-b879-ad0ebdc7a8a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:56.046357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-265c581c-d39e-4009-b879-ad0ebdc7a8a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:56.046789 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-265c581c-d39e-4009-b879-ad0ebdc7a8a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:56.047542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-265c581c-d39e-4009-b879-ad0ebdc7a8a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:56.048048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-265c581c-d39e-4009-b879-ad0ebdc7a8a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:56.048511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-265c581c-d39e-4009-b879-ad0ebdc7a8a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:56.078725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-265c581c-d39e-4009-b879-ad0ebdc7a8a8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045998 Sep 05 17:12:56.079289 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 666/1347] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:56 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:56.607086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b8b5e5b0-2a9b-45fe-b51f-48244b41da2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:56.607697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b8b5e5b0-2a9b-45fe-b51f-48244b41da2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:56.614038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8b5e5b0-2a9b-45fe-b51f-48244b41da2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:56.614516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8b5e5b0-2a9b-45fe-b51f-48244b41da2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:56.614947 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8b5e5b0-2a9b-45fe-b51f-48244b41da2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:56.615635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8b5e5b0-2a9b-45fe-b51f-48244b41da2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:56.616080 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8b5e5b0-2a9b-45fe-b51f-48244b41da2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:56.616524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8b5e5b0-2a9b-45fe-b51f-48244b41da2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:56.683457 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b8b5e5b0-2a9b-45fe-b51f-48244b41da2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:56.692345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b8b5e5b0-2a9b-45fe-b51f-48244b41da2f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089215 Sep 05 17:12:56.692911 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 682/1348] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:56 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:57.051810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c5239d67-336d-4b10-b58b-bb38842cbaa0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:57.055316 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c5239d67-336d-4b10-b58b-bb38842cbaa0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:57.065690 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c5239d67-336d-4b10-b58b-bb38842cbaa0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:57.066167 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c5239d67-336d-4b10-b58b-bb38842cbaa0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:57.066594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c5239d67-336d-4b10-b58b-bb38842cbaa0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:57.067282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c5239d67-336d-4b10-b58b-bb38842cbaa0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:57.067731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c5239d67-336d-4b10-b58b-bb38842cbaa0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:57.068167 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c5239d67-336d-4b10-b58b-bb38842cbaa0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:57.071822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:12:57.091285 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c0074987-9781-4335-9bf5-e2b7b35256cf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:57.093987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c0074987-9781-4335-9bf5-e2b7b35256cf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:57.101036 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0074987-9781-4335-9bf5-e2b7b35256cf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:57.101644 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0074987-9781-4335-9bf5-e2b7b35256cf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:57.101821 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c5239d67-336d-4b10-b58b-bb38842cbaa0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057714 Sep 05 17:12:57.102182 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0074987-9781-4335-9bf5-e2b7b35256cf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:57.102381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 667/1349] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:57 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:57.107163 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0074987-9781-4335-9bf5-e2b7b35256cf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:57.107642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0074987-9781-4335-9bf5-e2b7b35256cf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:57.108080 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0074987-9781-4335-9bf5-e2b7b35256cf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:57.140189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c0074987-9781-4335-9bf5-e2b7b35256cf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052895 Sep 05 17:12:57.140920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 683/1350] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:57 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:57.719653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-63449cee-2596-451d-9552-fd408d89debf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:57.720229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-63449cee-2596-451d-9552-fd408d89debf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:57.727842 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63449cee-2596-451d-9552-fd408d89debf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:57.728424 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63449cee-2596-451d-9552-fd408d89debf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:57.728895 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63449cee-2596-451d-9552-fd408d89debf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:57.729640 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63449cee-2596-451d-9552-fd408d89debf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:57.730128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63449cee-2596-451d-9552-fd408d89debf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:57.730617 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63449cee-2596-451d-9552-fd408d89debf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:57.807163 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-63449cee-2596-451d-9552-fd408d89debf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:57.815748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-63449cee-2596-451d-9552-fd408d89debf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.102695 Sep 05 17:12:57.816353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 668/1351] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:57 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:58.115763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-86123f96-da66-46fd-b5ba-b7614687644e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:58.117966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-86123f96-da66-46fd-b5ba-b7614687644e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:58.124450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86123f96-da66-46fd-b5ba-b7614687644e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:58.124920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86123f96-da66-46fd-b5ba-b7614687644e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:58.125564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86123f96-da66-46fd-b5ba-b7614687644e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:58.126264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86123f96-da66-46fd-b5ba-b7614687644e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:58.126728 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86123f96-da66-46fd-b5ba-b7614687644e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:58.127123 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86123f96-da66-46fd-b5ba-b7614687644e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:58.153742 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ad00e3ae-946b-4734-9fe7-7c8741f7db55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:58.155914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ad00e3ae-946b-4734-9fe7-7c8741f7db55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:58.159369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-86123f96-da66-46fd-b5ba-b7614687644e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047997 Sep 05 17:12:58.159940 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 684/1352] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:58 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:58.162565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ad00e3ae-946b-4734-9fe7-7c8741f7db55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:58.163055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ad00e3ae-946b-4734-9fe7-7c8741f7db55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:58.163491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ad00e3ae-946b-4734-9fe7-7c8741f7db55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:58.164186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ad00e3ae-946b-4734-9fe7-7c8741f7db55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:58.164673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ad00e3ae-946b-4734-9fe7-7c8741f7db55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:58.165094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ad00e3ae-946b-4734-9fe7-7c8741f7db55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:58.196057 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ad00e3ae-946b-4734-9fe7-7c8741f7db55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046494 Sep 05 17:12:58.196697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 669/1353] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:58 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:58.842562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ff57b4e7-a0ce-461f-a6cb-cb14980873be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:58.843514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ff57b4e7-a0ce-461f-a6cb-cb14980873be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:58.854189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff57b4e7-a0ce-461f-a6cb-cb14980873be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:58.854980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff57b4e7-a0ce-461f-a6cb-cb14980873be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:58.855690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff57b4e7-a0ce-461f-a6cb-cb14980873be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:58.856958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff57b4e7-a0ce-461f-a6cb-cb14980873be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:58.857688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff57b4e7-a0ce-461f-a6cb-cb14980873be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:58.858375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff57b4e7-a0ce-461f-a6cb-cb14980873be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:58.925621 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ff57b4e7-a0ce-461f-a6cb-cb14980873be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:12:58.937864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ff57b4e7-a0ce-461f-a6cb-cb14980873be tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.101445 Sep 05 17:12:58.938637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 685/1354] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:58 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:12:59.173509 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6870561c-968c-4beb-8eae-2307704ed423 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:59.176316 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6870561c-968c-4beb-8eae-2307704ed423 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:59.188504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6870561c-968c-4beb-8eae-2307704ed423 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:59.189027 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6870561c-968c-4beb-8eae-2307704ed423 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:59.189542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6870561c-968c-4beb-8eae-2307704ed423 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:59.190696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6870561c-968c-4beb-8eae-2307704ed423 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:59.191166 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6870561c-968c-4beb-8eae-2307704ed423 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:59.191608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6870561c-968c-4beb-8eae-2307704ed423 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:59.210043 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a44f35b4-6ff8-4ad5-a2e0-98c963751417 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:59.212399 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a44f35b4-6ff8-4ad5-a2e0-98c963751417 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:59.219213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a44f35b4-6ff8-4ad5-a2e0-98c963751417 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:59.219691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a44f35b4-6ff8-4ad5-a2e0-98c963751417 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:59.220104 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a44f35b4-6ff8-4ad5-a2e0-98c963751417 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:59.220860 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a44f35b4-6ff8-4ad5-a2e0-98c963751417 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:59.221308 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a44f35b4-6ff8-4ad5-a2e0-98c963751417 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:59.221720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a44f35b4-6ff8-4ad5-a2e0-98c963751417 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:59.225573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6870561c-968c-4beb-8eae-2307704ed423 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057747 Sep 05 17:12:59.226135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 670/1355] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:12:59 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:12:59.252409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a44f35b4-6ff8-4ad5-a2e0-98c963751417 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046328 Sep 05 17:12:59.252937 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 686/1356] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:12:59 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:12:59.964753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b77e25eb-19c4-4162-9041-da197f3a1b3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:12:59.965361 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b77e25eb-19c4-4162-9041-da197f3a1b3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:12:59.974811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b77e25eb-19c4-4162-9041-da197f3a1b3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:59.975293 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b77e25eb-19c4-4162-9041-da197f3a1b3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:59.975720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b77e25eb-19c4-4162-9041-da197f3a1b3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:12:59.976451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b77e25eb-19c4-4162-9041-da197f3a1b3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:12:59.976903 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b77e25eb-19c4-4162-9041-da197f3a1b3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:12:59.977333 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b77e25eb-19c4-4162-9041-da197f3a1b3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:00.052181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b77e25eb-19c4-4162-9041-da197f3a1b3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:00.064606 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b77e25eb-19c4-4162-9041-da197f3a1b3a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.103887 Sep 05 17:13:00.065181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 671/1357] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:12:59 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:00.245492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-343f72d1-8660-4156-9d65-52b78528e550 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:00.248848 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-343f72d1-8660-4156-9d65-52b78528e550 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:00.256702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-343f72d1-8660-4156-9d65-52b78528e550 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:00.257183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-343f72d1-8660-4156-9d65-52b78528e550 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:00.257618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-343f72d1-8660-4156-9d65-52b78528e550 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:00.259458 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-343f72d1-8660-4156-9d65-52b78528e550 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:00.260186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-343f72d1-8660-4156-9d65-52b78528e550 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:00.260643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-343f72d1-8660-4156-9d65-52b78528e550 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:00.267788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2de33857-72c8-4670-bdfe-50747e7b8224 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:00.270024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2de33857-72c8-4670-bdfe-50747e7b8224 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:00.276933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2de33857-72c8-4670-bdfe-50747e7b8224 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:00.277420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2de33857-72c8-4670-bdfe-50747e7b8224 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:00.277842 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2de33857-72c8-4670-bdfe-50747e7b8224 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:00.278507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2de33857-72c8-4670-bdfe-50747e7b8224 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:00.278979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2de33857-72c8-4670-bdfe-50747e7b8224 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:00.279371 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2de33857-72c8-4670-bdfe-50747e7b8224 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:00.309480 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-343f72d1-8660-4156-9d65-52b78528e550 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072113 Sep 05 17:13:00.310141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 687/1358] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:00 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:00.312120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2de33857-72c8-4670-bdfe-50747e7b8224 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050735 Sep 05 17:13:00.314543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 672/1359] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:00 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:01.093310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0bccb500-cee9-4d70-9335-c5bc0f376a26 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:01.094059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0bccb500-cee9-4d70-9335-c5bc0f376a26 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:01.101423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bccb500-cee9-4d70-9335-c5bc0f376a26 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:01.101961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bccb500-cee9-4d70-9335-c5bc0f376a26 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:01.102442 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bccb500-cee9-4d70-9335-c5bc0f376a26 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:01.103172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bccb500-cee9-4d70-9335-c5bc0f376a26 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:01.103673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bccb500-cee9-4d70-9335-c5bc0f376a26 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:01.104191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bccb500-cee9-4d70-9335-c5bc0f376a26 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:01.167294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0bccb500-cee9-4d70-9335-c5bc0f376a26 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:01.175144 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0bccb500-cee9-4d70-9335-c5bc0f376a26 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086306 Sep 05 17:13:01.175693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 688/1360] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:01 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:01.326660 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5f9902fd-bbbc-4893-bad3-e2ce4ae57ce2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:01.329845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0f8cd36e-8876-4249-a47f-0bb98b4a7dce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:01.330593 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5f9902fd-bbbc-4893-bad3-e2ce4ae57ce2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:01.333427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0f8cd36e-8876-4249-a47f-0bb98b4a7dce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:01.343061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f9902fd-bbbc-4893-bad3-e2ce4ae57ce2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:01.344181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f9902fd-bbbc-4893-bad3-e2ce4ae57ce2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:01.344400 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f9902fd-bbbc-4893-bad3-e2ce4ae57ce2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:01.345455 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f8cd36e-8876-4249-a47f-0bb98b4a7dce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:01.345627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f9902fd-bbbc-4893-bad3-e2ce4ae57ce2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:01.345732 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f8cd36e-8876-4249-a47f-0bb98b4a7dce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:01.345834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f9902fd-bbbc-4893-bad3-e2ce4ae57ce2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:01.346079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f9902fd-bbbc-4893-bad3-e2ce4ae57ce2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:01.346205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f8cd36e-8876-4249-a47f-0bb98b4a7dce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:01.346873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f8cd36e-8876-4249-a47f-0bb98b4a7dce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:01.347329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f8cd36e-8876-4249-a47f-0bb98b4a7dce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:01.347916 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f8cd36e-8876-4249-a47f-0bb98b4a7dce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:01.379733 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5f9902fd-bbbc-4893-bad3-e2ce4ae57ce2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059260 Sep 05 17:13:01.380130 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 673/1361] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:01 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:01.384432 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0f8cd36e-8876-4249-a47f-0bb98b4a7dce tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062209 Sep 05 17:13:01.385025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 689/1362] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:01 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:02.201997 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e1050d33-a22b-4863-b478-8e1ce9825dd7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:02.203015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e1050d33-a22b-4863-b478-8e1ce9825dd7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:02.213286 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1050d33-a22b-4863-b478-8e1ce9825dd7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:02.214099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1050d33-a22b-4863-b478-8e1ce9825dd7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:02.214818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1050d33-a22b-4863-b478-8e1ce9825dd7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:02.215949 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1050d33-a22b-4863-b478-8e1ce9825dd7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:02.216761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1050d33-a22b-4863-b478-8e1ce9825dd7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:02.217467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e1050d33-a22b-4863-b478-8e1ce9825dd7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:02.279302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e1050d33-a22b-4863-b478-8e1ce9825dd7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:02.287890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e1050d33-a22b-4863-b478-8e1ce9825dd7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092500 Sep 05 17:13:02.288507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 674/1363] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:02 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:02.392208 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-411005a5-5026-4122-976a-17ccf139deb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:02.394541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-411005a5-5026-4122-976a-17ccf139deb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:02.396948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=84 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:13:02.398062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4d4afce5-4afb-4bb0-b757-d07cb5a644de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:02.400597 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4d4afce5-4afb-4bb0-b757-d07cb5a644de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:02.401693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-411005a5-5026-4122-976a-17ccf139deb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:02.402281 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-411005a5-5026-4122-976a-17ccf139deb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:02.402608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-411005a5-5026-4122-976a-17ccf139deb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:02.403332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-411005a5-5026-4122-976a-17ccf139deb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:02.404120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-411005a5-5026-4122-976a-17ccf139deb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:02.404302 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-411005a5-5026-4122-976a-17ccf139deb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:02.407262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d4afce5-4afb-4bb0-b757-d07cb5a644de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:02.407865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d4afce5-4afb-4bb0-b757-d07cb5a644de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:02.408354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d4afce5-4afb-4bb0-b757-d07cb5a644de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:02.409056 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d4afce5-4afb-4bb0-b757-d07cb5a644de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:02.409508 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d4afce5-4afb-4bb0-b757-d07cb5a644de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:02.409948 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d4afce5-4afb-4bb0-b757-d07cb5a644de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:02.437400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-411005a5-5026-4122-976a-17ccf139deb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049371 Sep 05 17:13:02.438139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 690/1364] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:02 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:02.444180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4d4afce5-4afb-4bb0-b757-d07cb5a644de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050645 Sep 05 17:13:02.444753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 675/1365] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:02 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:03.319236 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-42b45377-29e5-4569-a224-c23cd752e84c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:03.319822 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-42b45377-29e5-4569-a224-c23cd752e84c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:03.326452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42b45377-29e5-4569-a224-c23cd752e84c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:03.326926 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42b45377-29e5-4569-a224-c23cd752e84c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:03.327384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42b45377-29e5-4569-a224-c23cd752e84c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:03.328192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42b45377-29e5-4569-a224-c23cd752e84c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:03.328845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42b45377-29e5-4569-a224-c23cd752e84c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:03.329284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42b45377-29e5-4569-a224-c23cd752e84c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:03.395654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-42b45377-29e5-4569-a224-c23cd752e84c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:03.404375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-42b45377-29e5-4569-a224-c23cd752e84c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089173 Sep 05 17:13:03.404971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 691/1366] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:03 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:03.450401 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f0e1937d-bf67-470d-9848-f5b151fcae55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:03.452661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f0e1937d-bf67-470d-9848-f5b151fcae55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:03.456608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-46fdae71-0d91-4cf2-8610-18cf5140dd50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:03.458754 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-46fdae71-0d91-4cf2-8610-18cf5140dd50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:03.459427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0e1937d-bf67-470d-9848-f5b151fcae55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:03.459903 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0e1937d-bf67-470d-9848-f5b151fcae55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:03.460333 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0e1937d-bf67-470d-9848-f5b151fcae55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:03.461030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0e1937d-bf67-470d-9848-f5b151fcae55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:03.461475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0e1937d-bf67-470d-9848-f5b151fcae55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:03.461899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0e1937d-bf67-470d-9848-f5b151fcae55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:03.464661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46fdae71-0d91-4cf2-8610-18cf5140dd50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:03.465132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46fdae71-0d91-4cf2-8610-18cf5140dd50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:03.465551 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46fdae71-0d91-4cf2-8610-18cf5140dd50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:03.466230 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46fdae71-0d91-4cf2-8610-18cf5140dd50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:03.466669 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46fdae71-0d91-4cf2-8610-18cf5140dd50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:03.467082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46fdae71-0d91-4cf2-8610-18cf5140dd50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:03.492691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f0e1937d-bf67-470d-9848-f5b151fcae55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046369 Sep 05 17:13:03.493303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 676/1367] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:03 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:03.497531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-46fdae71-0d91-4cf2-8610-18cf5140dd50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Sep 05 17:13:03.498057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 692/1368] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:03 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:13:04.427515 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4d514911-e131-4c44-9994-ec9419f06f76 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:04.428130 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4d514911-e131-4c44-9994-ec9419f06f76 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:04.434530 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d514911-e131-4c44-9994-ec9419f06f76 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:04.435004 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d514911-e131-4c44-9994-ec9419f06f76 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:04.435428 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d514911-e131-4c44-9994-ec9419f06f76 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:04.436106 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d514911-e131-4c44-9994-ec9419f06f76 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:04.436587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d514911-e131-4c44-9994-ec9419f06f76 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:04.437001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d514911-e131-4c44-9994-ec9419f06f76 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:04.505528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-78866733-7711-4ed1-8b8c-14cde2186df5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:04.507370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4d514911-e131-4c44-9994-ec9419f06f76 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:04.507905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-78866733-7711-4ed1-8b8c-14cde2186df5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:04.514422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78866733-7711-4ed1-8b8c-14cde2186df5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:04.514906 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78866733-7711-4ed1-8b8c-14cde2186df5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:04.515339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78866733-7711-4ed1-8b8c-14cde2186df5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:04.515650 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4d514911-e131-4c44-9994-ec9419f06f76 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092026 Sep 05 17:13:04.516024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78866733-7711-4ed1-8b8c-14cde2186df5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:04.516530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78866733-7711-4ed1-8b8c-14cde2186df5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:04.516704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 677/1369] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:04 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:04.516959 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78866733-7711-4ed1-8b8c-14cde2186df5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:04.521626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4a8b25f4-f9b8-4a4a-b765-58a8d7946ecd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:04.523239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4a8b25f4-f9b8-4a4a-b765-58a8d7946ecd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:04.529062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a8b25f4-f9b8-4a4a-b765-58a8d7946ecd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:04.529534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a8b25f4-f9b8-4a4a-b765-58a8d7946ecd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:04.529955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a8b25f4-f9b8-4a4a-b765-58a8d7946ecd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:04.530638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a8b25f4-f9b8-4a4a-b765-58a8d7946ecd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:04.531146 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a8b25f4-f9b8-4a4a-b765-58a8d7946ecd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:04.531993 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a8b25f4-f9b8-4a4a-b765-58a8d7946ecd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:04.547798 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-78866733-7711-4ed1-8b8c-14cde2186df5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046486 Sep 05 17:13:04.548440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 693/1370] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:04 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:04.561837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4a8b25f4-f9b8-4a4a-b765-58a8d7946ecd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044242 Sep 05 17:13:04.562421 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 678/1371] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:04 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:05.543570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8e31559a-8d01-4bba-8ac4-30bfdc8caa0b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:05.544526 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8e31559a-8d01-4bba-8ac4-30bfdc8caa0b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:05.552189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e31559a-8d01-4bba-8ac4-30bfdc8caa0b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:05.552714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e31559a-8d01-4bba-8ac4-30bfdc8caa0b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:05.553136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e31559a-8d01-4bba-8ac4-30bfdc8caa0b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:05.553853 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e31559a-8d01-4bba-8ac4-30bfdc8caa0b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:05.554292 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e31559a-8d01-4bba-8ac4-30bfdc8caa0b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:05.554708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e31559a-8d01-4bba-8ac4-30bfdc8caa0b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:05.560604 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-dc75692e-032b-45c0-a492-f5bd582ce0ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:05.563088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-dc75692e-032b-45c0-a492-f5bd582ce0ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:05.565535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=84 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:13:05.570767 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dc75692e-032b-45c0-a492-f5bd582ce0ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:05.571279 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dc75692e-032b-45c0-a492-f5bd582ce0ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:05.571701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dc75692e-032b-45c0-a492-f5bd582ce0ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:05.572413 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dc75692e-032b-45c0-a492-f5bd582ce0ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:05.572859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dc75692e-032b-45c0-a492-f5bd582ce0ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:05.573252 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dc75692e-032b-45c0-a492-f5bd582ce0ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:05.604852 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-dc75692e-032b-45c0-a492-f5bd582ce0ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048194 Sep 05 17:13:05.605401 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 679/1372] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:05 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:05.610373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-72bffcc3-c985-409b-8a4b-d7719b64b7ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:05.612567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-72bffcc3-c985-409b-8a4b-d7719b64b7ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:05.617873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8e31559a-8d01-4bba-8ac4-30bfdc8caa0b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:05.618577 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72bffcc3-c985-409b-8a4b-d7719b64b7ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:05.619060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72bffcc3-c985-409b-8a4b-d7719b64b7ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:05.619480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72bffcc3-c985-409b-8a4b-d7719b64b7ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:05.620194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72bffcc3-c985-409b-8a4b-d7719b64b7ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:05.620627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72bffcc3-c985-409b-8a4b-d7719b64b7ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:05.621034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72bffcc3-c985-409b-8a4b-d7719b64b7ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:05.625741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8e31559a-8d01-4bba-8ac4-30bfdc8caa0b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.088762 Sep 05 17:13:05.626320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 694/1373] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:05 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:05.649664 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-72bffcc3-c985-409b-8a4b-d7719b64b7ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043030 Sep 05 17:13:05.650192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 680/1374] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:05 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:06.619968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2d700c48-bb38-45df-88fa-f955c227bdc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:06.623004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2d700c48-bb38-45df-88fa-f955c227bdc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:06.630498 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d700c48-bb38-45df-88fa-f955c227bdc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:06.630979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d700c48-bb38-45df-88fa-f955c227bdc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:06.631413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d700c48-bb38-45df-88fa-f955c227bdc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:06.632101 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d700c48-bb38-45df-88fa-f955c227bdc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:06.632593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d700c48-bb38-45df-88fa-f955c227bdc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:06.633011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d700c48-bb38-45df-88fa-f955c227bdc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:06.648120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-20b30871-3331-4186-9143-ace44ef0ddaf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:06.648834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-20b30871-3331-4186-9143-ace44ef0ddaf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:06.655654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-20b30871-3331-4186-9143-ace44ef0ddaf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:06.656375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-20b30871-3331-4186-9143-ace44ef0ddaf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:06.657110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-20b30871-3331-4186-9143-ace44ef0ddaf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:06.657639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-20b30871-3331-4186-9143-ace44ef0ddaf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:06.658082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-20b30871-3331-4186-9143-ace44ef0ddaf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:06.658495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-20b30871-3331-4186-9143-ace44ef0ddaf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:06.664988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2d700c48-bb38-45df-88fa-f955c227bdc5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051419 Sep 05 17:13:06.665640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 695/1375] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:06 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:06.670478 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-edcbfb62-14d2-4550-b4ed-80c7b4e8481d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:06.673253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-edcbfb62-14d2-4550-b4ed-80c7b4e8481d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:06.679176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edcbfb62-14d2-4550-b4ed-80c7b4e8481d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:06.679657 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edcbfb62-14d2-4550-b4ed-80c7b4e8481d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:06.680077 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edcbfb62-14d2-4550-b4ed-80c7b4e8481d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:06.680798 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edcbfb62-14d2-4550-b4ed-80c7b4e8481d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:06.681244 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edcbfb62-14d2-4550-b4ed-80c7b4e8481d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:06.681663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edcbfb62-14d2-4550-b4ed-80c7b4e8481d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:06.712427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-edcbfb62-14d2-4550-b4ed-80c7b4e8481d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045684 Sep 05 17:13:06.712972 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 696/1376] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:06 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:06.720999 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-20b30871-3331-4186-9143-ace44ef0ddaf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:06.729590 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-20b30871-3331-4186-9143-ace44ef0ddaf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.085395 Sep 05 17:13:06.730118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 681/1377] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:06 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:07.683032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-397ae577-19b7-4d42-9842-17e57b790d6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:07.686421 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-397ae577-19b7-4d42-9842-17e57b790d6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:07.697737 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-397ae577-19b7-4d42-9842-17e57b790d6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:07.698522 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-397ae577-19b7-4d42-9842-17e57b790d6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:07.699228 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-397ae577-19b7-4d42-9842-17e57b790d6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:07.700417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-397ae577-19b7-4d42-9842-17e57b790d6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:07.701159 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-397ae577-19b7-4d42-9842-17e57b790d6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:07.701846 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-397ae577-19b7-4d42-9842-17e57b790d6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:07.725960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7e28b5cb-cd2c-4bb4-a3fb-3e6403ef2d4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:07.728142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7e28b5cb-cd2c-4bb4-a3fb-3e6403ef2d4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:07.733298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-397ae577-19b7-4d42-9842-17e57b790d6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057204 Sep 05 17:13:07.733936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 697/1378] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:07 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:07.735025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e28b5cb-cd2c-4bb4-a3fb-3e6403ef2d4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:07.735501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e28b5cb-cd2c-4bb4-a3fb-3e6403ef2d4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:07.735923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e28b5cb-cd2c-4bb4-a3fb-3e6403ef2d4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:07.736637 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e28b5cb-cd2c-4bb4-a3fb-3e6403ef2d4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:07.737079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e28b5cb-cd2c-4bb4-a3fb-3e6403ef2d4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:07.737488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e28b5cb-cd2c-4bb4-a3fb-3e6403ef2d4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:07.752117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-599548a9-b279-40ff-8e66-95693f366821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:07.752784 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-599548a9-b279-40ff-8e66-95693f366821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:07.759010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-599548a9-b279-40ff-8e66-95693f366821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:07.759492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-599548a9-b279-40ff-8e66-95693f366821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:07.759923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-599548a9-b279-40ff-8e66-95693f366821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:07.760740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-599548a9-b279-40ff-8e66-95693f366821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:07.761185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-599548a9-b279-40ff-8e66-95693f366821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:07.761606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-599548a9-b279-40ff-8e66-95693f366821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:07.768331 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7e28b5cb-cd2c-4bb4-a3fb-3e6403ef2d4c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046685 Sep 05 17:13:07.768908 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 682/1379] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:07 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:07.777534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:13:07.832872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-599548a9-b279-40ff-8e66-95693f366821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:07.840785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-599548a9-b279-40ff-8e66-95693f366821 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092530 Sep 05 17:13:07.841362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 698/1380] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:07 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:08.751499 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e23228a0-ec72-43b7-b347-07244b739e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:08.753719 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e23228a0-ec72-43b7-b347-07244b739e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:08.760949 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e23228a0-ec72-43b7-b347-07244b739e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:08.761462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e23228a0-ec72-43b7-b347-07244b739e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:08.761912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e23228a0-ec72-43b7-b347-07244b739e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:08.762647 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e23228a0-ec72-43b7-b347-07244b739e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:08.763114 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e23228a0-ec72-43b7-b347-07244b739e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:08.763554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e23228a0-ec72-43b7-b347-07244b739e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:08.780571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e1f62c06-b8aa-470b-94bd-9baf7897a190 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:08.782914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e1f62c06-b8aa-470b-94bd-9baf7897a190 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:08.789652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1f62c06-b8aa-470b-94bd-9baf7897a190 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:08.790134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1f62c06-b8aa-470b-94bd-9baf7897a190 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:08.790565 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1f62c06-b8aa-470b-94bd-9baf7897a190 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:08.791250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1f62c06-b8aa-470b-94bd-9baf7897a190 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:08.791697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1f62c06-b8aa-470b-94bd-9baf7897a190 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:08.792116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1f62c06-b8aa-470b-94bd-9baf7897a190 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:08.793929 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:13:08.796501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e23228a0-ec72-43b7-b347-07244b739e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052116 Sep 05 17:13:08.797821 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 683/1381] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:08 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:08.825299 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e1f62c06-b8aa-470b-94bd-9baf7897a190 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048982 Sep 05 17:13:08.825820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 699/1382] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:08 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:08.864109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5ca61e17-3da0-435d-8848-99cea854558e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:08.864728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5ca61e17-3da0-435d-8848-99cea854558e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:08.871302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ca61e17-3da0-435d-8848-99cea854558e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:08.871783 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ca61e17-3da0-435d-8848-99cea854558e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:08.872247 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ca61e17-3da0-435d-8848-99cea854558e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:08.872928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ca61e17-3da0-435d-8848-99cea854558e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:08.873374 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ca61e17-3da0-435d-8848-99cea854558e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:08.873785 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ca61e17-3da0-435d-8848-99cea854558e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:08.933651 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5ca61e17-3da0-435d-8848-99cea854558e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:08.941589 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5ca61e17-3da0-435d-8848-99cea854558e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.081247 Sep 05 17:13:08.942487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 684/1383] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:08 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:09.814681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-40935483-ab67-4fc8-bfc9-151f846bf22d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:09.818347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-40935483-ab67-4fc8-bfc9-151f846bf22d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:09.829315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40935483-ab67-4fc8-bfc9-151f846bf22d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:09.829790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40935483-ab67-4fc8-bfc9-151f846bf22d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:09.830210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40935483-ab67-4fc8-bfc9-151f846bf22d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:09.830892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40935483-ab67-4fc8-bfc9-151f846bf22d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:09.831341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40935483-ab67-4fc8-bfc9-151f846bf22d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:09.831759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40935483-ab67-4fc8-bfc9-151f846bf22d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:09.838150 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f67250ab-9ee0-41b4-b9a1-cdf118def9ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:09.840340 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f67250ab-9ee0-41b4-b9a1-cdf118def9ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:09.847353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f67250ab-9ee0-41b4-b9a1-cdf118def9ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:09.847835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f67250ab-9ee0-41b4-b9a1-cdf118def9ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:09.848297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f67250ab-9ee0-41b4-b9a1-cdf118def9ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:09.849346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f67250ab-9ee0-41b4-b9a1-cdf118def9ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:09.849795 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f67250ab-9ee0-41b4-b9a1-cdf118def9ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:09.850209 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f67250ab-9ee0-41b4-b9a1-cdf118def9ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:09.863026 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-40935483-ab67-4fc8-bfc9-151f846bf22d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055350 Sep 05 17:13:09.863599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 700/1384] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:09 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:09.881372 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f67250ab-9ee0-41b4-b9a1-cdf118def9ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047153 Sep 05 17:13:09.881924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 685/1385] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:09 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:09.972379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-efa82661-1d73-4a7b-803c-6c43527b0e1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:09.973417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-efa82661-1d73-4a7b-803c-6c43527b0e1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:09.984571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efa82661-1d73-4a7b-803c-6c43527b0e1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:09.985052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efa82661-1d73-4a7b-803c-6c43527b0e1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:09.985721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efa82661-1d73-4a7b-803c-6c43527b0e1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:09.986860 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efa82661-1d73-4a7b-803c-6c43527b0e1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:09.987583 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efa82661-1d73-4a7b-803c-6c43527b0e1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:09.988324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efa82661-1d73-4a7b-803c-6c43527b0e1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:10.052851 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-efa82661-1d73-4a7b-803c-6c43527b0e1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:10.060983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-efa82661-1d73-4a7b-803c-6c43527b0e1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095243 Sep 05 17:13:10.061541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 701/1386] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:09 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:10.880459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cc90051f-f0f2-49e3-9cf8-2cb4d862c148 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:10.883948 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cc90051f-f0f2-49e3-9cf8-2cb4d862c148 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:10.895097 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc90051f-f0f2-49e3-9cf8-2cb4d862c148 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:10.895894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc90051f-f0f2-49e3-9cf8-2cb4d862c148 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:10.896665 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc90051f-f0f2-49e3-9cf8-2cb4d862c148 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:10.897807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc90051f-f0f2-49e3-9cf8-2cb4d862c148 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:10.898605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc90051f-f0f2-49e3-9cf8-2cb4d862c148 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:10.898865 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e151299d-852a-4eae-a1dc-b1be59aa243b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:10.899527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc90051f-f0f2-49e3-9cf8-2cb4d862c148 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:10.902444 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e151299d-852a-4eae-a1dc-b1be59aa243b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:10.910591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e151299d-852a-4eae-a1dc-b1be59aa243b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:10.911069 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e151299d-852a-4eae-a1dc-b1be59aa243b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:10.911490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e151299d-852a-4eae-a1dc-b1be59aa243b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:10.912191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e151299d-852a-4eae-a1dc-b1be59aa243b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:10.912648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e151299d-852a-4eae-a1dc-b1be59aa243b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:10.913065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e151299d-852a-4eae-a1dc-b1be59aa243b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:10.933020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cc90051f-f0f2-49e3-9cf8-2cb4d862c148 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059613 Sep 05 17:13:10.933864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 686/1387] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:10 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:10.942754 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e151299d-852a-4eae-a1dc-b1be59aa243b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050871 Sep 05 17:13:10.943306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 702/1388] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:10 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:11.084395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3ae6492f-636d-4f60-a259-6ffa343f6d08 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:11.085079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3ae6492f-636d-4f60-a259-6ffa343f6d08 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:11.092465 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ae6492f-636d-4f60-a259-6ffa343f6d08 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:11.093015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ae6492f-636d-4f60-a259-6ffa343f6d08 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:11.093555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ae6492f-636d-4f60-a259-6ffa343f6d08 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:11.094487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ae6492f-636d-4f60-a259-6ffa343f6d08 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:11.095008 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ae6492f-636d-4f60-a259-6ffa343f6d08 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:11.095502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ae6492f-636d-4f60-a259-6ffa343f6d08 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:11.158210 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3ae6492f-636d-4f60-a259-6ffa343f6d08 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:11.165990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3ae6492f-636d-4f60-a259-6ffa343f6d08 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086147 Sep 05 17:13:11.166553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 687/1389] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:11 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:11.950557 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b953719f-84cf-4dc3-a9d8-50a3cdf37502 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:11.954394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b953719f-84cf-4dc3-a9d8-50a3cdf37502 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:11.957419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-83ae085e-b955-4194-8ca9-b8596006f8df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:11.959564 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-83ae085e-b955-4194-8ca9-b8596006f8df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:11.961293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b953719f-84cf-4dc3-a9d8-50a3cdf37502 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:11.961774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b953719f-84cf-4dc3-a9d8-50a3cdf37502 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:11.962198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b953719f-84cf-4dc3-a9d8-50a3cdf37502 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:11.962902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b953719f-84cf-4dc3-a9d8-50a3cdf37502 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:11.963347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b953719f-84cf-4dc3-a9d8-50a3cdf37502 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:11.963764 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b953719f-84cf-4dc3-a9d8-50a3cdf37502 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:11.966353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83ae085e-b955-4194-8ca9-b8596006f8df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:11.966838 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83ae085e-b955-4194-8ca9-b8596006f8df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:11.967258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83ae085e-b955-4194-8ca9-b8596006f8df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:11.967938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83ae085e-b955-4194-8ca9-b8596006f8df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:11.968476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83ae085e-b955-4194-8ca9-b8596006f8df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:11.968977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83ae085e-b955-4194-8ca9-b8596006f8df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:11.994899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b953719f-84cf-4dc3-a9d8-50a3cdf37502 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051175 Sep 05 17:13:11.995475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 703/1390] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:11 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:11.998856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-83ae085e-b955-4194-8ca9-b8596006f8df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045956 Sep 05 17:13:11.999412 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 688/1391] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:11 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:12.189604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f0fbe846-35c3-4b49-a0b7-f39742dd0b8e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:12.190306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f0fbe846-35c3-4b49-a0b7-f39742dd0b8e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:12.198008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0fbe846-35c3-4b49-a0b7-f39742dd0b8e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:12.198579 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0fbe846-35c3-4b49-a0b7-f39742dd0b8e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:12.199068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0fbe846-35c3-4b49-a0b7-f39742dd0b8e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:12.199865 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0fbe846-35c3-4b49-a0b7-f39742dd0b8e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:12.200444 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0fbe846-35c3-4b49-a0b7-f39742dd0b8e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:12.201006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0fbe846-35c3-4b49-a0b7-f39742dd0b8e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:12.269057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f0fbe846-35c3-4b49-a0b7-f39742dd0b8e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:12.277350 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f0fbe846-35c3-4b49-a0b7-f39742dd0b8e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092517 Sep 05 17:13:12.277949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 704/1392] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:12 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:13.012544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-db48f701-c899-4e32-a105-d70f7f27ac6c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:13.016047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-db48f701-c899-4e32-a105-d70f7f27ac6c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:13.016474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-34a118a1-74c2-45f4-908d-5cc2ce9f5f44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:13.020134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-34a118a1-74c2-45f4-908d-5cc2ce9f5f44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:13.026757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db48f701-c899-4e32-a105-d70f7f27ac6c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:13.027552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db48f701-c899-4e32-a105-d70f7f27ac6c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:13.028328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db48f701-c899-4e32-a105-d70f7f27ac6c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:13.029525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db48f701-c899-4e32-a105-d70f7f27ac6c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:13.030252 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db48f701-c899-4e32-a105-d70f7f27ac6c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:13.030814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34a118a1-74c2-45f4-908d-5cc2ce9f5f44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:13.031024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db48f701-c899-4e32-a105-d70f7f27ac6c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:13.031605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34a118a1-74c2-45f4-908d-5cc2ce9f5f44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:13.032367 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34a118a1-74c2-45f4-908d-5cc2ce9f5f44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:13.033354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34a118a1-74c2-45f4-908d-5cc2ce9f5f44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:13.033963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34a118a1-74c2-45f4-908d-5cc2ce9f5f44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:13.034229 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34a118a1-74c2-45f4-908d-5cc2ce9f5f44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:13.061925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-db48f701-c899-4e32-a105-d70f7f27ac6c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056262 Sep 05 17:13:13.062763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 689/1393] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:13 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:13.064065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-34a118a1-74c2-45f4-908d-5cc2ce9f5f44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054481 Sep 05 17:13:13.064852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 705/1394] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:13 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:13.302870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fb7a2ae7-9dfe-47c1-8c5a-de1c3171e9a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:13.303519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fb7a2ae7-9dfe-47c1-8c5a-de1c3171e9a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:13.311269 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb7a2ae7-9dfe-47c1-8c5a-de1c3171e9a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:13.311866 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb7a2ae7-9dfe-47c1-8c5a-de1c3171e9a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:13.312449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb7a2ae7-9dfe-47c1-8c5a-de1c3171e9a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:13.313303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb7a2ae7-9dfe-47c1-8c5a-de1c3171e9a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:13.313933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb7a2ae7-9dfe-47c1-8c5a-de1c3171e9a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:13.314576 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb7a2ae7-9dfe-47c1-8c5a-de1c3171e9a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:13.379334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fb7a2ae7-9dfe-47c1-8c5a-de1c3171e9a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:13.387553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fb7a2ae7-9dfe-47c1-8c5a-de1c3171e9a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091085 Sep 05 17:13:13.388118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 690/1395] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:13 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:14.080209 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-98eecb61-cf26-45d7-87f7-1fd5a17bb2b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:14.080860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f74ac923-39e9-49de-b7d5-7184892711a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:14.082452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-98eecb61-cf26-45d7-87f7-1fd5a17bb2b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:14.082613 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f74ac923-39e9-49de-b7d5-7184892711a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:14.089422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98eecb61-cf26-45d7-87f7-1fd5a17bb2b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:14.089609 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f74ac923-39e9-49de-b7d5-7184892711a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:14.089904 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98eecb61-cf26-45d7-87f7-1fd5a17bb2b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:14.090078 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f74ac923-39e9-49de-b7d5-7184892711a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:14.090331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98eecb61-cf26-45d7-87f7-1fd5a17bb2b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:14.090478 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f74ac923-39e9-49de-b7d5-7184892711a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:14.091025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98eecb61-cf26-45d7-87f7-1fd5a17bb2b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:14.091172 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f74ac923-39e9-49de-b7d5-7184892711a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:14.091460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98eecb61-cf26-45d7-87f7-1fd5a17bb2b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:14.091610 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f74ac923-39e9-49de-b7d5-7184892711a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:14.091877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98eecb61-cf26-45d7-87f7-1fd5a17bb2b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:14.092025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f74ac923-39e9-49de-b7d5-7184892711a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:14.122681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f74ac923-39e9-49de-b7d5-7184892711a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048399 Sep 05 17:13:14.123455 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 691/1396] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:14 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:14.124034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-98eecb61-cf26-45d7-87f7-1fd5a17bb2b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050818 Sep 05 17:13:14.124638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 706/1397] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:14 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:14.410454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fcec1eaa-e13d-4e8b-b699-51648b6c5e74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:14.411055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fcec1eaa-e13d-4e8b-b699-51648b6c5e74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:14.417562 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fcec1eaa-e13d-4e8b-b699-51648b6c5e74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:14.418040 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fcec1eaa-e13d-4e8b-b699-51648b6c5e74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:14.418459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fcec1eaa-e13d-4e8b-b699-51648b6c5e74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:14.419139 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fcec1eaa-e13d-4e8b-b699-51648b6c5e74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:14.419580 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fcec1eaa-e13d-4e8b-b699-51648b6c5e74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:14.419993 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fcec1eaa-e13d-4e8b-b699-51648b6c5e74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:14.487196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fcec1eaa-e13d-4e8b-b699-51648b6c5e74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:14.495508 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fcec1eaa-e13d-4e8b-b699-51648b6c5e74 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089360 Sep 05 17:13:14.496079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 692/1398] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:14 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:15.139364 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-95b5bdea-a91b-449d-bd1c-026db3d9be4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:15.140919 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6b81ab48-5d24-46cb-8db0-86304ce26252 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:15.142870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-95b5bdea-a91b-449d-bd1c-026db3d9be4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:15.144491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6b81ab48-5d24-46cb-8db0-86304ce26252 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:15.153841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95b5bdea-a91b-449d-bd1c-026db3d9be4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:15.154579 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95b5bdea-a91b-449d-bd1c-026db3d9be4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:15.155227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b81ab48-5d24-46cb-8db0-86304ce26252 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:15.155481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95b5bdea-a91b-449d-bd1c-026db3d9be4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:15.155989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b81ab48-5d24-46cb-8db0-86304ce26252 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:15.156489 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95b5bdea-a91b-449d-bd1c-026db3d9be4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:15.156730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b81ab48-5d24-46cb-8db0-86304ce26252 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:15.157240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95b5bdea-a91b-449d-bd1c-026db3d9be4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:15.157866 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b81ab48-5d24-46cb-8db0-86304ce26252 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:15.158105 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95b5bdea-a91b-449d-bd1c-026db3d9be4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:15.158668 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b81ab48-5d24-46cb-8db0-86304ce26252 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:15.159226 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b81ab48-5d24-46cb-8db0-86304ce26252 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:15.188275 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-95b5bdea-a91b-449d-bd1c-026db3d9be4d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055534 Sep 05 17:13:15.189052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 707/1399] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:15 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:15.189537 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6b81ab48-5d24-46cb-8db0-86304ce26252 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055238 Sep 05 17:13:15.194494 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 693/1400] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:15 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:15.521820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9803900f-18ff-4e3c-8a8a-bbc309d6cfca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:15.522498 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9803900f-18ff-4e3c-8a8a-bbc309d6cfca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:15.529468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9803900f-18ff-4e3c-8a8a-bbc309d6cfca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:15.529999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9803900f-18ff-4e3c-8a8a-bbc309d6cfca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:15.530478 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9803900f-18ff-4e3c-8a8a-bbc309d6cfca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:15.531238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9803900f-18ff-4e3c-8a8a-bbc309d6cfca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:15.531741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9803900f-18ff-4e3c-8a8a-bbc309d6cfca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:15.532215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9803900f-18ff-4e3c-8a8a-bbc309d6cfca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:15.600534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9803900f-18ff-4e3c-8a8a-bbc309d6cfca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:15.608608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9803900f-18ff-4e3c-8a8a-bbc309d6cfca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092839 Sep 05 17:13:15.609173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 708/1401] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:15 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:16.204418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ee2cee5a-9a71-44ff-92b7-76ef1c475cc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:16.206182 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-27a75cae-c8a3-4db3-b939-8305fce75eb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:16.207422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ee2cee5a-9a71-44ff-92b7-76ef1c475cc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:16.208337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-27a75cae-c8a3-4db3-b939-8305fce75eb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:16.214258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee2cee5a-9a71-44ff-92b7-76ef1c475cc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:16.214735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee2cee5a-9a71-44ff-92b7-76ef1c475cc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:16.215024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27a75cae-c8a3-4db3-b939-8305fce75eb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:16.215132 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee2cee5a-9a71-44ff-92b7-76ef1c475cc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:16.215509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27a75cae-c8a3-4db3-b939-8305fce75eb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:16.215862 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee2cee5a-9a71-44ff-92b7-76ef1c475cc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:16.216015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27a75cae-c8a3-4db3-b939-8305fce75eb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:16.216344 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee2cee5a-9a71-44ff-92b7-76ef1c475cc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:16.216671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27a75cae-c8a3-4db3-b939-8305fce75eb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:16.216810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ee2cee5a-9a71-44ff-92b7-76ef1c475cc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:16.217095 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27a75cae-c8a3-4db3-b939-8305fce75eb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:16.217536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27a75cae-c8a3-4db3-b939-8305fce75eb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:16.250078 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-27a75cae-c8a3-4db3-b939-8305fce75eb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050390 Sep 05 17:13:16.250655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 709/1402] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:16 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:16.253113 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ee2cee5a-9a71-44ff-92b7-76ef1c475cc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055390 Sep 05 17:13:16.253782 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 694/1403] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:16 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:16.631444 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3bc75875-3748-4111-a7c8-1681c2b5b7e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:16.632042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3bc75875-3748-4111-a7c8-1681c2b5b7e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:16.638603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3bc75875-3748-4111-a7c8-1681c2b5b7e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:16.639083 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3bc75875-3748-4111-a7c8-1681c2b5b7e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:16.639550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3bc75875-3748-4111-a7c8-1681c2b5b7e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:16.640298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3bc75875-3748-4111-a7c8-1681c2b5b7e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:16.640778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3bc75875-3748-4111-a7c8-1681c2b5b7e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:16.641191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3bc75875-3748-4111-a7c8-1681c2b5b7e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:16.705975 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3bc75875-3748-4111-a7c8-1681c2b5b7e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:16.714261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3bc75875-3748-4111-a7c8-1681c2b5b7e2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087034 Sep 05 17:13:16.714838 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 710/1404] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:16 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:17.267938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4d16a6a1-af14-4ff7-9f1d-73937f9fece7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:17.269600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4d97a128-4939-4080-88a1-bf35c5931791 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:17.270495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4d16a6a1-af14-4ff7-9f1d-73937f9fece7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:17.271727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4d97a128-4939-4080-88a1-bf35c5931791 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:17.277397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d16a6a1-af14-4ff7-9f1d-73937f9fece7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:17.277802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d16a6a1-af14-4ff7-9f1d-73937f9fece7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:17.278227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d16a6a1-af14-4ff7-9f1d-73937f9fece7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:17.278913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d16a6a1-af14-4ff7-9f1d-73937f9fece7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:17.279058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d97a128-4939-4080-88a1-bf35c5931791 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:17.279354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d16a6a1-af14-4ff7-9f1d-73937f9fece7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:17.279518 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d97a128-4939-4080-88a1-bf35c5931791 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:17.279762 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d16a6a1-af14-4ff7-9f1d-73937f9fece7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:17.279908 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d97a128-4939-4080-88a1-bf35c5931791 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:17.280617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d97a128-4939-4080-88a1-bf35c5931791 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:17.281064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d97a128-4939-4080-88a1-bf35c5931791 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:17.281473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d97a128-4939-4080-88a1-bf35c5931791 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:17.310422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4d16a6a1-af14-4ff7-9f1d-73937f9fece7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049143 Sep 05 17:13:17.310995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 695/1405] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:17 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:17.311219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4d97a128-4939-4080-88a1-bf35c5931791 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048134 Sep 05 17:13:17.311778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 711/1406] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:17 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:17.744550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-46a4f883-54e1-4c01-ae47-d4bc394ba848 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:17.745997 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-46a4f883-54e1-4c01-ae47-d4bc394ba848 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:17.756462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46a4f883-54e1-4c01-ae47-d4bc394ba848 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:17.757219 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46a4f883-54e1-4c01-ae47-d4bc394ba848 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:17.757959 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46a4f883-54e1-4c01-ae47-d4bc394ba848 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:17.759167 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46a4f883-54e1-4c01-ae47-d4bc394ba848 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:17.759915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46a4f883-54e1-4c01-ae47-d4bc394ba848 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:17.760647 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46a4f883-54e1-4c01-ae47-d4bc394ba848 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:17.826697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-46a4f883-54e1-4c01-ae47-d4bc394ba848 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:17.836526 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-46a4f883-54e1-4c01-ae47-d4bc394ba848 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098861 Sep 05 17:13:17.837099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 696/1407] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:17 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:18.327874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2599ff20-0827-4c9a-b52e-bb7748967433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:18.328806 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e64b8a78-61b0-43ff-a13c-e8b2d6ee5aee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:18.331967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2599ff20-0827-4c9a-b52e-bb7748967433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:18.333032 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e64b8a78-61b0-43ff-a13c-e8b2d6ee5aee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:18.343176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2599ff20-0827-4c9a-b52e-bb7748967433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:18.343553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e64b8a78-61b0-43ff-a13c-e8b2d6ee5aee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:18.343981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2599ff20-0827-4c9a-b52e-bb7748967433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:18.344485 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e64b8a78-61b0-43ff-a13c-e8b2d6ee5aee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:18.344706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2599ff20-0827-4c9a-b52e-bb7748967433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:18.345165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e64b8a78-61b0-43ff-a13c-e8b2d6ee5aee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:18.345878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2599ff20-0827-4c9a-b52e-bb7748967433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:18.346476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e64b8a78-61b0-43ff-a13c-e8b2d6ee5aee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:18.346867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2599ff20-0827-4c9a-b52e-bb7748967433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:18.347220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2599ff20-0827-4c9a-b52e-bb7748967433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:18.347356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e64b8a78-61b0-43ff-a13c-e8b2d6ee5aee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:18.347781 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e64b8a78-61b0-43ff-a13c-e8b2d6ee5aee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:18.378649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2599ff20-0827-4c9a-b52e-bb7748967433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056984 Sep 05 17:13:18.379176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 712/1408] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:18 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:18.385174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e64b8a78-61b0-43ff-a13c-e8b2d6ee5aee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064063 Sep 05 17:13:18.386116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 697/1409] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:18 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:13:18.864138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9a5190a9-d628-49d6-bd6c-c1106cbbceca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:18.865187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9a5190a9-d628-49d6-bd6c-c1106cbbceca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:18.875357 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a5190a9-d628-49d6-bd6c-c1106cbbceca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:18.876130 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a5190a9-d628-49d6-bd6c-c1106cbbceca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:18.876883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a5190a9-d628-49d6-bd6c-c1106cbbceca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:18.878122 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a5190a9-d628-49d6-bd6c-c1106cbbceca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:18.878645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a5190a9-d628-49d6-bd6c-c1106cbbceca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:18.879112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a5190a9-d628-49d6-bd6c-c1106cbbceca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:18.949755 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9a5190a9-d628-49d6-bd6c-c1106cbbceca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:18.958079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9a5190a9-d628-49d6-bd6c-c1106cbbceca tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.100436 Sep 05 17:13:18.958666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 713/1410] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:18 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:19.395117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-dd7aa4bf-d1e5-41f7-90de-fbf4d027deb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:19.397296 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-dd7aa4bf-d1e5-41f7-90de-fbf4d027deb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:19.399182 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b3214ec7-2258-42e6-8e6b-0749def9b84a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:19.401376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b3214ec7-2258-42e6-8e6b-0749def9b84a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:19.404242 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd7aa4bf-d1e5-41f7-90de-fbf4d027deb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:19.404727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd7aa4bf-d1e5-41f7-90de-fbf4d027deb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:19.405156 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd7aa4bf-d1e5-41f7-90de-fbf4d027deb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:19.405828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd7aa4bf-d1e5-41f7-90de-fbf4d027deb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:19.406297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd7aa4bf-d1e5-41f7-90de-fbf4d027deb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:19.406711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd7aa4bf-d1e5-41f7-90de-fbf4d027deb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:19.407824 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3214ec7-2258-42e6-8e6b-0749def9b84a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:19.408329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3214ec7-2258-42e6-8e6b-0749def9b84a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:19.408847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3214ec7-2258-42e6-8e6b-0749def9b84a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:19.409732 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3214ec7-2258-42e6-8e6b-0749def9b84a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:19.410166 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3214ec7-2258-42e6-8e6b-0749def9b84a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:19.412105 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3214ec7-2258-42e6-8e6b-0749def9b84a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:19.438149 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-dd7aa4bf-d1e5-41f7-90de-fbf4d027deb4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049175 Sep 05 17:13:19.438822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 698/1411] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:19 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:19.442780 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b3214ec7-2258-42e6-8e6b-0749def9b84a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047712 Sep 05 17:13:19.443343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 714/1412] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:19 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:19.982772 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-51dae16e-951d-4c81-9abc-541732ab9213 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:19.983548 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-51dae16e-951d-4c81-9abc-541732ab9213 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:19.991152 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51dae16e-951d-4c81-9abc-541732ab9213 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:19.991635 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51dae16e-951d-4c81-9abc-541732ab9213 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:19.992070 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51dae16e-951d-4c81-9abc-541732ab9213 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:19.992848 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51dae16e-951d-4c81-9abc-541732ab9213 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:19.993308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51dae16e-951d-4c81-9abc-541732ab9213 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:19.993728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51dae16e-951d-4c81-9abc-541732ab9213 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:20.063792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-51dae16e-951d-4c81-9abc-541732ab9213 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:20.072346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-51dae16e-951d-4c81-9abc-541732ab9213 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.094309 Sep 05 17:13:20.072916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 699/1413] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:19 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:20.455474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b006a9bf-e82a-473d-a429-da5c240fd65f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:20.459085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b006a9bf-e82a-473d-a429-da5c240fd65f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:20.459924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5ed73694-adcf-418a-98b3-c9a4562fbdc3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:20.463379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5ed73694-adcf-418a-98b3-c9a4562fbdc3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:20.470548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b006a9bf-e82a-473d-a429-da5c240fd65f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:20.471359 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b006a9bf-e82a-473d-a429-da5c240fd65f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:20.472647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b006a9bf-e82a-473d-a429-da5c240fd65f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:20.473154 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b006a9bf-e82a-473d-a429-da5c240fd65f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:20.474544 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b006a9bf-e82a-473d-a429-da5c240fd65f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:20.474657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ed73694-adcf-418a-98b3-c9a4562fbdc3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:20.474763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b006a9bf-e82a-473d-a429-da5c240fd65f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:20.474847 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ed73694-adcf-418a-98b3-c9a4562fbdc3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:20.475284 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ed73694-adcf-418a-98b3-c9a4562fbdc3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:20.475977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ed73694-adcf-418a-98b3-c9a4562fbdc3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:20.476479 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ed73694-adcf-418a-98b3-c9a4562fbdc3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:20.476875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:13:20.477023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5ed73694-adcf-418a-98b3-c9a4562fbdc3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:20.495906 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:13:20.508674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b006a9bf-e82a-473d-a429-da5c240fd65f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059813 Sep 05 17:13:20.508871 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5ed73694-adcf-418a-98b3-c9a4562fbdc3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056535 Sep 05 17:13:20.509246 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 715/1414] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:20 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:20.509658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 700/1415] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:20 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:21.095238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b2de9d65-6f04-4fac-bab2-292b6f5d6b3e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:21.095880 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b2de9d65-6f04-4fac-bab2-292b6f5d6b3e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:21.103870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2de9d65-6f04-4fac-bab2-292b6f5d6b3e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:21.104403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2de9d65-6f04-4fac-bab2-292b6f5d6b3e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:21.104838 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2de9d65-6f04-4fac-bab2-292b6f5d6b3e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:21.105530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2de9d65-6f04-4fac-bab2-292b6f5d6b3e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:21.105986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2de9d65-6f04-4fac-bab2-292b6f5d6b3e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:21.106408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2de9d65-6f04-4fac-bab2-292b6f5d6b3e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:21.171480 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b2de9d65-6f04-4fac-bab2-292b6f5d6b3e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:21.179431 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b2de9d65-6f04-4fac-bab2-292b6f5d6b3e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.088246 Sep 05 17:13:21.180008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 716/1416] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:21 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:21.526093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3b3f72c9-ef55-449e-b98f-c0072f5d93e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:21.527256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c0d2f5e0-4df8-4763-9194-5596b3324a45 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:21.529710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3b3f72c9-ef55-449e-b98f-c0072f5d93e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:21.530799 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c0d2f5e0-4df8-4763-9194-5596b3324a45 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:21.539015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b3f72c9-ef55-449e-b98f-c0072f5d93e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:21.539496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b3f72c9-ef55-449e-b98f-c0072f5d93e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:21.539923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b3f72c9-ef55-449e-b98f-c0072f5d93e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:21.540537 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0d2f5e0-4df8-4763-9194-5596b3324a45 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:21.540703 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b3f72c9-ef55-449e-b98f-c0072f5d93e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:21.541019 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0d2f5e0-4df8-4763-9194-5596b3324a45 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:21.541167 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b3f72c9-ef55-449e-b98f-c0072f5d93e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:21.541446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0d2f5e0-4df8-4763-9194-5596b3324a45 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:21.541594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b3f72c9-ef55-449e-b98f-c0072f5d93e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:21.542128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0d2f5e0-4df8-4763-9194-5596b3324a45 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:21.542578 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0d2f5e0-4df8-4763-9194-5596b3324a45 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:21.542995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0d2f5e0-4df8-4763-9194-5596b3324a45 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:21.571639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3b3f72c9-ef55-449e-b98f-c0072f5d93e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052299 Sep 05 17:13:21.572434 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 717/1417] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:21 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:21.574265 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c0d2f5e0-4df8-4763-9194-5596b3324a45 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055045 Sep 05 17:13:21.574826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 701/1418] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:21 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:22.215330 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8f30071c-032e-4a60-8277-84477b30b508 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:22.216375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8f30071c-032e-4a60-8277-84477b30b508 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:22.225997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f30071c-032e-4a60-8277-84477b30b508 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:22.226469 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f30071c-032e-4a60-8277-84477b30b508 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:22.226893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f30071c-032e-4a60-8277-84477b30b508 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:22.227574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f30071c-032e-4a60-8277-84477b30b508 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:22.228009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f30071c-032e-4a60-8277-84477b30b508 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:22.228450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f30071c-032e-4a60-8277-84477b30b508 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:22.299844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8f30071c-032e-4a60-8277-84477b30b508 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:22.308213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8f30071c-032e-4a60-8277-84477b30b508 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.099658 Sep 05 17:13:22.308788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 718/1419] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:22 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:22.586915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f1cf1a77-69dd-4634-841b-15a108fe898a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:22.588812 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e8a507e1-70ef-452c-8fbe-c53077f1b5cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:22.589282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f1cf1a77-69dd-4634-841b-15a108fe898a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:22.591022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e8a507e1-70ef-452c-8fbe-c53077f1b5cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:22.596243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1cf1a77-69dd-4634-841b-15a108fe898a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:22.596746 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1cf1a77-69dd-4634-841b-15a108fe898a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:22.597191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1cf1a77-69dd-4634-841b-15a108fe898a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:22.597890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1cf1a77-69dd-4634-841b-15a108fe898a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:22.598302 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a507e1-70ef-452c-8fbe-c53077f1b5cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:22.598436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1cf1a77-69dd-4634-841b-15a108fe898a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:22.599227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a507e1-70ef-452c-8fbe-c53077f1b5cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:22.599350 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1cf1a77-69dd-4634-841b-15a108fe898a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:22.600270 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a507e1-70ef-452c-8fbe-c53077f1b5cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:22.601004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a507e1-70ef-452c-8fbe-c53077f1b5cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:22.601477 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a507e1-70ef-452c-8fbe-c53077f1b5cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:22.601925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a507e1-70ef-452c-8fbe-c53077f1b5cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:22.631114 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f1cf1a77-69dd-4634-841b-15a108fe898a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049198 Sep 05 17:13:22.631675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 702/1420] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:22 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:22.633723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e8a507e1-70ef-452c-8fbe-c53077f1b5cc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049901 Sep 05 17:13:22.634316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 719/1421] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:22 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:23.337426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6c178d61-4560-427c-bfa2-2bfb460e4be2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:23.338188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6c178d61-4560-427c-bfa2-2bfb460e4be2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:23.346257 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c178d61-4560-427c-bfa2-2bfb460e4be2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:23.346862 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c178d61-4560-427c-bfa2-2bfb460e4be2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:23.347400 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c178d61-4560-427c-bfa2-2bfb460e4be2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:23.348302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c178d61-4560-427c-bfa2-2bfb460e4be2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:23.349281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c178d61-4560-427c-bfa2-2bfb460e4be2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:23.349928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c178d61-4560-427c-bfa2-2bfb460e4be2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:23.420495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6c178d61-4560-427c-bfa2-2bfb460e4be2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:23.429049 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6c178d61-4560-427c-bfa2-2bfb460e4be2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.097410 Sep 05 17:13:23.429620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 703/1422] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:23 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:23.647375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-de7e500e-40bc-4671-b5b6-da011155af96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:23.650968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-de7e500e-40bc-4671-b5b6-da011155af96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:23.651727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-05eec976-1afb-44ad-bcdc-4b488a709218 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:23.655196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-05eec976-1afb-44ad-bcdc-4b488a709218 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:23.662181 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de7e500e-40bc-4671-b5b6-da011155af96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:23.662373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de7e500e-40bc-4671-b5b6-da011155af96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:23.662836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de7e500e-40bc-4671-b5b6-da011155af96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:23.663512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de7e500e-40bc-4671-b5b6-da011155af96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:23.663962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de7e500e-40bc-4671-b5b6-da011155af96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:23.664433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de7e500e-40bc-4671-b5b6-da011155af96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:23.664544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05eec976-1afb-44ad-bcdc-4b488a709218 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:23.664996 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05eec976-1afb-44ad-bcdc-4b488a709218 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:23.665422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05eec976-1afb-44ad-bcdc-4b488a709218 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:23.666103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05eec976-1afb-44ad-bcdc-4b488a709218 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:23.666559 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05eec976-1afb-44ad-bcdc-4b488a709218 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:23.666958 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05eec976-1afb-44ad-bcdc-4b488a709218 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:23.694060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-de7e500e-40bc-4671-b5b6-da011155af96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053341 Sep 05 17:13:23.694566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 720/1423] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:23 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:23.697024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-05eec976-1afb-44ad-bcdc-4b488a709218 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051929 Sep 05 17:13:23.697554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 704/1424] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:23 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:24.451989 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5719f1b0-8a60-4a75-8ad8-e5b05e525767 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:24.452637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5719f1b0-8a60-4a75-8ad8-e5b05e525767 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:24.459136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5719f1b0-8a60-4a75-8ad8-e5b05e525767 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:24.459614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5719f1b0-8a60-4a75-8ad8-e5b05e525767 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:24.460049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5719f1b0-8a60-4a75-8ad8-e5b05e525767 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:24.460766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5719f1b0-8a60-4a75-8ad8-e5b05e525767 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:24.461193 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5719f1b0-8a60-4a75-8ad8-e5b05e525767 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:24.461642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5719f1b0-8a60-4a75-8ad8-e5b05e525767 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:24.528120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5719f1b0-8a60-4a75-8ad8-e5b05e525767 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:24.536315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5719f1b0-8a60-4a75-8ad8-e5b05e525767 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.088318 Sep 05 17:13:24.536934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 721/1425] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:24 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:24.711416 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fdab6a92-f53c-4a86-9761-8bceacda7c13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:24.714851 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fdab6a92-f53c-4a86-9761-8bceacda7c13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:24.716252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-18c102e5-af1a-468b-9e14-31ce5ca3f698 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:24.719784 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-18c102e5-af1a-468b-9e14-31ce5ca3f698 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:24.725892 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fdab6a92-f53c-4a86-9761-8bceacda7c13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:24.726357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fdab6a92-f53c-4a86-9761-8bceacda7c13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:24.726789 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fdab6a92-f53c-4a86-9761-8bceacda7c13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:24.727461 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fdab6a92-f53c-4a86-9761-8bceacda7c13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:24.727947 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fdab6a92-f53c-4a86-9761-8bceacda7c13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:24.728386 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fdab6a92-f53c-4a86-9761-8bceacda7c13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:24.729108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18c102e5-af1a-468b-9e14-31ce5ca3f698 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:24.729578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18c102e5-af1a-468b-9e14-31ce5ca3f698 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:24.730000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18c102e5-af1a-468b-9e14-31ce5ca3f698 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:24.730690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18c102e5-af1a-468b-9e14-31ce5ca3f698 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:24.731136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18c102e5-af1a-468b-9e14-31ce5ca3f698 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:24.731548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18c102e5-af1a-468b-9e14-31ce5ca3f698 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:24.759598 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fdab6a92-f53c-4a86-9761-8bceacda7c13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055007 Sep 05 17:13:24.760165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 705/1426] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:24 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:24.761453 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-18c102e5-af1a-468b-9e14-31ce5ca3f698 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052418 Sep 05 17:13:24.762001 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 722/1427] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:24 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:25.562519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-36b7b4d4-f4aa-4c9f-84d7-2fd3b05d8850 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:25.563501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-36b7b4d4-f4aa-4c9f-84d7-2fd3b05d8850 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:25.574551 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36b7b4d4-f4aa-4c9f-84d7-2fd3b05d8850 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:25.575326 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36b7b4d4-f4aa-4c9f-84d7-2fd3b05d8850 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:25.576073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36b7b4d4-f4aa-4c9f-84d7-2fd3b05d8850 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:25.577250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36b7b4d4-f4aa-4c9f-84d7-2fd3b05d8850 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:25.577999 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36b7b4d4-f4aa-4c9f-84d7-2fd3b05d8850 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:25.578702 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36b7b4d4-f4aa-4c9f-84d7-2fd3b05d8850 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:25.645328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-36b7b4d4-f4aa-4c9f-84d7-2fd3b05d8850 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:25.654196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-36b7b4d4-f4aa-4c9f-84d7-2fd3b05d8850 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098342 Sep 05 17:13:25.654764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 706/1428] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:25 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:25.775222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-876901c0-0688-4b61-a287-451c87aed8d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:25.777129 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-999d0341-262d-469b-b97b-025551b37010 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:25.777571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-876901c0-0688-4b61-a287-451c87aed8d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:25.779235 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-999d0341-262d-469b-b97b-025551b37010 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:25.784638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-876901c0-0688-4b61-a287-451c87aed8d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:25.785123 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-876901c0-0688-4b61-a287-451c87aed8d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:25.785551 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-876901c0-0688-4b61-a287-451c87aed8d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:25.785847 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-999d0341-262d-469b-b97b-025551b37010 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:25.786248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-876901c0-0688-4b61-a287-451c87aed8d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:25.786357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-999d0341-262d-469b-b97b-025551b37010 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:25.786696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-876901c0-0688-4b61-a287-451c87aed8d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:25.786846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-999d0341-262d-469b-b97b-025551b37010 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:25.787106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-876901c0-0688-4b61-a287-451c87aed8d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:25.787404 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-999d0341-262d-469b-b97b-025551b37010 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:25.788176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-999d0341-262d-469b-b97b-025551b37010 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:25.788745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-999d0341-262d-469b-b97b-025551b37010 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:25.816449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-876901c0-0688-4b61-a287-451c87aed8d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047232 Sep 05 17:13:25.817042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 723/1429] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:25 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:25.819594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-999d0341-262d-469b-b97b-025551b37010 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047967 Sep 05 17:13:25.820128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 707/1430] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:25 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:26.682016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-210c1e36-f80a-44c7-ba09-8f7053c725c8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:26.682885 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-210c1e36-f80a-44c7-ba09-8f7053c725c8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:26.693376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-210c1e36-f80a-44c7-ba09-8f7053c725c8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:26.693923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-210c1e36-f80a-44c7-ba09-8f7053c725c8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:26.694345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-210c1e36-f80a-44c7-ba09-8f7053c725c8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:26.695030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-210c1e36-f80a-44c7-ba09-8f7053c725c8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:26.695470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-210c1e36-f80a-44c7-ba09-8f7053c725c8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:26.695884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-210c1e36-f80a-44c7-ba09-8f7053c725c8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:26.757282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-210c1e36-f80a-44c7-ba09-8f7053c725c8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:26.765033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-210c1e36-f80a-44c7-ba09-8f7053c725c8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.090335 Sep 05 17:13:26.765598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 724/1431] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:26 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:26.833517 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-738d8e6a-87c0-4672-9943-aeab3768bfde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:26.836117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c42c6427-950f-4106-89b6-986cfa250226 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:26.837029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-738d8e6a-87c0-4672-9943-aeab3768bfde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:26.839584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c42c6427-950f-4106-89b6-986cfa250226 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:26.847919 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-738d8e6a-87c0-4672-9943-aeab3768bfde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:26.849184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-738d8e6a-87c0-4672-9943-aeab3768bfde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:26.849830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-738d8e6a-87c0-4672-9943-aeab3768bfde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:26.850286 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c42c6427-950f-4106-89b6-986cfa250226 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:26.850592 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-738d8e6a-87c0-4672-9943-aeab3768bfde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:26.850898 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c42c6427-950f-4106-89b6-986cfa250226 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:26.851053 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-738d8e6a-87c0-4672-9943-aeab3768bfde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:26.851475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c42c6427-950f-4106-89b6-986cfa250226 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:26.851625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-738d8e6a-87c0-4672-9943-aeab3768bfde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:26.852182 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c42c6427-950f-4106-89b6-986cfa250226 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:26.852647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c42c6427-950f-4106-89b6-986cfa250226 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:26.853066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c42c6427-950f-4106-89b6-986cfa250226 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:26.881826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-738d8e6a-87c0-4672-9943-aeab3768bfde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054916 Sep 05 17:13:26.882399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 708/1432] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:26 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:26.884628 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c42c6427-950f-4106-89b6-986cfa250226 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054905 Sep 05 17:13:26.885172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 725/1433] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:26 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:27.791818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-53cca3c4-9741-4862-a6b9-35a5fac73b95 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:27.792970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-53cca3c4-9741-4862-a6b9-35a5fac73b95 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:27.803248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53cca3c4-9741-4862-a6b9-35a5fac73b95 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:27.803727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53cca3c4-9741-4862-a6b9-35a5fac73b95 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:27.804191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53cca3c4-9741-4862-a6b9-35a5fac73b95 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:27.804901 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53cca3c4-9741-4862-a6b9-35a5fac73b95 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:27.805349 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53cca3c4-9741-4862-a6b9-35a5fac73b95 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:27.805775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-53cca3c4-9741-4862-a6b9-35a5fac73b95 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:27.878366 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-53cca3c4-9741-4862-a6b9-35a5fac73b95 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:27.886560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-53cca3c4-9741-4862-a6b9-35a5fac73b95 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.101442 Sep 05 17:13:27.887110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 709/1434] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:27 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:27.895251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-84bb637b-6c06-4f4a-9d42-d84fbf7063db tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:27.897478 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-84bb637b-6c06-4f4a-9d42-d84fbf7063db tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:27.899164 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d976ad94-9e8a-4987-af64-2c392fd5fa13 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:27.901368 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d976ad94-9e8a-4987-af64-2c392fd5fa13 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:27.903868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84bb637b-6c06-4f4a-9d42-d84fbf7063db tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:27.904390 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84bb637b-6c06-4f4a-9d42-d84fbf7063db tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:27.905031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84bb637b-6c06-4f4a-9d42-d84fbf7063db tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:27.905726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84bb637b-6c06-4f4a-9d42-d84fbf7063db tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:27.906169 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84bb637b-6c06-4f4a-9d42-d84fbf7063db tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:27.906584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84bb637b-6c06-4f4a-9d42-d84fbf7063db tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:27.907402 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d976ad94-9e8a-4987-af64-2c392fd5fa13 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:27.907876 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d976ad94-9e8a-4987-af64-2c392fd5fa13 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:27.908333 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d976ad94-9e8a-4987-af64-2c392fd5fa13 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:27.909023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d976ad94-9e8a-4987-af64-2c392fd5fa13 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:27.909469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d976ad94-9e8a-4987-af64-2c392fd5fa13 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:27.909887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d976ad94-9e8a-4987-af64-2c392fd5fa13 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:27.936367 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-84bb637b-6c06-4f4a-9d42-d84fbf7063db tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045159 Sep 05 17:13:27.937255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 726/1435] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:27 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:27.940206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d976ad94-9e8a-4987-af64-2c392fd5fa13 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045272 Sep 05 17:13:27.940762 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 710/1436] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:27 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 17:13:28.912957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a1f74535-901d-4a0e-b7f5-b56ba918dff6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:28.913674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a1f74535-901d-4a0e-b7f5-b56ba918dff6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:28.921542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1f74535-901d-4a0e-b7f5-b56ba918dff6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:28.922099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1f74535-901d-4a0e-b7f5-b56ba918dff6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:28.922602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1f74535-901d-4a0e-b7f5-b56ba918dff6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:28.923407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1f74535-901d-4a0e-b7f5-b56ba918dff6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:28.923930 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1f74535-901d-4a0e-b7f5-b56ba918dff6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:28.924454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1f74535-901d-4a0e-b7f5-b56ba918dff6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:28.950344 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-005c31d3-e028-454e-b90a-829fdd1bb85a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:28.952922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-005c31d3-e028-454e-b90a-829fdd1bb85a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:28.962048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-005c31d3-e028-454e-b90a-829fdd1bb85a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:28.962535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-005c31d3-e028-454e-b90a-829fdd1bb85a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:28.962959 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-005c31d3-e028-454e-b90a-829fdd1bb85a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:28.963682 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-005c31d3-e028-454e-b90a-829fdd1bb85a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:28.964174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-005c31d3-e028-454e-b90a-829fdd1bb85a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:28.964558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-005c31d3-e028-454e-b90a-829fdd1bb85a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:28.995381 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a1f74535-901d-4a0e-b7f5-b56ba918dff6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:28.997009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-005c31d3-e028-454e-b90a-829fdd1bb85a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051491 Sep 05 17:13:28.997601 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 711/1437] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:28 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:29.003402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a1f74535-901d-4a0e-b7f5-b56ba918dff6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.096967 Sep 05 17:13:29.003966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 727/1438] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:28 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:29.005416 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c4e6d821-76e3-4727-986a-6082ca3202e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:29.007664 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c4e6d821-76e3-4727-986a-6082ca3202e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:29.014648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4e6d821-76e3-4727-986a-6082ca3202e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:29.015124 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4e6d821-76e3-4727-986a-6082ca3202e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:29.015553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4e6d821-76e3-4727-986a-6082ca3202e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:29.016262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4e6d821-76e3-4727-986a-6082ca3202e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:29.016711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4e6d821-76e3-4727-986a-6082ca3202e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:29.017123 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4e6d821-76e3-4727-986a-6082ca3202e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:29.050407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c4e6d821-76e3-4727-986a-6082ca3202e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051470 Sep 05 17:13:29.051148 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 712/1439] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:28 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:30.014350 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aa84b5c3-efe8-49ac-9f83-cae2fc6d9343 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:30.017911 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aa84b5c3-efe8-49ac-9f83-cae2fc6d9343 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:30.026448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa84b5c3-efe8-49ac-9f83-cae2fc6d9343 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:30.026641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-71090fa7-e9fb-4fe6-bf30-ee0adf2484e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:30.027065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa84b5c3-efe8-49ac-9f83-cae2fc6d9343 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:30.027166 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-71090fa7-e9fb-4fe6-bf30-ee0adf2484e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:30.027334 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa84b5c3-efe8-49ac-9f83-cae2fc6d9343 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:30.028024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa84b5c3-efe8-49ac-9f83-cae2fc6d9343 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:30.028543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa84b5c3-efe8-49ac-9f83-cae2fc6d9343 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:30.028982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa84b5c3-efe8-49ac-9f83-cae2fc6d9343 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:30.033833 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71090fa7-e9fb-4fe6-bf30-ee0adf2484e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:30.034314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71090fa7-e9fb-4fe6-bf30-ee0adf2484e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:30.034736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71090fa7-e9fb-4fe6-bf30-ee0adf2484e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:30.035425 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71090fa7-e9fb-4fe6-bf30-ee0adf2484e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:30.035867 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71090fa7-e9fb-4fe6-bf30-ee0adf2484e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:30.036328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71090fa7-e9fb-4fe6-bf30-ee0adf2484e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:30.058925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aa84b5c3-efe8-49ac-9f83-cae2fc6d9343 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051391 Sep 05 17:13:30.059489 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 728/1440] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:30 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:30.064050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3632d454-f6ac-4487-9eac-a2e538fdf1f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:30.066168 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3632d454-f6ac-4487-9eac-a2e538fdf1f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:30.072670 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3632d454-f6ac-4487-9eac-a2e538fdf1f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:30.073145 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3632d454-f6ac-4487-9eac-a2e538fdf1f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:30.073570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3632d454-f6ac-4487-9eac-a2e538fdf1f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:30.074274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3632d454-f6ac-4487-9eac-a2e538fdf1f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:30.074686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3632d454-f6ac-4487-9eac-a2e538fdf1f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:30.075096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3632d454-f6ac-4487-9eac-a2e538fdf1f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:30.102228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-71090fa7-e9fb-4fe6-bf30-ee0adf2484e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:30.107251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3632d454-f6ac-4487-9eac-a2e538fdf1f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046721 Sep 05 17:13:30.107794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 729/1441] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:30 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:30.110805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-71090fa7-e9fb-4fe6-bf30-ee0adf2484e1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.088098 Sep 05 17:13:30.111345 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 713/1442] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:30 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:31.071601 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-66dbc214-1def-4689-9859-396148282236 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:31.074532 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-66dbc214-1def-4689-9859-396148282236 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:31.081389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66dbc214-1def-4689-9859-396148282236 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:31.081876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66dbc214-1def-4689-9859-396148282236 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:31.082306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66dbc214-1def-4689-9859-396148282236 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:31.082993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66dbc214-1def-4689-9859-396148282236 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:31.083436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66dbc214-1def-4689-9859-396148282236 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:31.084227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66dbc214-1def-4689-9859-396148282236 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:31.115924 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-66dbc214-1def-4689-9859-396148282236 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048039 Sep 05 17:13:31.116538 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 730/1443] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:31 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:31.119334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e652e88f-510f-47cf-94e9-62e8a510aa21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:31.121710 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e652e88f-510f-47cf-94e9-62e8a510aa21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:31.128512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e652e88f-510f-47cf-94e9-62e8a510aa21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:31.129506 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e652e88f-510f-47cf-94e9-62e8a510aa21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:31.129935 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e652e88f-510f-47cf-94e9-62e8a510aa21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:31.131343 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e652e88f-510f-47cf-94e9-62e8a510aa21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:31.131930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e652e88f-510f-47cf-94e9-62e8a510aa21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:31.132384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e652e88f-510f-47cf-94e9-62e8a510aa21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:31.135483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-407df07b-a8d3-469b-bf2f-a041c756dc3d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:31.137288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-407df07b-a8d3-469b-bf2f-a041c756dc3d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:31.142318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-407df07b-a8d3-469b-bf2f-a041c756dc3d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:31.142792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-407df07b-a8d3-469b-bf2f-a041c756dc3d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:31.143245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-407df07b-a8d3-469b-bf2f-a041c756dc3d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:31.143897 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-407df07b-a8d3-469b-bf2f-a041c756dc3d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:31.144385 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-407df07b-a8d3-469b-bf2f-a041c756dc3d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:31.144788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-407df07b-a8d3-469b-bf2f-a041c756dc3d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:31.164653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e652e88f-510f-47cf-94e9-62e8a510aa21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049260 Sep 05 17:13:31.165228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 714/1444] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:31 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:31.207949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-407df07b-a8d3-469b-bf2f-a041c756dc3d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:31.210635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:13:31.217496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-407df07b-a8d3-469b-bf2f-a041c756dc3d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086146 Sep 05 17:13:31.218048 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 731/1445] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:31 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:32.132630 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-eb61c4bb-c21a-490d-a7a4-e44e2720ffcb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:32.135121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-eb61c4bb-c21a-490d-a7a4-e44e2720ffcb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:32.143171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eb61c4bb-c21a-490d-a7a4-e44e2720ffcb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:32.143731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eb61c4bb-c21a-490d-a7a4-e44e2720ffcb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:32.144346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eb61c4bb-c21a-490d-a7a4-e44e2720ffcb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:32.145152 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eb61c4bb-c21a-490d-a7a4-e44e2720ffcb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:32.145672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eb61c4bb-c21a-490d-a7a4-e44e2720ffcb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:32.146212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-eb61c4bb-c21a-490d-a7a4-e44e2720ffcb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:32.177878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c215706c-7f3a-4b66-9beb-4ef4cd5a4997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:32.178675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-eb61c4bb-c21a-490d-a7a4-e44e2720ffcb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052330 Sep 05 17:13:32.179402 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 715/1446] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:32 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:32.180407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c215706c-7f3a-4b66-9beb-4ef4cd5a4997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:32.187358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c215706c-7f3a-4b66-9beb-4ef4cd5a4997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:32.187836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c215706c-7f3a-4b66-9beb-4ef4cd5a4997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:32.188298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c215706c-7f3a-4b66-9beb-4ef4cd5a4997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:32.189018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c215706c-7f3a-4b66-9beb-4ef4cd5a4997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:32.189462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c215706c-7f3a-4b66-9beb-4ef4cd5a4997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:32.189879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c215706c-7f3a-4b66-9beb-4ef4cd5a4997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:32.220183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c215706c-7f3a-4b66-9beb-4ef4cd5a4997 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046635 Sep 05 17:13:32.220766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 732/1447] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:32 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:32.242797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f30c181e-be42-41d7-80c4-2dc18bc2e589 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:32.243273 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f30c181e-be42-41d7-80c4-2dc18bc2e589 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:32.249358 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f30c181e-be42-41d7-80c4-2dc18bc2e589 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:32.249835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f30c181e-be42-41d7-80c4-2dc18bc2e589 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:32.250262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f30c181e-be42-41d7-80c4-2dc18bc2e589 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:32.250936 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f30c181e-be42-41d7-80c4-2dc18bc2e589 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:32.251377 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f30c181e-be42-41d7-80c4-2dc18bc2e589 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:32.251788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f30c181e-be42-41d7-80c4-2dc18bc2e589 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:32.320092 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f30c181e-be42-41d7-80c4-2dc18bc2e589 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:32.328348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f30c181e-be42-41d7-80c4-2dc18bc2e589 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.090483 Sep 05 17:13:32.328920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 716/1448] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:32 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:33.191969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1ed15806-b1c8-4e60-a71c-f2e3a10a891c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:33.194270 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1ed15806-b1c8-4e60-a71c-f2e3a10a891c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:33.196546 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=86 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:13:33.201711 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ed15806-b1c8-4e60-a71c-f2e3a10a891c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:33.202190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ed15806-b1c8-4e60-a71c-f2e3a10a891c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:33.202617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ed15806-b1c8-4e60-a71c-f2e3a10a891c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:33.203303 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ed15806-b1c8-4e60-a71c-f2e3a10a891c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:33.203750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ed15806-b1c8-4e60-a71c-f2e3a10a891c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:33.204187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ed15806-b1c8-4e60-a71c-f2e3a10a891c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:33.233512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ac090e6b-5139-41d7-a9e2-d1abcaa5d02b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:33.235739 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ac090e6b-5139-41d7-a9e2-d1abcaa5d02b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:33.236175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1ed15806-b1c8-4e60-a71c-f2e3a10a891c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048330 Sep 05 17:13:33.236744 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 733/1449] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:33 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:33.243090 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac090e6b-5139-41d7-a9e2-d1abcaa5d02b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:33.243569 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac090e6b-5139-41d7-a9e2-d1abcaa5d02b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:33.244020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac090e6b-5139-41d7-a9e2-d1abcaa5d02b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:33.244733 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac090e6b-5139-41d7-a9e2-d1abcaa5d02b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:33.245184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac090e6b-5139-41d7-a9e2-d1abcaa5d02b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:33.245605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ac090e6b-5139-41d7-a9e2-d1abcaa5d02b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:33.249375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:13:33.277365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ac090e6b-5139-41d7-a9e2-d1abcaa5d02b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047934 Sep 05 17:13:33.277920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 717/1450] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:33 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:33.354884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-348c6199-8663-48ec-a245-fd689735c078 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:33.355677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-348c6199-8663-48ec-a245-fd689735c078 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:33.363907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-348c6199-8663-48ec-a245-fd689735c078 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:33.364594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-348c6199-8663-48ec-a245-fd689735c078 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:33.365165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-348c6199-8663-48ec-a245-fd689735c078 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:33.366070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-348c6199-8663-48ec-a245-fd689735c078 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:33.366666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-348c6199-8663-48ec-a245-fd689735c078 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:33.367234 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-348c6199-8663-48ec-a245-fd689735c078 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:33.439066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-348c6199-8663-48ec-a245-fd689735c078 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:33.447701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-348c6199-8663-48ec-a245-fd689735c078 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098343 Sep 05 17:13:33.448175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 734/1451] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:33 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:34.249317 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5158b34d-cd49-44db-9f3b-d3682d2a3071 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:34.251508 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5158b34d-cd49-44db-9f3b-d3682d2a3071 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:34.258629 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5158b34d-cd49-44db-9f3b-d3682d2a3071 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:34.259110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5158b34d-cd49-44db-9f3b-d3682d2a3071 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:34.259538 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5158b34d-cd49-44db-9f3b-d3682d2a3071 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:34.260272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5158b34d-cd49-44db-9f3b-d3682d2a3071 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:34.260723 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5158b34d-cd49-44db-9f3b-d3682d2a3071 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:34.261139 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5158b34d-cd49-44db-9f3b-d3682d2a3071 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:34.290677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9ab53774-0e53-48cf-be3d-9beeeeb538bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:34.292078 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5158b34d-cd49-44db-9f3b-d3682d2a3071 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046871 Sep 05 17:13:34.292885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 718/1452] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:34 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:34.293127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9ab53774-0e53-48cf-be3d-9beeeeb538bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:34.299828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ab53774-0e53-48cf-be3d-9beeeeb538bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:34.300343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ab53774-0e53-48cf-be3d-9beeeeb538bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:34.300774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ab53774-0e53-48cf-be3d-9beeeeb538bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:34.301466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ab53774-0e53-48cf-be3d-9beeeeb538bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:34.301915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ab53774-0e53-48cf-be3d-9beeeeb538bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:34.302333 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ab53774-0e53-48cf-be3d-9beeeeb538bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:34.332862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9ab53774-0e53-48cf-be3d-9beeeeb538bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046188 Sep 05 17:13:34.333427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 735/1453] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:34 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:34.474493 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-650ca5f3-893c-4112-8250-9b3ee1d4007f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:34.475481 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-650ca5f3-893c-4112-8250-9b3ee1d4007f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:34.485612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-650ca5f3-893c-4112-8250-9b3ee1d4007f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:34.486419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-650ca5f3-893c-4112-8250-9b3ee1d4007f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:34.487613 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-650ca5f3-893c-4112-8250-9b3ee1d4007f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:34.488222 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-650ca5f3-893c-4112-8250-9b3ee1d4007f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:34.489004 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-650ca5f3-893c-4112-8250-9b3ee1d4007f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:34.489699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-650ca5f3-893c-4112-8250-9b3ee1d4007f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:34.567705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-650ca5f3-893c-4112-8250-9b3ee1d4007f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:34.579406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-650ca5f3-893c-4112-8250-9b3ee1d4007f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.111509 Sep 05 17:13:34.580181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 719/1454] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:34 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:35.307188 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9cce1fad-a76f-422b-94b3-8f2623637d8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:35.309367 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9cce1fad-a76f-422b-94b3-8f2623637d8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:35.316183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cce1fad-a76f-422b-94b3-8f2623637d8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:35.316679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cce1fad-a76f-422b-94b3-8f2623637d8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:35.317105 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cce1fad-a76f-422b-94b3-8f2623637d8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:35.317781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cce1fad-a76f-422b-94b3-8f2623637d8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:35.318224 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cce1fad-a76f-422b-94b3-8f2623637d8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:35.318640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cce1fad-a76f-422b-94b3-8f2623637d8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:35.345687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c44cf71b-458e-470d-94e0-a2738dd338ca tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:35.347887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c44cf71b-458e-470d-94e0-a2738dd338ca tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:35.349154 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9cce1fad-a76f-422b-94b3-8f2623637d8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046206 Sep 05 17:13:35.349921 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 736/1455] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:35 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:35.355511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c44cf71b-458e-470d-94e0-a2738dd338ca tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:35.355988 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c44cf71b-458e-470d-94e0-a2738dd338ca tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:35.356445 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c44cf71b-458e-470d-94e0-a2738dd338ca tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:35.357141 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c44cf71b-458e-470d-94e0-a2738dd338ca tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:35.357581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c44cf71b-458e-470d-94e0-a2738dd338ca tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:35.357980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c44cf71b-458e-470d-94e0-a2738dd338ca tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:35.388347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c44cf71b-458e-470d-94e0-a2738dd338ca tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046846 Sep 05 17:13:35.388941 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 720/1456] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:35 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:35.604240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ffaa6bb5-7cea-4964-b3c0-aa62d58133f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:35.604876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ffaa6bb5-7cea-4964-b3c0-aa62d58133f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:35.611598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ffaa6bb5-7cea-4964-b3c0-aa62d58133f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:35.612073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ffaa6bb5-7cea-4964-b3c0-aa62d58133f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:35.612536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ffaa6bb5-7cea-4964-b3c0-aa62d58133f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:35.613213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ffaa6bb5-7cea-4964-b3c0-aa62d58133f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:35.613658 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ffaa6bb5-7cea-4964-b3c0-aa62d58133f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:35.614075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ffaa6bb5-7cea-4964-b3c0-aa62d58133f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:35.681227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ffaa6bb5-7cea-4964-b3c0-aa62d58133f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:35.689468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ffaa6bb5-7cea-4964-b3c0-aa62d58133f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089615 Sep 05 17:13:35.690059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 737/1457] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:35 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:36.364654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e626a6fc-7664-48b6-b832-81ecfcb59894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:36.367979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e626a6fc-7664-48b6-b832-81ecfcb59894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:36.371485 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=84 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:13:36.379749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e626a6fc-7664-48b6-b832-81ecfcb59894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:36.380533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e626a6fc-7664-48b6-b832-81ecfcb59894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:36.381189 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e626a6fc-7664-48b6-b832-81ecfcb59894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:36.382114 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e626a6fc-7664-48b6-b832-81ecfcb59894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:36.382673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e626a6fc-7664-48b6-b832-81ecfcb59894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:36.383089 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e626a6fc-7664-48b6-b832-81ecfcb59894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:36.401581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e3edf123-750f-48d2-959a-52a4b564ee05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:36.404420 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e3edf123-750f-48d2-959a-52a4b564ee05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:36.411019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3edf123-750f-48d2-959a-52a4b564ee05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:36.411499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3edf123-750f-48d2-959a-52a4b564ee05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:36.411914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3edf123-750f-48d2-959a-52a4b564ee05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:36.412804 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3edf123-750f-48d2-959a-52a4b564ee05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:36.413353 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3edf123-750f-48d2-959a-52a4b564ee05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:36.413756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3edf123-750f-48d2-959a-52a4b564ee05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:36.414902 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e626a6fc-7664-48b6-b832-81ecfcb59894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056557 Sep 05 17:13:36.415467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 721/1458] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:36 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:36.444105 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e3edf123-750f-48d2-959a-52a4b564ee05 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046634 Sep 05 17:13:36.444766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 738/1459] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:36 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:36.714290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-473f9356-9772-4479-9be0-b9e142143b20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:36.714922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-473f9356-9772-4479-9be0-b9e142143b20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:36.721022 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-473f9356-9772-4479-9be0-b9e142143b20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:36.721498 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-473f9356-9772-4479-9be0-b9e142143b20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:36.721920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-473f9356-9772-4479-9be0-b9e142143b20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:36.722591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-473f9356-9772-4479-9be0-b9e142143b20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:36.723038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-473f9356-9772-4479-9be0-b9e142143b20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:36.723795 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-473f9356-9772-4479-9be0-b9e142143b20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:36.784383 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-473f9356-9772-4479-9be0-b9e142143b20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:36.792531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-473f9356-9772-4479-9be0-b9e142143b20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.082262 Sep 05 17:13:36.793263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 722/1460] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:36 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:37.431626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5e28081d-35b2-4cad-8d37-32a57e736c1e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:37.435022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5e28081d-35b2-4cad-8d37-32a57e736c1e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:37.444827 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e28081d-35b2-4cad-8d37-32a57e736c1e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:37.445310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e28081d-35b2-4cad-8d37-32a57e736c1e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:37.445725 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e28081d-35b2-4cad-8d37-32a57e736c1e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:37.446411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e28081d-35b2-4cad-8d37-32a57e736c1e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:37.446851 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e28081d-35b2-4cad-8d37-32a57e736c1e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:37.447291 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e28081d-35b2-4cad-8d37-32a57e736c1e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:37.458433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-61208eb8-f2bf-4089-8cf5-8e2b39a19ab4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:37.461103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-61208eb8-f2bf-4089-8cf5-8e2b39a19ab4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:37.467865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-61208eb8-f2bf-4089-8cf5-8e2b39a19ab4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:37.468385 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-61208eb8-f2bf-4089-8cf5-8e2b39a19ab4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:37.468807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-61208eb8-f2bf-4089-8cf5-8e2b39a19ab4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:37.469496 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-61208eb8-f2bf-4089-8cf5-8e2b39a19ab4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:37.469936 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-61208eb8-f2bf-4089-8cf5-8e2b39a19ab4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:37.470353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-61208eb8-f2bf-4089-8cf5-8e2b39a19ab4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:37.478632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5e28081d-35b2-4cad-8d37-32a57e736c1e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053743 Sep 05 17:13:37.479215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 739/1461] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:37 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:37.502107 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-61208eb8-f2bf-4089-8cf5-8e2b39a19ab4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047683 Sep 05 17:13:37.502662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 723/1462] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:37 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:37.819394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-be209cde-1dd3-4023-bd91-0bd2758164d2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:37.819878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-be209cde-1dd3-4023-bd91-0bd2758164d2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:37.826319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be209cde-1dd3-4023-bd91-0bd2758164d2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:37.826796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be209cde-1dd3-4023-bd91-0bd2758164d2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:37.827220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be209cde-1dd3-4023-bd91-0bd2758164d2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:37.827896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be209cde-1dd3-4023-bd91-0bd2758164d2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:37.828378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be209cde-1dd3-4023-bd91-0bd2758164d2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:37.828803 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be209cde-1dd3-4023-bd91-0bd2758164d2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:37.896683 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-be209cde-1dd3-4023-bd91-0bd2758164d2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:37.904929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-be209cde-1dd3-4023-bd91-0bd2758164d2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092115 Sep 05 17:13:37.905514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 740/1463] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:37 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:38.494079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3ccd735b-93bf-413e-8b21-21d500df702f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:38.496441 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3ccd735b-93bf-413e-8b21-21d500df702f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:38.503818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ccd735b-93bf-413e-8b21-21d500df702f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:38.504369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ccd735b-93bf-413e-8b21-21d500df702f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:38.504824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ccd735b-93bf-413e-8b21-21d500df702f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:38.505557 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ccd735b-93bf-413e-8b21-21d500df702f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:38.506034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ccd735b-93bf-413e-8b21-21d500df702f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:38.506475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ccd735b-93bf-413e-8b21-21d500df702f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:38.515462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-75a1cdfb-089c-48c0-a70a-64728f3ba180 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:38.517827 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-75a1cdfb-089c-48c0-a70a-64728f3ba180 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:38.525172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75a1cdfb-089c-48c0-a70a-64728f3ba180 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:38.525681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75a1cdfb-089c-48c0-a70a-64728f3ba180 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:38.526105 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75a1cdfb-089c-48c0-a70a-64728f3ba180 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:38.526800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75a1cdfb-089c-48c0-a70a-64728f3ba180 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:38.527274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75a1cdfb-089c-48c0-a70a-64728f3ba180 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:38.527689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75a1cdfb-089c-48c0-a70a-64728f3ba180 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:38.537768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3ccd735b-93bf-413e-8b21-21d500df702f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048947 Sep 05 17:13:38.538460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 724/1464] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:38 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:38.558824 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-75a1cdfb-089c-48c0-a70a-64728f3ba180 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047643 Sep 05 17:13:38.559409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 741/1465] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:38 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:38.927381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3942ebaf-737d-4e45-bc0d-bec27b622eef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:38.928055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3942ebaf-737d-4e45-bc0d-bec27b622eef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:38.935732 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3942ebaf-737d-4e45-bc0d-bec27b622eef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:38.936324 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3942ebaf-737d-4e45-bc0d-bec27b622eef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:38.936837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3942ebaf-737d-4e45-bc0d-bec27b622eef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:38.937606 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3942ebaf-737d-4e45-bc0d-bec27b622eef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:38.938110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3942ebaf-737d-4e45-bc0d-bec27b622eef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:38.938586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3942ebaf-737d-4e45-bc0d-bec27b622eef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:39.013305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3942ebaf-737d-4e45-bc0d-bec27b622eef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:39.024302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3942ebaf-737d-4e45-bc0d-bec27b622eef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.101299 Sep 05 17:13:39.024875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 725/1466] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:38 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:39.554066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-63f5feb8-98e6-4d50-b356-2e3c27363894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:39.557151 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-63f5feb8-98e6-4d50-b356-2e3c27363894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:39.565759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63f5feb8-98e6-4d50-b356-2e3c27363894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:39.566236 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63f5feb8-98e6-4d50-b356-2e3c27363894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:39.566668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63f5feb8-98e6-4d50-b356-2e3c27363894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:39.567359 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63f5feb8-98e6-4d50-b356-2e3c27363894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:39.567809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63f5feb8-98e6-4d50-b356-2e3c27363894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:39.568239 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63f5feb8-98e6-4d50-b356-2e3c27363894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:39.571460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f5ee9602-844f-4ca8-97d5-e695ed413fe4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:39.573672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f5ee9602-844f-4ca8-97d5-e695ed413fe4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:39.580460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5ee9602-844f-4ca8-97d5-e695ed413fe4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:39.580926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5ee9602-844f-4ca8-97d5-e695ed413fe4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:39.581354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5ee9602-844f-4ca8-97d5-e695ed413fe4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:39.582037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5ee9602-844f-4ca8-97d5-e695ed413fe4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:39.582487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5ee9602-844f-4ca8-97d5-e695ed413fe4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:39.582907 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f5ee9602-844f-4ca8-97d5-e695ed413fe4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:39.598977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-63f5feb8-98e6-4d50-b356-2e3c27363894 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050797 Sep 05 17:13:39.599546 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 742/1467] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:39 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:39.613610 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f5ee9602-844f-4ca8-97d5-e695ed413fe4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046488 Sep 05 17:13:39.614168 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 726/1468] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:39 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:40.050588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-17c51492-aa5c-45cc-aee2-5df07e9457cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:40.051597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-17c51492-aa5c-45cc-aee2-5df07e9457cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:40.059369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17c51492-aa5c-45cc-aee2-5df07e9457cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:40.059826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17c51492-aa5c-45cc-aee2-5df07e9457cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:40.060290 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17c51492-aa5c-45cc-aee2-5df07e9457cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:40.060989 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17c51492-aa5c-45cc-aee2-5df07e9457cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:40.061443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17c51492-aa5c-45cc-aee2-5df07e9457cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:40.061864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17c51492-aa5c-45cc-aee2-5df07e9457cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:40.122708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-17c51492-aa5c-45cc-aee2-5df07e9457cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:40.130584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-17c51492-aa5c-45cc-aee2-5df07e9457cf tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086510 Sep 05 17:13:40.131156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 743/1469] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:40 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:40.613018 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-008c315c-3ca2-43c9-8d50-d8699ce0e6ad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:40.615458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-008c315c-3ca2-43c9-8d50-d8699ce0e6ad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:40.622796 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-008c315c-3ca2-43c9-8d50-d8699ce0e6ad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:40.623278 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-008c315c-3ca2-43c9-8d50-d8699ce0e6ad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:40.623684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-008c315c-3ca2-43c9-8d50-d8699ce0e6ad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:40.624402 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-008c315c-3ca2-43c9-8d50-d8699ce0e6ad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:40.624851 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-008c315c-3ca2-43c9-8d50-d8699ce0e6ad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:40.625261 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-008c315c-3ca2-43c9-8d50-d8699ce0e6ad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:40.625637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-84df59d6-da41-44e7-b7e8-641331068d8d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:40.627828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-84df59d6-da41-44e7-b7e8-641331068d8d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:40.634541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84df59d6-da41-44e7-b7e8-641331068d8d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:40.634951 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84df59d6-da41-44e7-b7e8-641331068d8d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:40.635419 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84df59d6-da41-44e7-b7e8-641331068d8d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:40.636114 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84df59d6-da41-44e7-b7e8-641331068d8d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:40.636588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84df59d6-da41-44e7-b7e8-641331068d8d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:40.637013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84df59d6-da41-44e7-b7e8-641331068d8d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:40.655407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-008c315c-3ca2-43c9-8d50-d8699ce0e6ad tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046983 Sep 05 17:13:40.655973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 727/1470] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:40 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:40.668363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-84df59d6-da41-44e7-b7e8-641331068d8d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046756 Sep 05 17:13:40.668929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 744/1471] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:40 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 17:13:41.161087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2c8a8075-74eb-49d3-85ac-399e2287cf00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:41.161725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2c8a8075-74eb-49d3-85ac-399e2287cf00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:41.168554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c8a8075-74eb-49d3-85ac-399e2287cf00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:41.169058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c8a8075-74eb-49d3-85ac-399e2287cf00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:41.169512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c8a8075-74eb-49d3-85ac-399e2287cf00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:41.170230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c8a8075-74eb-49d3-85ac-399e2287cf00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:41.170704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c8a8075-74eb-49d3-85ac-399e2287cf00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:41.171147 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c8a8075-74eb-49d3-85ac-399e2287cf00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:41.233057 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2c8a8075-74eb-49d3-85ac-399e2287cf00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:41.241117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2c8a8075-74eb-49d3-85ac-399e2287cf00 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.084243 Sep 05 17:13:41.242259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 728/1472] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:41 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:41.673230 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-99633fbf-f709-4cba-96a1-d0708fd43823 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:41.676759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-99633fbf-f709-4cba-96a1-d0708fd43823 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:41.685264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-44c2022b-8fa2-4dd6-8500-0e7c1d46633a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:41.688288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99633fbf-f709-4cba-96a1-d0708fd43823 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:41.688719 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-44c2022b-8fa2-4dd6-8500-0e7c1d46633a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:41.689042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99633fbf-f709-4cba-96a1-d0708fd43823 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:41.689872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99633fbf-f709-4cba-96a1-d0708fd43823 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:41.691542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99633fbf-f709-4cba-96a1-d0708fd43823 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:41.692320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99633fbf-f709-4cba-96a1-d0708fd43823 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:41.693302 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99633fbf-f709-4cba-96a1-d0708fd43823 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:41.700204 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-44c2022b-8fa2-4dd6-8500-0e7c1d46633a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:41.700690 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-44c2022b-8fa2-4dd6-8500-0e7c1d46633a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:41.701149 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-44c2022b-8fa2-4dd6-8500-0e7c1d46633a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:41.701835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-44c2022b-8fa2-4dd6-8500-0e7c1d46633a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:41.702280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-44c2022b-8fa2-4dd6-8500-0e7c1d46633a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:41.702691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-44c2022b-8fa2-4dd6-8500-0e7c1d46633a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:41.726600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-99633fbf-f709-4cba-96a1-d0708fd43823 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060072 Sep 05 17:13:41.727168 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 745/1473] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:41 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:41.733389 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-44c2022b-8fa2-4dd6-8500-0e7c1d46633a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054927 Sep 05 17:13:41.733923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 729/1474] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:41 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:42.268735 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d1b8e612-11a2-45c2-8543-8988bdd36d21 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:42.269733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d1b8e612-11a2-45c2-8543-8988bdd36d21 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:42.277236 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1b8e612-11a2-45c2-8543-8988bdd36d21 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:42.277710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1b8e612-11a2-45c2-8543-8988bdd36d21 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:42.278132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1b8e612-11a2-45c2-8543-8988bdd36d21 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:42.278808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1b8e612-11a2-45c2-8543-8988bdd36d21 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:42.279249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1b8e612-11a2-45c2-8543-8988bdd36d21 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:42.279661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1b8e612-11a2-45c2-8543-8988bdd36d21 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:42.341380 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d1b8e612-11a2-45c2-8543-8988bdd36d21 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:42.349579 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d1b8e612-11a2-45c2-8543-8988bdd36d21 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087497 Sep 05 17:13:42.350143 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 746/1475] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:42 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:42.742460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-648c444a-ade2-471b-83f4-4a17eab17296 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:42.744772 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-648c444a-ade2-471b-83f4-4a17eab17296 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:42.746938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cf3c4766-5a25-4f14-8bf1-ec3432e50d04 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:42.749276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cf3c4766-5a25-4f14-8bf1-ec3432e50d04 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:42.751959 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-648c444a-ade2-471b-83f4-4a17eab17296 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:42.752532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-648c444a-ade2-471b-83f4-4a17eab17296 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:42.752985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-648c444a-ade2-471b-83f4-4a17eab17296 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:42.753718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-648c444a-ade2-471b-83f4-4a17eab17296 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:42.754190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-648c444a-ade2-471b-83f4-4a17eab17296 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:42.754606 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-648c444a-ade2-471b-83f4-4a17eab17296 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:42.756249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf3c4766-5a25-4f14-8bf1-ec3432e50d04 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:42.756744 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf3c4766-5a25-4f14-8bf1-ec3432e50d04 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:42.757470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf3c4766-5a25-4f14-8bf1-ec3432e50d04 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:42.758214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf3c4766-5a25-4f14-8bf1-ec3432e50d04 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:42.758687 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf3c4766-5a25-4f14-8bf1-ec3432e50d04 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:42.759126 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf3c4766-5a25-4f14-8bf1-ec3432e50d04 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:42.786051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-648c444a-ade2-471b-83f4-4a17eab17296 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049734 Sep 05 17:13:42.786470 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 730/1476] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:42 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:42.795745 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cf3c4766-5a25-4f14-8bf1-ec3432e50d04 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053099 Sep 05 17:13:42.796363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 747/1477] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:42 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 17:13:43.377012 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6305f963-2385-4082-af14-5a906e1191f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:43.377972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6305f963-2385-4082-af14-5a906e1191f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:43.385724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6305f963-2385-4082-af14-5a906e1191f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:43.386205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6305f963-2385-4082-af14-5a906e1191f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:43.386630 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6305f963-2385-4082-af14-5a906e1191f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:43.387312 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6305f963-2385-4082-af14-5a906e1191f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:43.387750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6305f963-2385-4082-af14-5a906e1191f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:43.388185 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6305f963-2385-4082-af14-5a906e1191f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:43.452472 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6305f963-2385-4082-af14-5a906e1191f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:43.460778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6305f963-2385-4082-af14-5a906e1191f2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.090392 Sep 05 17:13:43.461316 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 731/1478] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:43 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:43.804238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5f53ee49-0cea-45e7-ba30-7f9e5eb9b72d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:43.807333 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5f53ee49-0cea-45e7-ba30-7f9e5eb9b72d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:43.809930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c4f5fb0a-369f-4334-b282-556ef332b37e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:43.812081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c4f5fb0a-369f-4334-b282-556ef332b37e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:43.813915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f53ee49-0cea-45e7-ba30-7f9e5eb9b72d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:43.814388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f53ee49-0cea-45e7-ba30-7f9e5eb9b72d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:43.814814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f53ee49-0cea-45e7-ba30-7f9e5eb9b72d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:43.815471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f53ee49-0cea-45e7-ba30-7f9e5eb9b72d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:43.815941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f53ee49-0cea-45e7-ba30-7f9e5eb9b72d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:43.816355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f53ee49-0cea-45e7-ba30-7f9e5eb9b72d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:43.818249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4f5fb0a-369f-4334-b282-556ef332b37e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:43.818851 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4f5fb0a-369f-4334-b282-556ef332b37e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:43.819294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4f5fb0a-369f-4334-b282-556ef332b37e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:43.820081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4f5fb0a-369f-4334-b282-556ef332b37e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:43.821704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4f5fb0a-369f-4334-b282-556ef332b37e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:43.821704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4f5fb0a-369f-4334-b282-556ef332b37e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:43.831237 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:13:43.850294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5f53ee49-0cea-45e7-ba30-7f9e5eb9b72d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054249 Sep 05 17:13:43.851632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 748/1479] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:43 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:43.853100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c4f5fb0a-369f-4334-b282-556ef332b37e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047453 Sep 05 17:13:43.853786 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 732/1480] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:43 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:44.487312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0fb1d179-e7a2-4dce-a88a-c4028342882c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:44.488340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0fb1d179-e7a2-4dce-a88a-c4028342882c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:44.495886 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fb1d179-e7a2-4dce-a88a-c4028342882c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:44.496393 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fb1d179-e7a2-4dce-a88a-c4028342882c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:44.496836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fb1d179-e7a2-4dce-a88a-c4028342882c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:44.497502 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fb1d179-e7a2-4dce-a88a-c4028342882c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:44.497946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fb1d179-e7a2-4dce-a88a-c4028342882c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:44.498364 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fb1d179-e7a2-4dce-a88a-c4028342882c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:44.566280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0fb1d179-e7a2-4dce-a88a-c4028342882c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:44.574224 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0fb1d179-e7a2-4dce-a88a-c4028342882c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093467 Sep 05 17:13:44.574782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 749/1481] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:44 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:44.864391 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-db0eafa7-d581-4ba9-8f84-c7dd88052954 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:44.866864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-db0eafa7-d581-4ba9-8f84-c7dd88052954 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:44.867045 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-22e7cb77-2ba6-47ca-82ba-657176b916ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:44.869272 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-22e7cb77-2ba6-47ca-82ba-657176b916ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:44.874516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db0eafa7-d581-4ba9-8f84-c7dd88052954 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:44.875045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db0eafa7-d581-4ba9-8f84-c7dd88052954 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:44.875511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db0eafa7-d581-4ba9-8f84-c7dd88052954 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:44.876315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db0eafa7-d581-4ba9-8f84-c7dd88052954 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:44.876476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22e7cb77-2ba6-47ca-82ba-657176b916ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:44.876809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db0eafa7-d581-4ba9-8f84-c7dd88052954 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:44.876971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22e7cb77-2ba6-47ca-82ba-657176b916ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:44.877268 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db0eafa7-d581-4ba9-8f84-c7dd88052954 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:44.877431 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22e7cb77-2ba6-47ca-82ba-657176b916ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:44.878085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22e7cb77-2ba6-47ca-82ba-657176b916ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:44.878584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22e7cb77-2ba6-47ca-82ba-657176b916ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:44.879093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22e7cb77-2ba6-47ca-82ba-657176b916ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:44.909553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:13:44.912718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-22e7cb77-2ba6-47ca-82ba-657176b916ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050781 Sep 05 17:13:44.914233 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 750/1482] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:44 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:44.914382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-db0eafa7-d581-4ba9-8f84-c7dd88052954 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054054 Sep 05 17:13:44.914953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 733/1483] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:44 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:45.601156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-42879840-7bb3-4a5e-b3fd-a9954a565077 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:45.601909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-42879840-7bb3-4a5e-b3fd-a9954a565077 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:45.608890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42879840-7bb3-4a5e-b3fd-a9954a565077 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:45.609402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42879840-7bb3-4a5e-b3fd-a9954a565077 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:45.609852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42879840-7bb3-4a5e-b3fd-a9954a565077 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:45.610574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42879840-7bb3-4a5e-b3fd-a9954a565077 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:45.611051 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42879840-7bb3-4a5e-b3fd-a9954a565077 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:45.611488 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42879840-7bb3-4a5e-b3fd-a9954a565077 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:45.677402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-42879840-7bb3-4a5e-b3fd-a9954a565077 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:45.686427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-42879840-7bb3-4a5e-b3fd-a9954a565077 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092052 Sep 05 17:13:45.687003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 751/1484] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:45 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:45.929905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9d65bb3a-7e77-4715-97a4-e76f5a8b1184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:45.930608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4b69d65e-0187-4e96-8383-ad7735c0c69a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:45.931970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9d65bb3a-7e77-4715-97a4-e76f5a8b1184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:45.932177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4b69d65e-0187-4e96-8383-ad7735c0c69a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:45.938854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d65bb3a-7e77-4715-97a4-e76f5a8b1184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:45.939037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4b69d65e-0187-4e96-8383-ad7735c0c69a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:45.939340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d65bb3a-7e77-4715-97a4-e76f5a8b1184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:45.939509 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4b69d65e-0187-4e96-8383-ad7735c0c69a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:45.939746 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d65bb3a-7e77-4715-97a4-e76f5a8b1184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:45.939865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4b69d65e-0187-4e96-8383-ad7735c0c69a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:45.940508 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d65bb3a-7e77-4715-97a4-e76f5a8b1184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:45.940764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4b69d65e-0187-4e96-8383-ad7735c0c69a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:45.940932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d65bb3a-7e77-4715-97a4-e76f5a8b1184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:45.941202 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4b69d65e-0187-4e96-8383-ad7735c0c69a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:45.941345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d65bb3a-7e77-4715-97a4-e76f5a8b1184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:45.941618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4b69d65e-0187-4e96-8383-ad7735c0c69a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:45.971727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4b69d65e-0187-4e96-8383-ad7735c0c69a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048364 Sep 05 17:13:45.972206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9d65bb3a-7e77-4715-97a4-e76f5a8b1184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048770 Sep 05 17:13:45.972369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 734/1485] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:45 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:45.972827 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 752/1486] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:45 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:46.713450 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0b936104-9e9e-4a78-b496-be8471fa9344 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:46.714241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0b936104-9e9e-4a78-b496-be8471fa9344 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:46.722799 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b936104-9e9e-4a78-b496-be8471fa9344 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:46.723814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b936104-9e9e-4a78-b496-be8471fa9344 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:46.724460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b936104-9e9e-4a78-b496-be8471fa9344 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:46.726729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b936104-9e9e-4a78-b496-be8471fa9344 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:46.726729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b936104-9e9e-4a78-b496-be8471fa9344 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:46.726729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0b936104-9e9e-4a78-b496-be8471fa9344 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:46.799403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0b936104-9e9e-4a78-b496-be8471fa9344 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:46.807659 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0b936104-9e9e-4a78-b496-be8471fa9344 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.100336 Sep 05 17:13:46.808283 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 735/1487] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:46 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:46.985712 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f3336256-de01-4126-88b2-1cd4345d792d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:46.986282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6b482177-d142-4cc7-a523-5c1fa35e9100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:46.987852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f3336256-de01-4126-88b2-1cd4345d792d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:46.987963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6b482177-d142-4cc7-a523-5c1fa35e9100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:46.995123 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3336256-de01-4126-88b2-1cd4345d792d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:46.995592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3336256-de01-4126-88b2-1cd4345d792d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:46.995746 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b482177-d142-4cc7-a523-5c1fa35e9100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:46.996029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3336256-de01-4126-88b2-1cd4345d792d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:46.996232 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b482177-d142-4cc7-a523-5c1fa35e9100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:46.996733 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b482177-d142-4cc7-a523-5c1fa35e9100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:46.996854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3336256-de01-4126-88b2-1cd4345d792d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:46.997173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3336256-de01-4126-88b2-1cd4345d792d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:46.997430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b482177-d142-4cc7-a523-5c1fa35e9100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:46.997582 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3336256-de01-4126-88b2-1cd4345d792d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:46.997878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b482177-d142-4cc7-a523-5c1fa35e9100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:46.998296 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b482177-d142-4cc7-a523-5c1fa35e9100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:47.030094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6b482177-d142-4cc7-a523-5c1fa35e9100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047904 Sep 05 17:13:47.031231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f3336256-de01-4126-88b2-1cd4345d792d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049760 Sep 05 17:13:47.035896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 753/1488] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:46 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:47.036050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 736/1489] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:46 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:47.833830 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-abe1f7dc-6d56-436b-bc39-b91f55a162a8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:47.834831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-abe1f7dc-6d56-436b-bc39-b91f55a162a8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:47.845151 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abe1f7dc-6d56-436b-bc39-b91f55a162a8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:47.845972 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abe1f7dc-6d56-436b-bc39-b91f55a162a8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:47.846638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abe1f7dc-6d56-436b-bc39-b91f55a162a8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:47.847740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abe1f7dc-6d56-436b-bc39-b91f55a162a8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:47.848912 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abe1f7dc-6d56-436b-bc39-b91f55a162a8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:47.849607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abe1f7dc-6d56-436b-bc39-b91f55a162a8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:47.915375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-abe1f7dc-6d56-436b-bc39-b91f55a162a8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:47.927431 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-abe1f7dc-6d56-436b-bc39-b91f55a162a8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.099971 Sep 05 17:13:47.928205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 754/1490] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:47 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:48.046981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1e8bf8d8-1f30-4ec3-b0a6-b38eb3703655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:48.048033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-42d583f8-86ba-4c1c-a26f-d2c01154eb71 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:48.050680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1e8bf8d8-1f30-4ec3-b0a6-b38eb3703655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:48.050961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-42d583f8-86ba-4c1c-a26f-d2c01154eb71 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:48.058588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42d583f8-86ba-4c1c-a26f-d2c01154eb71 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:48.058753 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e8bf8d8-1f30-4ec3-b0a6-b38eb3703655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:48.059066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42d583f8-86ba-4c1c-a26f-d2c01154eb71 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:48.059213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e8bf8d8-1f30-4ec3-b0a6-b38eb3703655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:48.059492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42d583f8-86ba-4c1c-a26f-d2c01154eb71 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:48.059648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e8bf8d8-1f30-4ec3-b0a6-b38eb3703655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:48.060185 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42d583f8-86ba-4c1c-a26f-d2c01154eb71 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:48.060376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e8bf8d8-1f30-4ec3-b0a6-b38eb3703655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:48.060652 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42d583f8-86ba-4c1c-a26f-d2c01154eb71 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:48.060821 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e8bf8d8-1f30-4ec3-b0a6-b38eb3703655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:48.061069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42d583f8-86ba-4c1c-a26f-d2c01154eb71 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:48.061213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e8bf8d8-1f30-4ec3-b0a6-b38eb3703655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:48.091186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1e8bf8d8-1f30-4ec3-b0a6-b38eb3703655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050563 Sep 05 17:13:48.091397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-42d583f8-86ba-4c1c-a26f-d2c01154eb71 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050558 Sep 05 17:13:48.091665 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 755/1491] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:48 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:48.096002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 737/1492] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:48 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:48.954870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b9b110bb-4138-4b83-b231-133f6060e0ea tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:48.955877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b9b110bb-4138-4b83-b231-133f6060e0ea tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:48.964695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9b110bb-4138-4b83-b231-133f6060e0ea tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:48.965175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9b110bb-4138-4b83-b231-133f6060e0ea tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:48.965606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9b110bb-4138-4b83-b231-133f6060e0ea tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:48.966286 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9b110bb-4138-4b83-b231-133f6060e0ea tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:48.966729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9b110bb-4138-4b83-b231-133f6060e0ea tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:48.967141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9b110bb-4138-4b83-b231-133f6060e0ea tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:49.029351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b9b110bb-4138-4b83-b231-133f6060e0ea tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:49.037496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b9b110bb-4138-4b83-b231-133f6060e0ea tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089046 Sep 05 17:13:49.038052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 756/1493] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:48 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:49.103574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a2bd2c89-fe31-4a2e-9562-3d2a1cf5e0bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:49.104205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-59a65cdd-916d-47b3-8c0f-a2610547c0a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:49.105780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a2bd2c89-fe31-4a2e-9562-3d2a1cf5e0bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:49.106069 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-59a65cdd-916d-47b3-8c0f-a2610547c0a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:49.112773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2bd2c89-fe31-4a2e-9562-3d2a1cf5e0bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:49.112958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59a65cdd-916d-47b3-8c0f-a2610547c0a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:49.113250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2bd2c89-fe31-4a2e-9562-3d2a1cf5e0bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:49.113410 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59a65cdd-916d-47b3-8c0f-a2610547c0a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:49.113648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2bd2c89-fe31-4a2e-9562-3d2a1cf5e0bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:49.113805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59a65cdd-916d-47b3-8c0f-a2610547c0a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:49.114355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2bd2c89-fe31-4a2e-9562-3d2a1cf5e0bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:49.114496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59a65cdd-916d-47b3-8c0f-a2610547c0a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:49.114798 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2bd2c89-fe31-4a2e-9562-3d2a1cf5e0bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:49.114926 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59a65cdd-916d-47b3-8c0f-a2610547c0a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:49.115199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2bd2c89-fe31-4a2e-9562-3d2a1cf5e0bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:49.115322 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59a65cdd-916d-47b3-8c0f-a2610547c0a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:49.145148 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a2bd2c89-fe31-4a2e-9562-3d2a1cf5e0bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045583 Sep 05 17:13:49.145386 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-59a65cdd-916d-47b3-8c0f-a2610547c0a6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045727 Sep 05 17:13:49.145716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 738/1494] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:49 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:49.145884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 757/1495] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:49 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:50.064444 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4d65571b-8264-4e53-99d1-5ff69d694c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:50.065429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4d65571b-8264-4e53-99d1-5ff69d694c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:50.073567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d65571b-8264-4e53-99d1-5ff69d694c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:50.074088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d65571b-8264-4e53-99d1-5ff69d694c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:50.074516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d65571b-8264-4e53-99d1-5ff69d694c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:50.075217 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d65571b-8264-4e53-99d1-5ff69d694c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:50.075673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d65571b-8264-4e53-99d1-5ff69d694c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:50.076095 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d65571b-8264-4e53-99d1-5ff69d694c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:50.139744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4d65571b-8264-4e53-99d1-5ff69d694c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:50.148166 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4d65571b-8264-4e53-99d1-5ff69d694c97 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.090337 Sep 05 17:13:50.148751 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 739/1496] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:50 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:50.158061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b384348e-293b-4bae-8963-1e1a9ce744a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:50.158266 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cebae36d-001b-4d20-a0bf-298f8732e0a4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:50.160354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cebae36d-001b-4d20-a0bf-298f8732e0a4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:50.160511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b384348e-293b-4bae-8963-1e1a9ce744a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:50.167381 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cebae36d-001b-4d20-a0bf-298f8732e0a4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:50.167562 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b384348e-293b-4bae-8963-1e1a9ce744a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:50.167859 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cebae36d-001b-4d20-a0bf-298f8732e0a4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:50.168010 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b384348e-293b-4bae-8963-1e1a9ce744a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:50.168319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cebae36d-001b-4d20-a0bf-298f8732e0a4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:50.168485 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b384348e-293b-4bae-8963-1e1a9ce744a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:50.169013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cebae36d-001b-4d20-a0bf-298f8732e0a4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:50.169174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b384348e-293b-4bae-8963-1e1a9ce744a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:50.169449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cebae36d-001b-4d20-a0bf-298f8732e0a4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:50.169598 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b384348e-293b-4bae-8963-1e1a9ce744a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:50.169864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cebae36d-001b-4d20-a0bf-298f8732e0a4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:50.170012 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b384348e-293b-4bae-8963-1e1a9ce744a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:50.200428 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b384348e-293b-4bae-8963-1e1a9ce744a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046280 Sep 05 17:13:50.200687 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cebae36d-001b-4d20-a0bf-298f8732e0a4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046245 Sep 05 17:13:50.201042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 740/1498] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:50 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:50.201199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 758/1498] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:50 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:51.171609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0fe422b0-cfcf-439e-a322-7c6e6a33b808 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:51.172449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0fe422b0-cfcf-439e-a322-7c6e6a33b808 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:51.179813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fe422b0-cfcf-439e-a322-7c6e6a33b808 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:51.180356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fe422b0-cfcf-439e-a322-7c6e6a33b808 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:51.180785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fe422b0-cfcf-439e-a322-7c6e6a33b808 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:51.181470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fe422b0-cfcf-439e-a322-7c6e6a33b808 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:51.181914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fe422b0-cfcf-439e-a322-7c6e6a33b808 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:51.182339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fe422b0-cfcf-439e-a322-7c6e6a33b808 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:51.213938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-895bf98d-ac37-4606-b8bf-e8b9e8436502 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:51.216126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-895bf98d-ac37-4606-b8bf-e8b9e8436502 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:51.222731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-895bf98d-ac37-4606-b8bf-e8b9e8436502 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:51.223541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-895bf98d-ac37-4606-b8bf-e8b9e8436502 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:51.224007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-895bf98d-ac37-4606-b8bf-e8b9e8436502 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:51.224723 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-895bf98d-ac37-4606-b8bf-e8b9e8436502 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:51.225170 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-895bf98d-ac37-4606-b8bf-e8b9e8436502 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:51.225588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-895bf98d-ac37-4606-b8bf-e8b9e8436502 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:51.244845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0fe422b0-cfcf-439e-a322-7c6e6a33b808 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:51.252709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0fe422b0-cfcf-439e-a322-7c6e6a33b808 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.085563 Sep 05 17:13:51.253264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 759/1499] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:51 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:51.255809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-895bf98d-ac37-4606-b8bf-e8b9e8436502 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046689 Sep 05 17:13:51.256555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 741/1500] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:51 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:51.257996 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b288d180-d57a-408e-8482-9fb07a534106 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:51.260424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b288d180-d57a-408e-8482-9fb07a534106 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:51.266506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b288d180-d57a-408e-8482-9fb07a534106 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:51.266978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b288d180-d57a-408e-8482-9fb07a534106 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:51.267409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b288d180-d57a-408e-8482-9fb07a534106 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:51.268100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b288d180-d57a-408e-8482-9fb07a534106 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:51.268571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b288d180-d57a-408e-8482-9fb07a534106 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:51.268985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b288d180-d57a-408e-8482-9fb07a534106 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:51.297897 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b288d180-d57a-408e-8482-9fb07a534106 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043665 Sep 05 17:13:51.298451 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 760/1501] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:51 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:52.273442 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-453ad014-c606-4ee1-80fa-11bc355b89a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:52.276957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-453ad014-c606-4ee1-80fa-11bc355b89a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:52.279062 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7f82ce3b-3938-4209-81cc-dc5d1d6f01d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:52.280065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7f82ce3b-3938-4209-81cc-dc5d1d6f01d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:52.286803 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-453ad014-c606-4ee1-80fa-11bc355b89a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:52.287602 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-453ad014-c606-4ee1-80fa-11bc355b89a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:52.288364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-453ad014-c606-4ee1-80fa-11bc355b89a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:52.289511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-453ad014-c606-4ee1-80fa-11bc355b89a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:52.290266 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-453ad014-c606-4ee1-80fa-11bc355b89a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:52.290863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f82ce3b-3938-4209-81cc-dc5d1d6f01d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:52.290992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-453ad014-c606-4ee1-80fa-11bc355b89a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:52.291443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f82ce3b-3938-4209-81cc-dc5d1d6f01d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:52.291877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f82ce3b-3938-4209-81cc-dc5d1d6f01d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:52.292597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f82ce3b-3938-4209-81cc-dc5d1d6f01d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:52.293073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f82ce3b-3938-4209-81cc-dc5d1d6f01d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:52.293495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f82ce3b-3938-4209-81cc-dc5d1d6f01d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:52.321504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-453ad014-c606-4ee1-80fa-11bc355b89a2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054804 Sep 05 17:13:52.322285 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 742/1502] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:52 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:52.326683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0140308c-3bba-48ef-ae9f-c693cee7b87b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:52.328902 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0140308c-3bba-48ef-ae9f-c693cee7b87b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:52.335032 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0140308c-3bba-48ef-ae9f-c693cee7b87b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:52.335523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0140308c-3bba-48ef-ae9f-c693cee7b87b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:52.335933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0140308c-3bba-48ef-ae9f-c693cee7b87b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:52.336668 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0140308c-3bba-48ef-ae9f-c693cee7b87b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:52.337122 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0140308c-3bba-48ef-ae9f-c693cee7b87b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:52.337564 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0140308c-3bba-48ef-ae9f-c693cee7b87b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:52.358751 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7f82ce3b-3938-4209-81cc-dc5d1d6f01d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:52.366507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7f82ce3b-3938-4209-81cc-dc5d1d6f01d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.094180 Sep 05 17:13:52.367068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 761/1503] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:52 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:52.372834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0140308c-3bba-48ef-ae9f-c693cee7b87b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045724 Sep 05 17:13:52.372834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 743/1504] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:52 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:53.338656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-89cebefa-a9b2-4823-bbdd-8165c282229a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:53.340889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-89cebefa-a9b2-4823-bbdd-8165c282229a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:53.347727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89cebefa-a9b2-4823-bbdd-8165c282229a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:53.348620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89cebefa-a9b2-4823-bbdd-8165c282229a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:53.349058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89cebefa-a9b2-4823-bbdd-8165c282229a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:53.349757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89cebefa-a9b2-4823-bbdd-8165c282229a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:53.350204 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89cebefa-a9b2-4823-bbdd-8165c282229a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:53.350627 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89cebefa-a9b2-4823-bbdd-8165c282229a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:53.381000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-89cebefa-a9b2-4823-bbdd-8165c282229a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048922 Sep 05 17:13:53.381764 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 762/1505] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:53 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:53.383706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-315b5e29-f978-45da-aefa-4171a2fb0139 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:53.386075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-315b5e29-f978-45da-aefa-4171a2fb0139 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:53.390844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c12a70c8-bafd-4048-b89f-e04452d90627 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:53.391449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c12a70c8-bafd-4048-b89f-e04452d90627 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:53.392953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-315b5e29-f978-45da-aefa-4171a2fb0139 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:53.393482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-315b5e29-f978-45da-aefa-4171a2fb0139 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:53.393908 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-315b5e29-f978-45da-aefa-4171a2fb0139 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:53.394572 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-315b5e29-f978-45da-aefa-4171a2fb0139 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:53.395043 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-315b5e29-f978-45da-aefa-4171a2fb0139 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:53.395456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-315b5e29-f978-45da-aefa-4171a2fb0139 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:53.397590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c12a70c8-bafd-4048-b89f-e04452d90627 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:53.397994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c12a70c8-bafd-4048-b89f-e04452d90627 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:53.398426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c12a70c8-bafd-4048-b89f-e04452d90627 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:53.399131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c12a70c8-bafd-4048-b89f-e04452d90627 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:53.399578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c12a70c8-bafd-4048-b89f-e04452d90627 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:53.400047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c12a70c8-bafd-4048-b89f-e04452d90627 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:53.425443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-315b5e29-f978-45da-aefa-4171a2fb0139 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045673 Sep 05 17:13:53.427329 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 744/1506] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:53 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:53.461645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c12a70c8-bafd-4048-b89f-e04452d90627 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:53.470061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c12a70c8-bafd-4048-b89f-e04452d90627 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.082951 Sep 05 17:13:53.470637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 763/1507] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:53 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:13:54.397702 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-772f1bc3-cdc8-400d-8b0b-c1e2f8e5e5cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:54.401282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-772f1bc3-cdc8-400d-8b0b-c1e2f8e5e5cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:54.411501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-772f1bc3-cdc8-400d-8b0b-c1e2f8e5e5cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:54.412102 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-772f1bc3-cdc8-400d-8b0b-c1e2f8e5e5cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:54.412566 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-772f1bc3-cdc8-400d-8b0b-c1e2f8e5e5cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:54.413539 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-772f1bc3-cdc8-400d-8b0b-c1e2f8e5e5cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:54.414105 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-772f1bc3-cdc8-400d-8b0b-c1e2f8e5e5cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:54.414673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-772f1bc3-cdc8-400d-8b0b-c1e2f8e5e5cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:54.439787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fe776d71-6ab8-4d3b-bd94-1116e1e50a6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:54.442061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fe776d71-6ab8-4d3b-bd94-1116e1e50a6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:54.448867 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-772f1bc3-cdc8-400d-8b0b-c1e2f8e5e5cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058000 Sep 05 17:13:54.449451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 745/1508] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:54 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:54.449721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe776d71-6ab8-4d3b-bd94-1116e1e50a6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:54.450191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe776d71-6ab8-4d3b-bd94-1116e1e50a6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:54.450705 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe776d71-6ab8-4d3b-bd94-1116e1e50a6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:54.451406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe776d71-6ab8-4d3b-bd94-1116e1e50a6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:54.451852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe776d71-6ab8-4d3b-bd94-1116e1e50a6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:54.452302 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe776d71-6ab8-4d3b-bd94-1116e1e50a6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:54.482938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fe776d71-6ab8-4d3b-bd94-1116e1e50a6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047357 Sep 05 17:13:54.483495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 764/1509] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:54 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:54.492751 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c365cb3f-45b6-4cb5-8016-377bcf1e06e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:54.493356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c365cb3f-45b6-4cb5-8016-377bcf1e06e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:54.499621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c365cb3f-45b6-4cb5-8016-377bcf1e06e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:54.500096 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c365cb3f-45b6-4cb5-8016-377bcf1e06e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:54.500546 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c365cb3f-45b6-4cb5-8016-377bcf1e06e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:54.501288 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c365cb3f-45b6-4cb5-8016-377bcf1e06e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:54.501822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c365cb3f-45b6-4cb5-8016-377bcf1e06e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:54.502188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c365cb3f-45b6-4cb5-8016-377bcf1e06e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:54.566423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c365cb3f-45b6-4cb5-8016-377bcf1e06e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:54.576107 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c365cb3f-45b6-4cb5-8016-377bcf1e06e8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087219 Sep 05 17:13:54.576716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 746/1510] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:54 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:55.464437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b992ce97-43c0-42de-982f-e9ab1581ccb8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:55.466602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b992ce97-43c0-42de-982f-e9ab1581ccb8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:55.473954 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b992ce97-43c0-42de-982f-e9ab1581ccb8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:55.474554 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b992ce97-43c0-42de-982f-e9ab1581ccb8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:55.474951 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b992ce97-43c0-42de-982f-e9ab1581ccb8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:55.475665 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b992ce97-43c0-42de-982f-e9ab1581ccb8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:55.476102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b992ce97-43c0-42de-982f-e9ab1581ccb8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:55.476545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b992ce97-43c0-42de-982f-e9ab1581ccb8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:55.481751 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:13:55.495524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c4c233c3-d23b-49ce-9c8a-447360334c32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:55.497696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c4c233c3-d23b-49ce-9c8a-447360334c32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:55.504845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4c233c3-d23b-49ce-9c8a-447360334c32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:55.505328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4c233c3-d23b-49ce-9c8a-447360334c32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:55.505784 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4c233c3-d23b-49ce-9c8a-447360334c32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:55.506486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4c233c3-d23b-49ce-9c8a-447360334c32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:55.506938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4c233c3-d23b-49ce-9c8a-447360334c32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:55.507360 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c4c233c3-d23b-49ce-9c8a-447360334c32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:55.507803 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b992ce97-43c0-42de-982f-e9ab1581ccb8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049582 Sep 05 17:13:55.508435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 765/1511] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:55 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:55.537864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c4c233c3-d23b-49ce-9c8a-447360334c32 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046587 Sep 05 17:13:55.538399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 747/1512] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Sep 5 17:13:55 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:13:55.601755 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cf6a545d-acb7-4ac8-9804-9c80da2e130e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:55.602542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cf6a545d-acb7-4ac8-9804-9c80da2e130e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:55.611381 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf6a545d-acb7-4ac8-9804-9c80da2e130e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:55.612064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf6a545d-acb7-4ac8-9804-9c80da2e130e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:55.612685 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf6a545d-acb7-4ac8-9804-9c80da2e130e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:55.613594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf6a545d-acb7-4ac8-9804-9c80da2e130e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:55.614198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf6a545d-acb7-4ac8-9804-9c80da2e130e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:55.614753 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf6a545d-acb7-4ac8-9804-9c80da2e130e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:55.685128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cf6a545d-acb7-4ac8-9804-9c80da2e130e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:55.694764 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cf6a545d-acb7-4ac8-9804-9c80da2e130e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098719 Sep 05 17:13:55.695342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 766/1513] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:55 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:56.521176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9c28a0d6-0715-40c6-a820-04dbcabcc2f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:56.523363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9c28a0d6-0715-40c6-a820-04dbcabcc2f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:56.530711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c28a0d6-0715-40c6-a820-04dbcabcc2f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:56.531194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c28a0d6-0715-40c6-a820-04dbcabcc2f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:56.531622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c28a0d6-0715-40c6-a820-04dbcabcc2f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:56.532348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c28a0d6-0715-40c6-a820-04dbcabcc2f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:56.532796 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c28a0d6-0715-40c6-a820-04dbcabcc2f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:56.533218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c28a0d6-0715-40c6-a820-04dbcabcc2f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:56.551112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-17f21d03-4e38-4448-80d6-744b39cdc20b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:13:56.553335 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-17f21d03-4e38-4448-80d6-744b39cdc20b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:56.560415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17f21d03-4e38-4448-80d6-744b39cdc20b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:56.560932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17f21d03-4e38-4448-80d6-744b39cdc20b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:56.561366 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17f21d03-4e38-4448-80d6-744b39cdc20b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:56.562071 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17f21d03-4e38-4448-80d6-744b39cdc20b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:56.562496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17f21d03-4e38-4448-80d6-744b39cdc20b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:56.562923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17f21d03-4e38-4448-80d6-744b39cdc20b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:56.564653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9c28a0d6-0715-40c6-a820-04dbcabcc2f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047543 Sep 05 17:13:56.565197 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 748/1514] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:56 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:56.668520 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-17f21d03-4e38-4448-80d6-744b39cdc20b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "POST /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/action" status: 200 len: 37466 microversion: 2.20 time: 0.121037 Sep 05 17:13:56.669062 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 767/1515] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Sep 5 17:13:56 2022] POST /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68/action => generated 37466 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:13:56.717926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-73770b3f-ca0d-4504-b524-df64228c5019 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:56.718530 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-73770b3f-ca0d-4504-b524-df64228c5019 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:56.725316 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-73770b3f-ca0d-4504-b524-df64228c5019 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:56.725790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-73770b3f-ca0d-4504-b524-df64228c5019 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:56.726212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-73770b3f-ca0d-4504-b524-df64228c5019 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:56.726886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-73770b3f-ca0d-4504-b524-df64228c5019 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:56.727338 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-73770b3f-ca0d-4504-b524-df64228c5019 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:56.727749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-73770b3f-ca0d-4504-b524-df64228c5019 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:56.794975 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-73770b3f-ca0d-4504-b524-df64228c5019 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:56.807062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-73770b3f-ca0d-4504-b524-df64228c5019 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092688 Sep 05 17:13:56.807921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 749/1516] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:56 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:57.578856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ee9da9b8-7d42-4d45-a3f4-65592f345c26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:57.581134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ee9da9b8-7d42-4d45-a3f4-65592f345c26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:57.588468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee9da9b8-7d42-4d45-a3f4-65592f345c26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:57.588948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee9da9b8-7d42-4d45-a3f4-65592f345c26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:57.589373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee9da9b8-7d42-4d45-a3f4-65592f345c26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:57.590054 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee9da9b8-7d42-4d45-a3f4-65592f345c26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:57.590493 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee9da9b8-7d42-4d45-a3f4-65592f345c26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:57.590909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee9da9b8-7d42-4d45-a3f4-65592f345c26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:57.622434 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ee9da9b8-7d42-4d45-a3f4-65592f345c26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047975 Sep 05 17:13:57.622988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 768/1517] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:57 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:57.834272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e6e2ad94-3b60-4a88-bf89-87c06b3e997e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:57.835206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e6e2ad94-3b60-4a88-bf89-87c06b3e997e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:57.844059 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6e2ad94-3b60-4a88-bf89-87c06b3e997e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:57.844672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6e2ad94-3b60-4a88-bf89-87c06b3e997e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:57.845178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6e2ad94-3b60-4a88-bf89-87c06b3e997e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:57.845992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6e2ad94-3b60-4a88-bf89-87c06b3e997e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:57.846528 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6e2ad94-3b60-4a88-bf89-87c06b3e997e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:57.847026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6e2ad94-3b60-4a88-bf89-87c06b3e997e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:57.870089 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:13:57.912691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e6e2ad94-3b60-4a88-bf89-87c06b3e997e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:57.921142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e6e2ad94-3b60-4a88-bf89-87c06b3e997e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093490 Sep 05 17:13:57.921709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 750/1518] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:57 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:58.641798 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b06632e9-437b-4950-9906-30e3fbf14729 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:58.645213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b06632e9-437b-4950-9906-30e3fbf14729 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:58.654129 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b06632e9-437b-4950-9906-30e3fbf14729 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:58.654614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b06632e9-437b-4950-9906-30e3fbf14729 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:58.655046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b06632e9-437b-4950-9906-30e3fbf14729 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:58.655731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b06632e9-437b-4950-9906-30e3fbf14729 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:58.656190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b06632e9-437b-4950-9906-30e3fbf14729 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:58.656625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b06632e9-437b-4950-9906-30e3fbf14729 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:58.687615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b06632e9-437b-4950-9906-30e3fbf14729 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052655 Sep 05 17:13:58.688174 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 769/1519] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:58 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:13:58.950068 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9800c0a2-0104-431c-a5f8-4f7c756aa414 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:58.950966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9800c0a2-0104-431c-a5f8-4f7c756aa414 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:58.959087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9800c0a2-0104-431c-a5f8-4f7c756aa414 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:58.959604 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9800c0a2-0104-431c-a5f8-4f7c756aa414 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:58.960096 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9800c0a2-0104-431c-a5f8-4f7c756aa414 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:58.960907 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9800c0a2-0104-431c-a5f8-4f7c756aa414 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:58.961375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9800c0a2-0104-431c-a5f8-4f7c756aa414 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:58.961795 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9800c0a2-0104-431c-a5f8-4f7c756aa414 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:59.024797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9800c0a2-0104-431c-a5f8-4f7c756aa414 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:13:59.033348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9800c0a2-0104-431c-a5f8-4f7c756aa414 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.088360 Sep 05 17:13:59.033938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 751/1520] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:13:58 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:13:59.702936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d19876f4-68fa-4b71-914d-0a48112e81cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:13:59.705839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d19876f4-68fa-4b71-914d-0a48112e81cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:13:59.714807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d19876f4-68fa-4b71-914d-0a48112e81cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:59.715292 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d19876f4-68fa-4b71-914d-0a48112e81cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:59.715720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d19876f4-68fa-4b71-914d-0a48112e81cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:59.716453 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d19876f4-68fa-4b71-914d-0a48112e81cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:13:59.716899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d19876f4-68fa-4b71-914d-0a48112e81cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:13:59.717317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d19876f4-68fa-4b71-914d-0a48112e81cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:13:59.750530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d19876f4-68fa-4b71-914d-0a48112e81cb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052349 Sep 05 17:13:59.751136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 770/1521] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:13:59 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:00.059117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f583bfe8-de36-4cc5-927f-24fccc0f5b34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:00.059708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f583bfe8-de36-4cc5-927f-24fccc0f5b34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:00.066837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f583bfe8-de36-4cc5-927f-24fccc0f5b34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:00.067343 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f583bfe8-de36-4cc5-927f-24fccc0f5b34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:00.067777 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f583bfe8-de36-4cc5-927f-24fccc0f5b34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:00.068522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f583bfe8-de36-4cc5-927f-24fccc0f5b34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:00.068984 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f583bfe8-de36-4cc5-927f-24fccc0f5b34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:00.069653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f583bfe8-de36-4cc5-927f-24fccc0f5b34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:00.145790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f583bfe8-de36-4cc5-927f-24fccc0f5b34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:00.156263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f583bfe8-de36-4cc5-927f-24fccc0f5b34 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.102879 Sep 05 17:14:00.156884 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 752/1522] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:00 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:00.763619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-59b60a87-240d-488a-86f0-4cd6f5df3819 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:00.765725 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-59b60a87-240d-488a-86f0-4cd6f5df3819 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:00.772720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59b60a87-240d-488a-86f0-4cd6f5df3819 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:00.773212 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59b60a87-240d-488a-86f0-4cd6f5df3819 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:00.773632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59b60a87-240d-488a-86f0-4cd6f5df3819 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:00.774323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59b60a87-240d-488a-86f0-4cd6f5df3819 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:00.774774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59b60a87-240d-488a-86f0-4cd6f5df3819 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:00.775195 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59b60a87-240d-488a-86f0-4cd6f5df3819 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:00.805312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-59b60a87-240d-488a-86f0-4cd6f5df3819 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045880 Sep 05 17:14:00.805875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 771/1523] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:00 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:01.179296 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-64582ec8-f3bb-449b-a76b-9a14f04fde59 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:01.179912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-64582ec8-f3bb-449b-a76b-9a14f04fde59 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:01.187106 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64582ec8-f3bb-449b-a76b-9a14f04fde59 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:01.187587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64582ec8-f3bb-449b-a76b-9a14f04fde59 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:01.187999 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64582ec8-f3bb-449b-a76b-9a14f04fde59 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:01.188755 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64582ec8-f3bb-449b-a76b-9a14f04fde59 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:01.189209 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64582ec8-f3bb-449b-a76b-9a14f04fde59 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:01.189633 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64582ec8-f3bb-449b-a76b-9a14f04fde59 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:01.260293 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-64582ec8-f3bb-449b-a76b-9a14f04fde59 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:01.268352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-64582ec8-f3bb-449b-a76b-9a14f04fde59 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092986 Sep 05 17:14:01.268894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 753/1524] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:01 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:01.824185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7459dce4-474f-4336-8880-c7a0dd79caeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:01.826508 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7459dce4-474f-4336-8880-c7a0dd79caeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:01.833654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7459dce4-474f-4336-8880-c7a0dd79caeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:01.834158 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7459dce4-474f-4336-8880-c7a0dd79caeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:01.834615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7459dce4-474f-4336-8880-c7a0dd79caeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:01.835345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7459dce4-474f-4336-8880-c7a0dd79caeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:01.835819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7459dce4-474f-4336-8880-c7a0dd79caeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:01.836293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7459dce4-474f-4336-8880-c7a0dd79caeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:01.869565 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7459dce4-474f-4336-8880-c7a0dd79caeb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051721 Sep 05 17:14:01.870154 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 772/1525] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:01 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:02.295563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b52f9c58-9702-4d69-8a01-0b0457b78f05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:02.296497 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b52f9c58-9702-4d69-8a01-0b0457b78f05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:02.307353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b52f9c58-9702-4d69-8a01-0b0457b78f05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:02.308117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b52f9c58-9702-4d69-8a01-0b0457b78f05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:02.308634 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b52f9c58-9702-4d69-8a01-0b0457b78f05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:02.309324 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b52f9c58-9702-4d69-8a01-0b0457b78f05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:02.309770 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b52f9c58-9702-4d69-8a01-0b0457b78f05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:02.310179 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b52f9c58-9702-4d69-8a01-0b0457b78f05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:02.380545 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b52f9c58-9702-4d69-8a01-0b0457b78f05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:02.389165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b52f9c58-9702-4d69-8a01-0b0457b78f05 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.100213 Sep 05 17:14:02.389937 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 754/1526] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:02 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:02.888829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-95b4cc5c-67c9-4c27-92bb-7abe294cc86a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:02.892417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-95b4cc5c-67c9-4c27-92bb-7abe294cc86a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:02.903278 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95b4cc5c-67c9-4c27-92bb-7abe294cc86a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:02.903756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95b4cc5c-67c9-4c27-92bb-7abe294cc86a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:02.904195 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95b4cc5c-67c9-4c27-92bb-7abe294cc86a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:02.904907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95b4cc5c-67c9-4c27-92bb-7abe294cc86a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:02.905355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95b4cc5c-67c9-4c27-92bb-7abe294cc86a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:02.905772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95b4cc5c-67c9-4c27-92bb-7abe294cc86a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:02.937594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-95b4cc5c-67c9-4c27-92bb-7abe294cc86a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057074 Sep 05 17:14:02.938165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 773/1527] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:02 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:03.412757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a1dce53b-8076-4d13-b02a-5b472aafaaa4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:03.413254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a1dce53b-8076-4d13-b02a-5b472aafaaa4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:03.420436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1dce53b-8076-4d13-b02a-5b472aafaaa4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:03.420913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1dce53b-8076-4d13-b02a-5b472aafaaa4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:03.421337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1dce53b-8076-4d13-b02a-5b472aafaaa4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:03.422020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1dce53b-8076-4d13-b02a-5b472aafaaa4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:03.422461 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1dce53b-8076-4d13-b02a-5b472aafaaa4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:03.422876 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1dce53b-8076-4d13-b02a-5b472aafaaa4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:03.487972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a1dce53b-8076-4d13-b02a-5b472aafaaa4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:03.496385 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a1dce53b-8076-4d13-b02a-5b472aafaaa4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087618 Sep 05 17:14:03.496969 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 755/1528] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:03 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:03.955936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-327e3762-4797-4458-8dac-042e496f0734 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:03.958761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-327e3762-4797-4458-8dac-042e496f0734 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:03.961918 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=82 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:14:03.969006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-327e3762-4797-4458-8dac-042e496f0734 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:03.969637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-327e3762-4797-4458-8dac-042e496f0734 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:03.970211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-327e3762-4797-4458-8dac-042e496f0734 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:03.971120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-327e3762-4797-4458-8dac-042e496f0734 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:03.971711 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-327e3762-4797-4458-8dac-042e496f0734 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:03.972319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-327e3762-4797-4458-8dac-042e496f0734 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:04.004478 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-327e3762-4797-4458-8dac-042e496f0734 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053909 Sep 05 17:14:04.005035 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 774/1529] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:03 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:04.523153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-951faf69-1930-44d6-90fd-e09f54418ed9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:04.524143 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-951faf69-1930-44d6-90fd-e09f54418ed9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:04.531914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-951faf69-1930-44d6-90fd-e09f54418ed9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:04.532427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-951faf69-1930-44d6-90fd-e09f54418ed9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:04.532852 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-951faf69-1930-44d6-90fd-e09f54418ed9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:04.533535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-951faf69-1930-44d6-90fd-e09f54418ed9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:04.533985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-951faf69-1930-44d6-90fd-e09f54418ed9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:04.534397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-951faf69-1930-44d6-90fd-e09f54418ed9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:04.595929 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-951faf69-1930-44d6-90fd-e09f54418ed9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:04.604239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-951faf69-1930-44d6-90fd-e09f54418ed9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087717 Sep 05 17:14:04.604798 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 756/1530] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:04 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:05.019632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f1f63526-04c2-43d6-9f6e-ceceed57c9d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:05.023001 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f1f63526-04c2-43d6-9f6e-ceceed57c9d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:05.031773 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1f63526-04c2-43d6-9f6e-ceceed57c9d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:05.032654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1f63526-04c2-43d6-9f6e-ceceed57c9d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:05.033408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1f63526-04c2-43d6-9f6e-ceceed57c9d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:05.034369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1f63526-04c2-43d6-9f6e-ceceed57c9d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:05.034833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1f63526-04c2-43d6-9f6e-ceceed57c9d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:05.035250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1f63526-04c2-43d6-9f6e-ceceed57c9d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:05.073181 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f1f63526-04c2-43d6-9f6e-ceceed57c9d4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058444 Sep 05 17:14:05.073741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 775/1531] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:05 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:05.629748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8381d72f-ce92-48a7-a6a9-866fe5311860 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:05.630592 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8381d72f-ce92-48a7-a6a9-866fe5311860 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:05.639540 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8381d72f-ce92-48a7-a6a9-866fe5311860 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:05.640016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8381d72f-ce92-48a7-a6a9-866fe5311860 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:05.640470 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8381d72f-ce92-48a7-a6a9-866fe5311860 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:05.641155 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8381d72f-ce92-48a7-a6a9-866fe5311860 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:05.641602 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8381d72f-ce92-48a7-a6a9-866fe5311860 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:05.642015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8381d72f-ce92-48a7-a6a9-866fe5311860 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:05.715589 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8381d72f-ce92-48a7-a6a9-866fe5311860 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:05.724058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8381d72f-ce92-48a7-a6a9-866fe5311860 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.100528 Sep 05 17:14:05.724661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 757/1532] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:05 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:06.087979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ed2552dd-1ab9-45a0-9595-f17bdbb01fe9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:06.091130 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ed2552dd-1ab9-45a0-9595-f17bdbb01fe9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:06.098317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed2552dd-1ab9-45a0-9595-f17bdbb01fe9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:06.098822 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed2552dd-1ab9-45a0-9595-f17bdbb01fe9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:06.099255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed2552dd-1ab9-45a0-9595-f17bdbb01fe9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:06.099948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed2552dd-1ab9-45a0-9595-f17bdbb01fe9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:06.100434 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed2552dd-1ab9-45a0-9595-f17bdbb01fe9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:06.100853 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed2552dd-1ab9-45a0-9595-f17bdbb01fe9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:06.130742 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ed2552dd-1ab9-45a0-9595-f17bdbb01fe9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047876 Sep 05 17:14:06.131537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 776/1533] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:06 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:06.751601 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c7d6813f-89a2-4990-b30b-7c7df7804489 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:06.752595 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c7d6813f-89a2-4990-b30b-7c7df7804489 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:06.756286 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=74 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:14:06.765526 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7d6813f-89a2-4990-b30b-7c7df7804489 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:06.766316 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7d6813f-89a2-4990-b30b-7c7df7804489 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:06.767027 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7d6813f-89a2-4990-b30b-7c7df7804489 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:06.768306 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7d6813f-89a2-4990-b30b-7c7df7804489 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:06.768960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7d6813f-89a2-4990-b30b-7c7df7804489 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:06.769689 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7d6813f-89a2-4990-b30b-7c7df7804489 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:06.834563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c7d6813f-89a2-4990-b30b-7c7df7804489 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:06.842990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c7d6813f-89a2-4990-b30b-7c7df7804489 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098255 Sep 05 17:14:06.843563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 758/1534] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:06 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:07.144107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-86bf91e2-94b2-4b9c-a671-606e3257b4e7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:07.146342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-86bf91e2-94b2-4b9c-a671-606e3257b4e7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:07.153485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86bf91e2-94b2-4b9c-a671-606e3257b4e7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:07.153970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86bf91e2-94b2-4b9c-a671-606e3257b4e7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:07.154400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86bf91e2-94b2-4b9c-a671-606e3257b4e7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:07.155100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86bf91e2-94b2-4b9c-a671-606e3257b4e7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:07.155548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86bf91e2-94b2-4b9c-a671-606e3257b4e7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:07.155954 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86bf91e2-94b2-4b9c-a671-606e3257b4e7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:07.193044 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-86bf91e2-94b2-4b9c-a671-606e3257b4e7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052866 Sep 05 17:14:07.193757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 777/1535] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:07 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:07.869828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2a0b63f8-8245-46ae-80f6-5cadcded936a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:07.870753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2a0b63f8-8245-46ae-80f6-5cadcded936a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:07.881680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a0b63f8-8245-46ae-80f6-5cadcded936a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:07.882469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a0b63f8-8245-46ae-80f6-5cadcded936a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:07.883174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a0b63f8-8245-46ae-80f6-5cadcded936a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:07.884550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a0b63f8-8245-46ae-80f6-5cadcded936a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:07.885289 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a0b63f8-8245-46ae-80f6-5cadcded936a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:07.885982 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2a0b63f8-8245-46ae-80f6-5cadcded936a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:07.963709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2a0b63f8-8245-46ae-80f6-5cadcded936a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:07.974928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2a0b63f8-8245-46ae-80f6-5cadcded936a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.111447 Sep 05 17:14:07.975642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 759/1536] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:07 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:08.210397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c37e95ca-8ecd-48b8-8b6d-a05154024387 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:08.213785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c37e95ca-8ecd-48b8-8b6d-a05154024387 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:08.221399 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c37e95ca-8ecd-48b8-8b6d-a05154024387 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:08.221876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c37e95ca-8ecd-48b8-8b6d-a05154024387 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:08.222304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c37e95ca-8ecd-48b8-8b6d-a05154024387 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:08.223299 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c37e95ca-8ecd-48b8-8b6d-a05154024387 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:08.223778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c37e95ca-8ecd-48b8-8b6d-a05154024387 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:08.224194 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c37e95ca-8ecd-48b8-8b6d-a05154024387 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:08.254432 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c37e95ca-8ecd-48b8-8b6d-a05154024387 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050973 Sep 05 17:14:08.254965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 778/1537] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:08 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:08.999342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-af6b0bf4-56ca-45bd-8847-d41380c1ab65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:08.999921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-af6b0bf4-56ca-45bd-8847-d41380c1ab65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:09.006904 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af6b0bf4-56ca-45bd-8847-d41380c1ab65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:09.007385 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af6b0bf4-56ca-45bd-8847-d41380c1ab65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:09.007814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af6b0bf4-56ca-45bd-8847-d41380c1ab65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:09.008552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af6b0bf4-56ca-45bd-8847-d41380c1ab65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:09.009004 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af6b0bf4-56ca-45bd-8847-d41380c1ab65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:09.009424 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af6b0bf4-56ca-45bd-8847-d41380c1ab65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:09.076960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-af6b0bf4-56ca-45bd-8847-d41380c1ab65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:09.085056 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-af6b0bf4-56ca-45bd-8847-d41380c1ab65 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089871 Sep 05 17:14:09.085632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 760/1538] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:08 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:09.271983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-106742c9-021a-4ddd-85ed-981b869fcd19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:09.275384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-106742c9-021a-4ddd-85ed-981b869fcd19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:09.286148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-106742c9-021a-4ddd-85ed-981b869fcd19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:09.286929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-106742c9-021a-4ddd-85ed-981b869fcd19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:09.287638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-106742c9-021a-4ddd-85ed-981b869fcd19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:09.288831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-106742c9-021a-4ddd-85ed-981b869fcd19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:09.289570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-106742c9-021a-4ddd-85ed-981b869fcd19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:09.290308 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-106742c9-021a-4ddd-85ed-981b869fcd19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:09.321794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-106742c9-021a-4ddd-85ed-981b869fcd19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056810 Sep 05 17:14:09.322347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 779/1539] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:09 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:10.112700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8e6ef3d8-b230-4fe5-a038-c51e7affbd20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:10.113654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8e6ef3d8-b230-4fe5-a038-c51e7affbd20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:10.124797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e6ef3d8-b230-4fe5-a038-c51e7affbd20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:10.125544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e6ef3d8-b230-4fe5-a038-c51e7affbd20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:10.126250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e6ef3d8-b230-4fe5-a038-c51e7affbd20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:10.127370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e6ef3d8-b230-4fe5-a038-c51e7affbd20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:10.128111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e6ef3d8-b230-4fe5-a038-c51e7affbd20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:10.128846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e6ef3d8-b230-4fe5-a038-c51e7affbd20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:10.201042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8e6ef3d8-b230-4fe5-a038-c51e7affbd20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:10.209082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8e6ef3d8-b230-4fe5-a038-c51e7affbd20 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.103350 Sep 05 17:14:10.209681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 761/1540] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:10 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:10.338718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5427f756-2888-48c8-9cc4-f59b843ce6da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:10.342081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5427f756-2888-48c8-9cc4-f59b843ce6da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:10.349219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5427f756-2888-48c8-9cc4-f59b843ce6da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:10.349691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5427f756-2888-48c8-9cc4-f59b843ce6da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:10.350112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5427f756-2888-48c8-9cc4-f59b843ce6da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:10.350799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5427f756-2888-48c8-9cc4-f59b843ce6da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:10.351235 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5427f756-2888-48c8-9cc4-f59b843ce6da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:10.351655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5427f756-2888-48c8-9cc4-f59b843ce6da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:10.381433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5427f756-2888-48c8-9cc4-f59b843ce6da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049268 Sep 05 17:14:10.381993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 780/1541] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:10 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:11.232310 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-51f1f1fe-4c85-45d6-be30-0d14e9ab27b2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:11.232881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-51f1f1fe-4c85-45d6-be30-0d14e9ab27b2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:11.240263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51f1f1fe-4c85-45d6-be30-0d14e9ab27b2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:11.241094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51f1f1fe-4c85-45d6-be30-0d14e9ab27b2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:11.241571 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51f1f1fe-4c85-45d6-be30-0d14e9ab27b2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:11.242208 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51f1f1fe-4c85-45d6-be30-0d14e9ab27b2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:11.242688 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51f1f1fe-4c85-45d6-be30-0d14e9ab27b2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:11.243092 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51f1f1fe-4c85-45d6-be30-0d14e9ab27b2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:11.246293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-38fd07db-8e54-4292-9ae5-07687aa5de60 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:11.247223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-38fd07db-8e54-4292-9ae5-07687aa5de60 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:11.255829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38fd07db-8e54-4292-9ae5-07687aa5de60 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:11.256495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38fd07db-8e54-4292-9ae5-07687aa5de60 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:11.257085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38fd07db-8e54-4292-9ae5-07687aa5de60 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:11.257946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38fd07db-8e54-4292-9ae5-07687aa5de60 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:11.258478 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38fd07db-8e54-4292-9ae5-07687aa5de60 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:11.259595 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38fd07db-8e54-4292-9ae5-07687aa5de60 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:11.286000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-38fd07db-8e54-4292-9ae5-07687aa5de60 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:14:11.301538 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:14:11.307230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-51f1f1fe-4c85-45d6-be30-0d14e9ab27b2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:11.314987 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-51f1f1fe-4c85-45d6-be30-0d14e9ab27b2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086858 Sep 05 17:14:11.315539 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 762/1542] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:11 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:11.320198 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-feb7f353-83f7-4d06-bf00-8be8e51c7d35 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:11.320693 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-feb7f353-83f7-4d06-bf00-8be8e51c7d35 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:11.326452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-feb7f353-83f7-4d06-bf00-8be8e51c7d35 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:11.327064 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-feb7f353-83f7-4d06-bf00-8be8e51c7d35 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:11.327486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-feb7f353-83f7-4d06-bf00-8be8e51c7d35 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:11.328196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-feb7f353-83f7-4d06-bf00-8be8e51c7d35 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:11.328704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-feb7f353-83f7-4d06-bf00-8be8e51c7d35 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:11.329201 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-feb7f353-83f7-4d06-bf00-8be8e51c7d35 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:11.372993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-38fd07db-8e54-4292-9ae5-07687aa5de60 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 204 len: 0 microversion: 2.1 time: 0.130734 Sep 05 17:14:11.374934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 781/1543] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:14:11 2022] DELETE /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:14:11.383295 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-059604e7-cbd8-407b-87c6-1541a862d461 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:11.384019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-059604e7-cbd8-407b-87c6-1541a862d461 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:11.391056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-059604e7-cbd8-407b-87c6-1541a862d461 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:11.391473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-059604e7-cbd8-407b-87c6-1541a862d461 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:11.391909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-059604e7-cbd8-407b-87c6-1541a862d461 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:11.392633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-059604e7-cbd8-407b-87c6-1541a862d461 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:11.393118 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-059604e7-cbd8-407b-87c6-1541a862d461 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:11.393535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-059604e7-cbd8-407b-87c6-1541a862d461 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:11.540083 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-059604e7-cbd8-407b-87c6-1541a862d461 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:11.548574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-059604e7-cbd8-407b-87c6-1541a862d461 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1681 microversion: 2.1 time: 0.169377 Sep 05 17:14:11.549149 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 782/1544] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:11 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:11.553955 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-92b0f56d-f8c5-4de3-a943-7f17f6552d8a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:11.556184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-92b0f56d-f8c5-4de3-a943-7f17f6552d8a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:11.562528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92b0f56d-f8c5-4de3-a943-7f17f6552d8a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:11.562983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92b0f56d-f8c5-4de3-a943-7f17f6552d8a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:11.563440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92b0f56d-f8c5-4de3-a943-7f17f6552d8a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:11.564128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92b0f56d-f8c5-4de3-a943-7f17f6552d8a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:11.564602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92b0f56d-f8c5-4de3-a943-7f17f6552d8a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:11.565018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92b0f56d-f8c5-4de3-a943-7f17f6552d8a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:11.595422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-92b0f56d-f8c5-4de3-a943-7f17f6552d8a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045274 Sep 05 17:14:11.595976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 783/1545] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:11 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:12.250227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-492b3fc2-c51f-4832-98f9-b1e79cc75110 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:12.250717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-492b3fc2-c51f-4832-98f9-b1e79cc75110 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:12.256976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-492b3fc2-c51f-4832-98f9-b1e79cc75110 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:12.257452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-492b3fc2-c51f-4832-98f9-b1e79cc75110 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:12.257875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-492b3fc2-c51f-4832-98f9-b1e79cc75110 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:12.258555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-492b3fc2-c51f-4832-98f9-b1e79cc75110 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:12.259029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-492b3fc2-c51f-4832-98f9-b1e79cc75110 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:12.259439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-492b3fc2-c51f-4832-98f9-b1e79cc75110 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:12.285711 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-492b3fc2-c51f-4832-98f9-b1e79cc75110 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:14:12.367988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-492b3fc2-c51f-4832-98f9-b1e79cc75110 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "DELETE /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 204 len: 0 microversion: 2.1 time: 0.121427 Sep 05 17:14:12.368891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 784/1546] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:14:12 2022] DELETE /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:14:12.375720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-840f6587-6b30-4cad-bef5-72576ee8c2df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:12.376440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-840f6587-6b30-4cad-bef5-72576ee8c2df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:12.382526 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-840f6587-6b30-4cad-bef5-72576ee8c2df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:12.383182 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-840f6587-6b30-4cad-bef5-72576ee8c2df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:12.383940 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-840f6587-6b30-4cad-bef5-72576ee8c2df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:12.384799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-840f6587-6b30-4cad-bef5-72576ee8c2df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:12.385271 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-840f6587-6b30-4cad-bef5-72576ee8c2df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:12.385697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-840f6587-6b30-4cad-bef5-72576ee8c2df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:12.453750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-840f6587-6b30-4cad-bef5-72576ee8c2df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:12.465601 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-840f6587-6b30-4cad-bef5-72576ee8c2df tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095300 Sep 05 17:14:12.466468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 785/1547] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:12 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:12.471031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-79052aea-2c25-40a6-93ca-8ce50b926992 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:12.471629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-79052aea-2c25-40a6-93ca-8ce50b926992 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:12.477678 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79052aea-2c25-40a6-93ca-8ce50b926992 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:12.478162 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79052aea-2c25-40a6-93ca-8ce50b926992 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:12.478589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79052aea-2c25-40a6-93ca-8ce50b926992 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:12.479268 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79052aea-2c25-40a6-93ca-8ce50b926992 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:12.479719 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79052aea-2c25-40a6-93ca-8ce50b926992 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:12.480136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79052aea-2c25-40a6-93ca-8ce50b926992 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:12.611763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-79052aea-2c25-40a6-93ca-8ce50b926992 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:12.619679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-79052aea-2c25-40a6-93ca-8ce50b926992 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1689 microversion: 2.1 time: 0.152197 Sep 05 17:14:12.620260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 786/1548] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:12 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:12.624995 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-246191e2-c328-47c9-bc82-eb51ba98c33c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:12.625727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-246191e2-c328-47c9-bc82-eb51ba98c33c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:12.631909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-246191e2-c328-47c9-bc82-eb51ba98c33c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:12.632693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-246191e2-c328-47c9-bc82-eb51ba98c33c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:12.633121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-246191e2-c328-47c9-bc82-eb51ba98c33c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:12.633954 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-246191e2-c328-47c9-bc82-eb51ba98c33c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:12.634411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-246191e2-c328-47c9-bc82-eb51ba98c33c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:12.634858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-246191e2-c328-47c9-bc82-eb51ba98c33c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:12.768771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-246191e2-c328-47c9-bc82-eb51ba98c33c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:12.777376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-246191e2-c328-47c9-bc82-eb51ba98c33c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1681 microversion: 2.1 time: 0.155966 Sep 05 17:14:12.778091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 787/1549] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:12 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:12.783656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-728055f4-a431-43d2-a818-9749535350af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:12.786146 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-728055f4-a431-43d2-a818-9749535350af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:12.793365 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-728055f4-a431-43d2-a818-9749535350af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:12.793950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-728055f4-a431-43d2-a818-9749535350af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:12.794496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-728055f4-a431-43d2-a818-9749535350af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:12.795948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-728055f4-a431-43d2-a818-9749535350af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:12.796538 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-728055f4-a431-43d2-a818-9749535350af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:12.797039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-728055f4-a431-43d2-a818-9749535350af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:12.833335 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-728055f4-a431-43d2-a818-9749535350af tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054132 Sep 05 17:14:12.834188 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 788/1550] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:12 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:13.488761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fb90f01e-e644-407f-a3bd-20d0669bbaf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:13.489378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fb90f01e-e644-407f-a3bd-20d0669bbaf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:13.496217 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb90f01e-e644-407f-a3bd-20d0669bbaf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:13.496710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb90f01e-e644-407f-a3bd-20d0669bbaf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:13.497143 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb90f01e-e644-407f-a3bd-20d0669bbaf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:13.497837 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb90f01e-e644-407f-a3bd-20d0669bbaf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:13.498928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb90f01e-e644-407f-a3bd-20d0669bbaf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:13.499090 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb90f01e-e644-407f-a3bd-20d0669bbaf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:13.563367 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fb90f01e-e644-407f-a3bd-20d0669bbaf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:13.571702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fb90f01e-e644-407f-a3bd-20d0669bbaf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086807 Sep 05 17:14:13.572402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 789/1551] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:13 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:14:13.643700 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0a4045d0-da3d-472a-ab69-8dfd506bdea5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:13.644453 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0a4045d0-da3d-472a-ab69-8dfd506bdea5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:13.650804 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a4045d0-da3d-472a-ab69-8dfd506bdea5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:13.651370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a4045d0-da3d-472a-ab69-8dfd506bdea5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:13.651871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a4045d0-da3d-472a-ab69-8dfd506bdea5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:13.652678 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a4045d0-da3d-472a-ab69-8dfd506bdea5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:13.653200 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a4045d0-da3d-472a-ab69-8dfd506bdea5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:13.653690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a4045d0-da3d-472a-ab69-8dfd506bdea5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:13.821823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0a4045d0-da3d-472a-ab69-8dfd506bdea5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:13.831682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0a4045d0-da3d-472a-ab69-8dfd506bdea5 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1689 microversion: 2.1 time: 0.192776 Sep 05 17:14:13.832922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 790/1552] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:13 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:14:13.922032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-da9a7cff-a42f-4238-a5d3-3fbf1171654e req-622f820a-58b1-4c83-b40c-ec711ead38ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e647f8e8-c663-4226-a839-4e44249e4955", "name": "network-vif-deleted", "tag": "d7765d2b-82cd-4366-8f14-f3bcb7d033a7"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:14:13.936018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-da9a7cff-a42f-4238-a5d3-3fbf1171654e req-622f820a-58b1-4c83-b40c-ec711ead38ad service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:13.936803 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-da9a7cff-a42f-4238-a5d3-3fbf1171654e req-622f820a-58b1-4c83-b40c-ec711ead38ad service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:13.937381 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-da9a7cff-a42f-4238-a5d3-3fbf1171654e req-622f820a-58b1-4c83-b40c-ec711ead38ad service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:13.955949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-da9a7cff-a42f-4238-a5d3-3fbf1171654e req-622f820a-58b1-4c83-b40c-ec711ead38ad service nova] Creating event network-vif-deleted:d7765d2b-82cd-4366-8f14-f3bcb7d033a7 for instance e647f8e8-c663-4226-a839-4e44249e4955 on hv-cinder-85596 Sep 05 17:14:13.961279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-da9a7cff-a42f-4238-a5d3-3fbf1171654e req-622f820a-58b1-4c83-b40c-ec711ead38ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127133 Sep 05 17:14:13.963408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 791/1553] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:13.968730 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-572bedde-0d70-404d-9bda-447c9512aa05 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:13.969424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-572bedde-0d70-404d-9bda-447c9512aa05 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:13.976684 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-572bedde-0d70-404d-9bda-447c9512aa05 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:13.977160 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-572bedde-0d70-404d-9bda-447c9512aa05 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:13.977596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-572bedde-0d70-404d-9bda-447c9512aa05 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:13.978330 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-572bedde-0d70-404d-9bda-447c9512aa05 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:13.978786 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-572bedde-0d70-404d-9bda-447c9512aa05 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:13.979194 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-572bedde-0d70-404d-9bda-447c9512aa05 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:14.018875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-572bedde-0d70-404d-9bda-447c9512aa05 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:14.019161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-572bedde-0d70-404d-9bda-447c9512aa05 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:14.019586 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-572bedde-0d70-404d-9bda-447c9512aa05 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:14.020038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-572bedde-0d70-404d-9bda-447c9512aa05 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lazy-loading 'fault' on Instance uuid e647f8e8-c663-4226-a839-4e44249e4955 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:14:14.080606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-572bedde-0d70-404d-9bda-447c9512aa05 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:14.088478 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-572bedde-0d70-404d-9bda-447c9512aa05 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 200 len: 1331 microversion: 2.1 time: 0.123843 Sep 05 17:14:14.092552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 792/1554] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:13 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 1331 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:14.094385 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3f6b9dfa-0f23-4612-9653-5b1a78870813 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:14.096811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3f6b9dfa-0f23-4612-9653-5b1a78870813 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:14.103061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f6b9dfa-0f23-4612-9653-5b1a78870813 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:14.103658 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f6b9dfa-0f23-4612-9653-5b1a78870813 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:14.104212 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f6b9dfa-0f23-4612-9653-5b1a78870813 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:14.105017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f6b9dfa-0f23-4612-9653-5b1a78870813 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:14.105688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f6b9dfa-0f23-4612-9653-5b1a78870813 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:14.106185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f6b9dfa-0f23-4612-9653-5b1a78870813 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:14.140581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3f6b9dfa-0f23-4612-9653-5b1a78870813 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050163 Sep 05 17:14:14.141334 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 793/1555] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:14 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:14.595354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-052b3ee3-cc19-4697-ae41-99b6a26c14f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:14.597217 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-052b3ee3-cc19-4697-ae41-99b6a26c14f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:14.606704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-052b3ee3-cc19-4697-ae41-99b6a26c14f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:14.607891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-052b3ee3-cc19-4697-ae41-99b6a26c14f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:14.609070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-052b3ee3-cc19-4697-ae41-99b6a26c14f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:14.610332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-052b3ee3-cc19-4697-ae41-99b6a26c14f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:14.610983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-052b3ee3-cc19-4697-ae41-99b6a26c14f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:14.611627 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-052b3ee3-cc19-4697-ae41-99b6a26c14f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:14.733419 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-052b3ee3-cc19-4697-ae41-99b6a26c14f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:14.743514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-052b3ee3-cc19-4697-ae41-99b6a26c14f6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.153007 Sep 05 17:14:14.744113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 794/1556] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:14 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:14:14.860501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-34d96898-d59c-4b4c-b800-a99f4ab3caf7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:14.861907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-34d96898-d59c-4b4c-b800-a99f4ab3caf7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:14.873868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34d96898-d59c-4b4c-b800-a99f4ab3caf7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:14.874480 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34d96898-d59c-4b4c-b800-a99f4ab3caf7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:14.874919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34d96898-d59c-4b4c-b800-a99f4ab3caf7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:14.876107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34d96898-d59c-4b4c-b800-a99f4ab3caf7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:14.876107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34d96898-d59c-4b4c-b800-a99f4ab3caf7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:14.878887 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34d96898-d59c-4b4c-b800-a99f4ab3caf7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:14.929671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34d96898-d59c-4b4c-b800-a99f4ab3caf7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:14.930403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34d96898-d59c-4b4c-b800-a99f4ab3caf7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:14.930985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34d96898-d59c-4b4c-b800-a99f4ab3caf7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:14.931597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-34d96898-d59c-4b4c-b800-a99f4ab3caf7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lazy-loading 'fault' on Instance uuid 997db40d-a563-4bec-ae08-02d2d7e0eb5d {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:14:14.935342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:14:14.981987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-34d96898-d59c-4b4c-b800-a99f4ab3caf7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:14.991767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-34d96898-d59c-4b4c-b800-a99f4ab3caf7 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 200 len: 1423 microversion: 2.1 time: 0.136280 Sep 05 17:14:14.992356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 795/1557] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:14 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 1423 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:14:15.120867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-539fa99b-cd5b-4e53-bf81-964dc816a478 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:15.121572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-539fa99b-cd5b-4e53-bf81-964dc816a478 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:15.128780 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-539fa99b-cd5b-4e53-bf81-964dc816a478 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:15.129258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-539fa99b-cd5b-4e53-bf81-964dc816a478 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:15.129710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-539fa99b-cd5b-4e53-bf81-964dc816a478 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:15.130401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-539fa99b-cd5b-4e53-bf81-964dc816a478 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:15.130866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-539fa99b-cd5b-4e53-bf81-964dc816a478 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:15.131261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-539fa99b-cd5b-4e53-bf81-964dc816a478 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:15.156124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-539fa99b-cd5b-4e53-bf81-964dc816a478 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] HTTP exception thrown: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-539fa99b-cd5b-4e53-bf81-964dc816a478 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Request method failure captured: Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 HTTP/1.1 Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFiv_u9Fbkzz4N4EnwLFTHdVgGIHyTWZLVadgHsx5DjzJc71ULzFynHZ-XPxUeQAMj5CK9TClkqesRSKhjnpIv2d__HUGj1wgdznOqyEZDFoYmO3imZ0m9_h8uFe0RLmxeR8bY4quUM556Rumoa232jhk_i2qgcsiqF_5KIfw8vmSWkU Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:14:15.157879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:14:15.159552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6ed4f1f1246408099252ebea491832c"}]}] Sep 05 17:14:15.159552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:14:15.159552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:14:15.159552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:14:15.159552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:14:15.159552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:14:15.159552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:14:15.159552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: 2b81fb00b1b545308d01f74a55b7e77b Sep 05 17:14:15.159552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:14:15.159552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:14:15.159552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. Sep 05 17:14:15.159552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': 'e647f8e8-c663-4226-a839-4e44249e4955'} Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:14:15.160727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. Sep 05 17:14:15.162089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:14:15.163383 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-539fa99b-cd5b-4e53-bf81-964dc816a478 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Returning 404 to user: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:14:15.163383 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-539fa99b-cd5b-4e53-bf81-964dc816a478 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 404 len: 111 microversion: 2.1 time: 0.044199 Sep 05 17:14:15.163383 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 796/1558] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:15 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:14:15.164915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c56e5e35-3752-4b31-928e-f3204c6d630c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:15.167106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c56e5e35-3752-4b31-928e-f3204c6d630c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:15.174202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c56e5e35-3752-4b31-928e-f3204c6d630c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:15.174696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c56e5e35-3752-4b31-928e-f3204c6d630c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:15.175131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c56e5e35-3752-4b31-928e-f3204c6d630c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:15.175837 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c56e5e35-3752-4b31-928e-f3204c6d630c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:15.176331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c56e5e35-3752-4b31-928e-f3204c6d630c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:15.176757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c56e5e35-3752-4b31-928e-f3204c6d630c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:15.209691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c56e5e35-3752-4b31-928e-f3204c6d630c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048432 Sep 05 17:14:15.210265 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 797/1559] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:15 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:15.214867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d2a5559a-142b-4969-9c3b-3d6091ae357c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '.version_select at 0x7f1d3e209ee0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:15.242912 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d2a5559a-142b-4969-9c3b-3d6091ae357c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-668573268" status: 202 len: 0 microversion: 2.1 time: 0.031461 Sep 05 17:14:15.247038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 798/1560] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Sep 5 17:14:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-668573268 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:14:15.771717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-baa49bb3-f7f8-4ec1-a05a-55cd25b88c16 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:15.772488 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-baa49bb3-f7f8-4ec1-a05a-55cd25b88c16 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:15.779638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baa49bb3-f7f8-4ec1-a05a-55cd25b88c16 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:15.780120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baa49bb3-f7f8-4ec1-a05a-55cd25b88c16 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:15.780569 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baa49bb3-f7f8-4ec1-a05a-55cd25b88c16 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:15.781268 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baa49bb3-f7f8-4ec1-a05a-55cd25b88c16 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:15.781735 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baa49bb3-f7f8-4ec1-a05a-55cd25b88c16 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:15.782485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baa49bb3-f7f8-4ec1-a05a-55cd25b88c16 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:15.855147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-baa49bb3-f7f8-4ec1-a05a-55cd25b88c16 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:15.864002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-baa49bb3-f7f8-4ec1-a05a-55cd25b88c16 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.096866 Sep 05 17:14:15.864609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 799/1561] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:15 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:14:15.931391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3eec7aac-0b75-4342-8641-eddd1595b15e tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Action: 'create', calling method: .version_select at 0x7f1d3c1a08b0>, body: {"keypair": {"name": "tempest-keypair-146801640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3BGnAlgqz32b4uHdI1P69sFN5nkw0mM4dPbjpn1wnlLCl1yAvBWRo2+B7r8DLps7IvurhyePBpyAT68CfLyBEo0bsYArpphKgWx22A2uoW93l1DOqHvc/Gmb50lfiuGg=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:14:15.946368 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-3eec7aac-0b75-4342-8641-eddd1595b15e tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Getting quotas for project c6ed4f1f1246408099252ebea491832c. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:14:15.950324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-3eec7aac-0b75-4342-8641-eddd1595b15e tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Getting quotas for user 2b81fb00b1b545308d01f74a55b7e77b and project c6ed4f1f1246408099252ebea491832c. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:14:15.978321 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3eec7aac-0b75-4342-8641-eddd1595b15e tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050718 Sep 05 17:14:15.979361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 800/1562] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Sep 5 17:14:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:14:15.995674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-ad3849e6-fd38-41f7-b235-e171c573cbef req-99503add-342a-4722-addc-27c569213de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "997db40d-a563-4bec-ae08-02d2d7e0eb5d", "name": "network-vif-deleted", "tag": "8d4acf9a-8a3d-41cc-b0dc-29dc4170b535"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:14:16.007391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ad3849e6-fd38-41f7-b235-e171c573cbef req-99503add-342a-4722-addc-27c569213de9 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:16.007934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ad3849e6-fd38-41f7-b235-e171c573cbef req-99503add-342a-4722-addc-27c569213de9 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:16.008397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ad3849e6-fd38-41f7-b235-e171c573cbef req-99503add-342a-4722-addc-27c569213de9 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:16.019636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-ad3849e6-fd38-41f7-b235-e171c573cbef req-99503add-342a-4722-addc-27c569213de9 service nova] Creating event network-vif-deleted:8d4acf9a-8a3d-41cc-b0dc-29dc4170b535 for instance 997db40d-a563-4bec-ae08-02d2d7e0eb5d on hv-cinder-85596 Sep 05 17:14:16.024920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-ad3849e6-fd38-41f7-b235-e171c573cbef req-99503add-342a-4722-addc-27c569213de9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032830 Sep 05 17:14:16.025522 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 801/1563] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:14:16.030739 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c6202cf1-2416-4d9a-8e2a-12df2ba87ce3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:16.031464 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c6202cf1-2416-4d9a-8e2a-12df2ba87ce3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 997db40d-a563-4bec-ae08-02d2d7e0eb5d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:16.037609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6202cf1-2416-4d9a-8e2a-12df2ba87ce3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:16.038096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6202cf1-2416-4d9a-8e2a-12df2ba87ce3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:16.038528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6202cf1-2416-4d9a-8e2a-12df2ba87ce3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:16.039220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6202cf1-2416-4d9a-8e2a-12df2ba87ce3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:16.039673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6202cf1-2416-4d9a-8e2a-12df2ba87ce3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:16.040091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6202cf1-2416-4d9a-8e2a-12df2ba87ce3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:16.053790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-c6202cf1-2416-4d9a-8e2a-12df2ba87ce3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] HTTP exception thrown: Instance 997db40d-a563-4bec-ae08-02d2d7e0eb5d could not be found. Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c6202cf1-2416-4d9a-8e2a-12df2ba87ce3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Request method failure captured: Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d HTTP/1.1 Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFitxdGDptMqKaSDcVcmkRm1t48CriV9c0ccA6Z1f3PBhZ4X3VOBQrmrnSwoQJNXHENpQxOK9N_VWBLXzvYEwxkL7F6ZeCtCe8BAOiO0gzsNLKUjsJwSlh16H3BtCRgZARE5xoQqGlZxRzVVM6Hcrsb1HnEo3UGWPn2hD9AA0yp03J-k Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: cdbd9f06f3484da6a6fd14977b82f384 Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1395654055 Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:14:16.055445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:14:16.057068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cdbd9f06f3484da6a6fd14977b82f384"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cdbd9f06f3484da6a6fd14977b82f384"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cdbd9f06f3484da6a6fd14977b82f384"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cdbd9f06f3484da6a6fd14977b82f384"}]}] Sep 05 17:14:16.057068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1395654055 Sep 05 17:14:16.057068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: cdbd9f06f3484da6a6fd14977b82f384 Sep 05 17:14:16.057068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1395654055 Sep 05 17:14:16.057068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-ServerRescueNegativeTestJSON-1395654055-project Sep 05 17:14:16.057068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:14:16.057068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:14:16.057068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: 06e60909a8b04008af659620527e3236 Sep 05 17:14:16.057068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1395654055-project Sep 05 17:14:16.057068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:14:16.057068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Instance 997db40d-a563-4bec-ae08-02d2d7e0eb5d could not be found. Sep 05 17:14:16.057068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': '997db40d-a563-4bec-ae08-02d2d7e0eb5d'} Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 997db40d-a563-4bec-ae08-02d2d7e0eb5d could not be found. Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:14:16.057892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 997db40d-a563-4bec-ae08-02d2d7e0eb5d could not be found. Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 997db40d-a563-4bec-ae08-02d2d7e0eb5d could not be found. Sep 05 17:14:16.059148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:14:16.060342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c6202cf1-2416-4d9a-8e2a-12df2ba87ce3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Returning 404 to user: Instance 997db40d-a563-4bec-ae08-02d2d7e0eb5d could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:14:16.060342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c6202cf1-2416-4d9a-8e2a-12df2ba87ce3 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d" status: 404 len: 111 microversion: 2.1 time: 0.030255 Sep 05 17:14:16.060342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 802/1564] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:16 2022] GET /compute/v2.1/servers/997db40d-a563-4bec-ae08-02d2d7e0eb5d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:14:16.065762 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-49c59de3-ad4c-4794-8465-c42d83420874 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '.version_select at 0x7f1d3ad4a3a0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:16.086686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-49c59de3-ad4c-4794-8465-c42d83420874 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1546866633" status: 202 len: 0 microversion: 2.1 time: 0.024607 Sep 05 17:14:16.087273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 803/1565] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Sep 5 17:14:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1546866633 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 05 17:14:16.223809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-648d7e17-04c7-43cd-b75e-b500a6ad12dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:16.226012 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-648d7e17-04c7-43cd-b75e-b500a6ad12dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:16.233432 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-648d7e17-04c7-43cd-b75e-b500a6ad12dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:16.234165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-648d7e17-04c7-43cd-b75e-b500a6ad12dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:16.234604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-648d7e17-04c7-43cd-b75e-b500a6ad12dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:16.235309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-648d7e17-04c7-43cd-b75e-b500a6ad12dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:16.236417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-648d7e17-04c7-43cd-b75e-b500a6ad12dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:16.237011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-648d7e17-04c7-43cd-b75e-b500a6ad12dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:16.278008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-648d7e17-04c7-43cd-b75e-b500a6ad12dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058675 Sep 05 17:14:16.281004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 804/1566] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:16 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:14:16.889077 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4a4665d3-8966-49bf-9145-e6af368be940 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:16.889833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4a4665d3-8966-49bf-9145-e6af368be940 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:16.896433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a4665d3-8966-49bf-9145-e6af368be940 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:16.897141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a4665d3-8966-49bf-9145-e6af368be940 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:16.897648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a4665d3-8966-49bf-9145-e6af368be940 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:16.898413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a4665d3-8966-49bf-9145-e6af368be940 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:16.898870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a4665d3-8966-49bf-9145-e6af368be940 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:16.899291 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a4665d3-8966-49bf-9145-e6af368be940 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:16.961849 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4a4665d3-8966-49bf-9145-e6af368be940 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:16.970127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4a4665d3-8966-49bf-9145-e6af368be940 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086095 Sep 05 17:14:16.970696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 805/1567] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:16 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:14:17.290671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-51d8b368-32db-4803-b3ec-d358fb424e83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:17.292861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-51d8b368-32db-4803-b3ec-d358fb424e83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:17.299551 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51d8b368-32db-4803-b3ec-d358fb424e83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:17.300473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51d8b368-32db-4803-b3ec-d358fb424e83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:17.301035 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51d8b368-32db-4803-b3ec-d358fb424e83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:17.301823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51d8b368-32db-4803-b3ec-d358fb424e83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:17.302359 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51d8b368-32db-4803-b3ec-d358fb424e83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:17.302843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51d8b368-32db-4803-b3ec-d358fb424e83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:17.333420 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-51d8b368-32db-4803-b3ec-d358fb424e83 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047205 Sep 05 17:14:17.333970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 806/1568] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:17 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:17.338891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1294056471", "imageRef": "c1a4f3d3-4d68-489a-a57b-bae7854beb29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d0f5cb4-668d-4cba-a489-7255c177e6e4"}], "security_groups": [{"name": "tempest-securitygroup--495532794"}], "key_name": "tempest-keypair-146801640", "user_data": "}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:14:17.452968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] validate_networks() for [('8d0f5cb4-668d-4cba-a489-7255c177e6e4', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:14:17.903542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:14:17.904292 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:14:17.904536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:14:17.904936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:14:17.905343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:14:17.907397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:14:17.916416 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:17.916890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:17.917310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:17.918025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:17.918470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:17.918884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:17.938196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Getting quotas for project c6ed4f1f1246408099252ebea491832c. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:14:17.942068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Getting quotas for user 2b81fb00b1b545308d01f74a55b7e77b and project c6ed4f1f1246408099252ebea491832c. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:14:17.952822 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:14:17.955141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a4f3d3-4d68-489a-a57b-bae7854beb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:14:18.008568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-69aeea09-9e40-4442-adb7-10a5921c71b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.673248 Sep 05 17:14:18.009524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 807/1569] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:14:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 17:14:18.014148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2893f399-021b-413b-b649-cb5e7baa3333 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:18.014776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2893f399-021b-413b-b649-cb5e7baa3333 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:18.024693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2893f399-021b-413b-b649-cb5e7baa3333 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:18.025475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2893f399-021b-413b-b649-cb5e7baa3333 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:18.026182 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2893f399-021b-413b-b649-cb5e7baa3333 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:18.027568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2893f399-021b-413b-b649-cb5e7baa3333 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:18.027833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2893f399-021b-413b-b649-cb5e7baa3333 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:18.028354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2893f399-021b-413b-b649-cb5e7baa3333 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:18.091617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2893f399-021b-413b-b649-cb5e7baa3333 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:18.100301 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2893f399-021b-413b-b649-cb5e7baa3333 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089670 Sep 05 17:14:18.100946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 808/1570] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:18 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:18.105418 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-de2737fb-db26-4e3f-82d5-0fac7f2f521a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:18.106023 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-de2737fb-db26-4e3f-82d5-0fac7f2f521a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:18.159535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-de2737fb-db26-4e3f-82d5-0fac7f2f521a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:18.166691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-de2737fb-db26-4e3f-82d5-0fac7f2f521a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 200 len: 1241 microversion: 2.1 time: 0.064797 Sep 05 17:14:18.167279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 809/1571] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:18 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:18.345913 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-74918762-bb28-44a0-8822-227117a27b33 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:18.348582 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-74918762-bb28-44a0-8822-227117a27b33 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:18.355061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-74918762-bb28-44a0-8822-227117a27b33 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:18.355773 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-74918762-bb28-44a0-8822-227117a27b33 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:18.356259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-74918762-bb28-44a0-8822-227117a27b33 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:18.356942 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-74918762-bb28-44a0-8822-227117a27b33 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:18.357407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-74918762-bb28-44a0-8822-227117a27b33 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:18.358022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-74918762-bb28-44a0-8822-227117a27b33 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:18.394096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-74918762-bb28-44a0-8822-227117a27b33 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052285 Sep 05 17:14:18.395222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 810/1572] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:18 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:19.125922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0bd743d1-4877-419a-b3b0-b5771ab65491 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:19.126882 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0bd743d1-4877-419a-b3b0-b5771ab65491 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:19.136207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bd743d1-4877-419a-b3b0-b5771ab65491 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:19.136964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bd743d1-4877-419a-b3b0-b5771ab65491 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:19.137586 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bd743d1-4877-419a-b3b0-b5771ab65491 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:19.138580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bd743d1-4877-419a-b3b0-b5771ab65491 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:19.139391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bd743d1-4877-419a-b3b0-b5771ab65491 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:19.139979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bd743d1-4877-419a-b3b0-b5771ab65491 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:19.211745 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0bd743d1-4877-419a-b3b0-b5771ab65491 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:19.219774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0bd743d1-4877-419a-b3b0-b5771ab65491 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.099767 Sep 05 17:14:19.220369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 811/1573] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:19 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:19.225074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fe43fc94-b26b-4ecd-a321-b51e09dd271b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:19.225706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fe43fc94-b26b-4ecd-a321-b51e09dd271b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:19.231335 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe43fc94-b26b-4ecd-a321-b51e09dd271b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:19.231809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe43fc94-b26b-4ecd-a321-b51e09dd271b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:19.232270 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe43fc94-b26b-4ecd-a321-b51e09dd271b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:19.232948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe43fc94-b26b-4ecd-a321-b51e09dd271b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:19.233403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe43fc94-b26b-4ecd-a321-b51e09dd271b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:19.233819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe43fc94-b26b-4ecd-a321-b51e09dd271b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:19.305660 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fe43fc94-b26b-4ecd-a321-b51e09dd271b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:19.314028 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fe43fc94-b26b-4ecd-a321-b51e09dd271b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 200 len: 1293 microversion: 2.1 time: 0.092706 Sep 05 17:14:19.314628 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 812/1574] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:19 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:19.410826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-51b239b9-5890-49de-8698-7a05c06cb538 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:19.412983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-51b239b9-5890-49de-8698-7a05c06cb538 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:19.419074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51b239b9-5890-49de-8698-7a05c06cb538 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:19.419547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51b239b9-5890-49de-8698-7a05c06cb538 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:19.420138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51b239b9-5890-49de-8698-7a05c06cb538 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:19.420915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51b239b9-5890-49de-8698-7a05c06cb538 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:19.421359 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51b239b9-5890-49de-8698-7a05c06cb538 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:19.421773 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51b239b9-5890-49de-8698-7a05c06cb538 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:19.454079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-51b239b9-5890-49de-8698-7a05c06cb538 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047114 Sep 05 17:14:19.454686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 813/1575] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:19 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:20.243197 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7fa7bf01-1a77-4c74-a6c4-abff56747c23 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:20.244199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7fa7bf01-1a77-4c74-a6c4-abff56747c23 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:20.251413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fa7bf01-1a77-4c74-a6c4-abff56747c23 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:20.252234 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fa7bf01-1a77-4c74-a6c4-abff56747c23 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:20.252945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fa7bf01-1a77-4c74-a6c4-abff56747c23 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:20.253797 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fa7bf01-1a77-4c74-a6c4-abff56747c23 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:20.254407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fa7bf01-1a77-4c74-a6c4-abff56747c23 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:20.254919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fa7bf01-1a77-4c74-a6c4-abff56747c23 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:20.328697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7fa7bf01-1a77-4c74-a6c4-abff56747c23 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:20.337556 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7fa7bf01-1a77-4c74-a6c4-abff56747c23 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098605 Sep 05 17:14:20.338380 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 814/1576] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:20 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:20.344539 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-18ff72ff-e781-4baa-826b-9e0330026233 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:20.345345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-18ff72ff-e781-4baa-826b-9e0330026233 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:20.353390 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18ff72ff-e781-4baa-826b-9e0330026233 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:20.353876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18ff72ff-e781-4baa-826b-9e0330026233 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:20.354456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18ff72ff-e781-4baa-826b-9e0330026233 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:20.355161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18ff72ff-e781-4baa-826b-9e0330026233 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:20.355780 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18ff72ff-e781-4baa-826b-9e0330026233 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:20.356222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18ff72ff-e781-4baa-826b-9e0330026233 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:20.492456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-18ff72ff-e781-4baa-826b-9e0330026233 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:20.502034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-18ff72ff-e781-4baa-826b-9e0330026233 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 200 len: 1366 microversion: 2.1 time: 0.162345 Sep 05 17:14:20.502621 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 815/1577] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:20 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:20.507548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-16e2d708-1239-442f-85bf-455abe18e241 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:20.509756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-16e2d708-1239-442f-85bf-455abe18e241 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:20.516319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16e2d708-1239-442f-85bf-455abe18e241 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:20.516815 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16e2d708-1239-442f-85bf-455abe18e241 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:20.517247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16e2d708-1239-442f-85bf-455abe18e241 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:20.517959 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16e2d708-1239-442f-85bf-455abe18e241 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:20.518408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16e2d708-1239-442f-85bf-455abe18e241 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:20.518831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16e2d708-1239-442f-85bf-455abe18e241 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:20.548491 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-16e2d708-1239-442f-85bf-455abe18e241 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Sep 05 17:14:20.549076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 816/1578] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:20 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:20.933166 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-2a64c7aa-1ff4-472e-9756-ed73cc4a4089 req-393e416e-f2c1-4472-b949-303c4e982f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c69901d5-72a5-4e1d-af30-b7c680f90b73", "tag": "01c8109f-3864-4fe7-aab8-f7e9f1ac508b"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:14:20.951562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-2a64c7aa-1ff4-472e-9756-ed73cc4a4089 req-393e416e-f2c1-4472-b949-303c4e982f25 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:20.952824 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-2a64c7aa-1ff4-472e-9756-ed73cc4a4089 req-393e416e-f2c1-4472-b949-303c4e982f25 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:20.953279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-2a64c7aa-1ff4-472e-9756-ed73cc4a4089 req-393e416e-f2c1-4472-b949-303c4e982f25 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:20.964613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-2a64c7aa-1ff4-472e-9756-ed73cc4a4089 req-393e416e-f2c1-4472-b949-303c4e982f25 service nova] Creating event network-changed:01c8109f-3864-4fe7-aab8-f7e9f1ac508b for instance c69901d5-72a5-4e1d-af30-b7c680f90b73 on hv-cinder-85596 Sep 05 17:14:20.969866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-2a64c7aa-1ff4-472e-9756-ed73cc4a4089 req-393e416e-f2c1-4472-b949-303c4e982f25 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040515 Sep 05 17:14:20.970845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 817/1579] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:21.324100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=11 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:14:21.349222 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=78 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:14:21.362508 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fb7ae53f-f59a-41a2-8f45-d63f9e679b78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:21.363215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fb7ae53f-f59a-41a2-8f45-d63f9e679b78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:21.370238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb7ae53f-f59a-41a2-8f45-d63f9e679b78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:21.370958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb7ae53f-f59a-41a2-8f45-d63f9e679b78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:21.371616 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb7ae53f-f59a-41a2-8f45-d63f9e679b78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:21.372331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb7ae53f-f59a-41a2-8f45-d63f9e679b78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:21.372989 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb7ae53f-f59a-41a2-8f45-d63f9e679b78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:21.373695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb7ae53f-f59a-41a2-8f45-d63f9e679b78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:21.440809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fb7ae53f-f59a-41a2-8f45-d63f9e679b78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:21.449016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fb7ae53f-f59a-41a2-8f45-d63f9e679b78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091645 Sep 05 17:14:21.449590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 818/1580] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:21 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:21.528734 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8fa7b18d-7c0b-4064-9167-d3555ea148b5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:21.529540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8fa7b18d-7c0b-4064-9167-d3555ea148b5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:21.536300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fa7b18d-7c0b-4064-9167-d3555ea148b5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:21.536782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fa7b18d-7c0b-4064-9167-d3555ea148b5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:21.537206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fa7b18d-7c0b-4064-9167-d3555ea148b5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:21.537935 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fa7b18d-7c0b-4064-9167-d3555ea148b5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:21.538402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fa7b18d-7c0b-4064-9167-d3555ea148b5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:21.538812 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fa7b18d-7c0b-4064-9167-d3555ea148b5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:21.553831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:14:21.678198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8fa7b18d-7c0b-4064-9167-d3555ea148b5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:21.686504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8fa7b18d-7c0b-4064-9167-d3555ea148b5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 200 len: 1366 microversion: 2.1 time: 0.164234 Sep 05 17:14:21.687074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 819/1581] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:21 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:21.691601 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bd43b933-1a89-43e7-9707-02ffbb15fd4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:21.693932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bd43b933-1a89-43e7-9707-02ffbb15fd4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:21.699748 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd43b933-1a89-43e7-9707-02ffbb15fd4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:21.700251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd43b933-1a89-43e7-9707-02ffbb15fd4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:21.700677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd43b933-1a89-43e7-9707-02ffbb15fd4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:21.701384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd43b933-1a89-43e7-9707-02ffbb15fd4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:21.701922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd43b933-1a89-43e7-9707-02ffbb15fd4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:21.702344 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd43b933-1a89-43e7-9707-02ffbb15fd4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:21.733944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bd43b933-1a89-43e7-9707-02ffbb15fd4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045715 Sep 05 17:14:21.734515 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 820/1582] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:21 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:22.476085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-21435ade-8e54-45c9-8221-ac8ccd8fb101 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:22.477212 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-21435ade-8e54-45c9-8221-ac8ccd8fb101 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:22.488219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21435ade-8e54-45c9-8221-ac8ccd8fb101 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:22.489046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21435ade-8e54-45c9-8221-ac8ccd8fb101 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:22.489756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21435ade-8e54-45c9-8221-ac8ccd8fb101 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:22.490890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21435ade-8e54-45c9-8221-ac8ccd8fb101 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:22.491640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21435ade-8e54-45c9-8221-ac8ccd8fb101 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:22.492386 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21435ade-8e54-45c9-8221-ac8ccd8fb101 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:22.556863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-21435ade-8e54-45c9-8221-ac8ccd8fb101 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:22.565132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-21435ade-8e54-45c9-8221-ac8ccd8fb101 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.096115 Sep 05 17:14:22.565696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 821/1583] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:22 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:22.711794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f2602078-8f91-4caa-99e7-f7df88bde087 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:22.712509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f2602078-8f91-4caa-99e7-f7df88bde087 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:22.721677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2602078-8f91-4caa-99e7-f7df88bde087 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:22.722346 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2602078-8f91-4caa-99e7-f7df88bde087 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:22.723275 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2602078-8f91-4caa-99e7-f7df88bde087 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:22.724331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2602078-8f91-4caa-99e7-f7df88bde087 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:22.724992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2602078-8f91-4caa-99e7-f7df88bde087 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:22.725619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2602078-8f91-4caa-99e7-f7df88bde087 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:22.875710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f2602078-8f91-4caa-99e7-f7df88bde087 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:22.887925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f2602078-8f91-4caa-99e7-f7df88bde087 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 200 len: 1366 microversion: 2.1 time: 0.181897 Sep 05 17:14:22.888823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 822/1584] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:22 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:22.893763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c2f30da4-ea1d-490a-8a4c-03f2ea4f2be9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:22.895914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c2f30da4-ea1d-490a-8a4c-03f2ea4f2be9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:22.901921 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2f30da4-ea1d-490a-8a4c-03f2ea4f2be9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:22.902404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2f30da4-ea1d-490a-8a4c-03f2ea4f2be9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:22.902837 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2f30da4-ea1d-490a-8a4c-03f2ea4f2be9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:22.903526 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2f30da4-ea1d-490a-8a4c-03f2ea4f2be9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:22.903976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2f30da4-ea1d-490a-8a4c-03f2ea4f2be9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:22.904438 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2f30da4-ea1d-490a-8a4c-03f2ea4f2be9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:22.934692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c2f30da4-ea1d-490a-8a4c-03f2ea4f2be9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044729 Sep 05 17:14:22.935258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 823/1585] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:22 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:23.587176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2400fc2f-757a-4869-8e60-0d0e27517477 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:23.587818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2400fc2f-757a-4869-8e60-0d0e27517477 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:23.595038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2400fc2f-757a-4869-8e60-0d0e27517477 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:23.595514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2400fc2f-757a-4869-8e60-0d0e27517477 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:23.595940 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2400fc2f-757a-4869-8e60-0d0e27517477 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:23.596666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2400fc2f-757a-4869-8e60-0d0e27517477 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:23.597112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2400fc2f-757a-4869-8e60-0d0e27517477 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:23.597527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2400fc2f-757a-4869-8e60-0d0e27517477 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:23.658440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2400fc2f-757a-4869-8e60-0d0e27517477 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:23.667022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2400fc2f-757a-4869-8e60-0d0e27517477 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.083805 Sep 05 17:14:23.667618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 824/1586] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:23 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:23.911255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4b592172-7158-48d2-8525-80a71eb8bf7f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:23.911861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4b592172-7158-48d2-8525-80a71eb8bf7f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:23.917990 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b592172-7158-48d2-8525-80a71eb8bf7f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:23.918496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b592172-7158-48d2-8525-80a71eb8bf7f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:23.918923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b592172-7158-48d2-8525-80a71eb8bf7f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:23.919609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b592172-7158-48d2-8525-80a71eb8bf7f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:23.920053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b592172-7158-48d2-8525-80a71eb8bf7f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:23.920494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b592172-7158-48d2-8525-80a71eb8bf7f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:24.055961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4b592172-7158-48d2-8525-80a71eb8bf7f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:24.064496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4b592172-7158-48d2-8525-80a71eb8bf7f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 200 len: 1366 microversion: 2.1 time: 0.157069 Sep 05 17:14:24.064993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 825/1587] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:23 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:24.069602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1e42c169-9109-427a-9d2e-38034b1bdc5b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:24.071777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1e42c169-9109-427a-9d2e-38034b1bdc5b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:24.078133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e42c169-9109-427a-9d2e-38034b1bdc5b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:24.078706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e42c169-9109-427a-9d2e-38034b1bdc5b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:24.079099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e42c169-9109-427a-9d2e-38034b1bdc5b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:24.079805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e42c169-9109-427a-9d2e-38034b1bdc5b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:24.080272 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e42c169-9109-427a-9d2e-38034b1bdc5b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:24.080685 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e42c169-9109-427a-9d2e-38034b1bdc5b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:24.115184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1e42c169-9109-427a-9d2e-38034b1bdc5b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049132 Sep 05 17:14:24.115805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 826/1588] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:24 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:24.691713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5c53d4e5-cdfc-4931-9942-b0e8504613d8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:24.692431 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5c53d4e5-cdfc-4931-9942-b0e8504613d8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:24.699151 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c53d4e5-cdfc-4931-9942-b0e8504613d8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:24.699634 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c53d4e5-cdfc-4931-9942-b0e8504613d8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:24.700057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c53d4e5-cdfc-4931-9942-b0e8504613d8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:24.700800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c53d4e5-cdfc-4931-9942-b0e8504613d8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:24.701246 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c53d4e5-cdfc-4931-9942-b0e8504613d8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:24.701683 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c53d4e5-cdfc-4931-9942-b0e8504613d8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:24.775187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5c53d4e5-cdfc-4931-9942-b0e8504613d8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:24.785558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5c53d4e5-cdfc-4931-9942-b0e8504613d8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.097931 Sep 05 17:14:24.786140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 827/1589] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:24 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:25.091134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3ff189cc-f8d1-4652-a7f8-2baa253702d0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:25.092134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3ff189cc-f8d1-4652-a7f8-2baa253702d0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:25.103037 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ff189cc-f8d1-4652-a7f8-2baa253702d0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:25.103838 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ff189cc-f8d1-4652-a7f8-2baa253702d0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:25.104615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ff189cc-f8d1-4652-a7f8-2baa253702d0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:25.105750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ff189cc-f8d1-4652-a7f8-2baa253702d0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:25.106501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ff189cc-f8d1-4652-a7f8-2baa253702d0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:25.107204 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ff189cc-f8d1-4652-a7f8-2baa253702d0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:25.253772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3ff189cc-f8d1-4652-a7f8-2baa253702d0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:25.261611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3ff189cc-f8d1-4652-a7f8-2baa253702d0 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 200 len: 1366 microversion: 2.1 time: 0.177105 Sep 05 17:14:25.262216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 828/1590] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:25 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:25.266873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a8e1556c-8686-47ae-979c-1e309455d8e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:25.269243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a8e1556c-8686-47ae-979c-1e309455d8e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:25.275158 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e1556c-8686-47ae-979c-1e309455d8e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:25.275631 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e1556c-8686-47ae-979c-1e309455d8e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:25.276054 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e1556c-8686-47ae-979c-1e309455d8e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:25.276769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e1556c-8686-47ae-979c-1e309455d8e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:25.277207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e1556c-8686-47ae-979c-1e309455d8e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:25.277617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e1556c-8686-47ae-979c-1e309455d8e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:25.306679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a8e1556c-8686-47ae-979c-1e309455d8e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043279 Sep 05 17:14:25.307243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 829/1591] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:25 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:25.817716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-6ee6ee6b-53b9-41fa-a8d8-c0eb607c6a43 req-f543ab63-4ab3-4744-b391-4bcba044be57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c69901d5-72a5-4e1d-af30-b7c680f90b73", "name": "network-vif-plugged", "status": "completed", "tag": "01c8109f-3864-4fe7-aab8-f7e9f1ac508b"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:14:25.827620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-6ee6ee6b-53b9-41fa-a8d8-c0eb607c6a43 req-f543ab63-4ab3-4744-b391-4bcba044be57 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:25.828068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-6ee6ee6b-53b9-41fa-a8d8-c0eb607c6a43 req-f543ab63-4ab3-4744-b391-4bcba044be57 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:25.828525 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-6ee6ee6b-53b9-41fa-a8d8-c0eb607c6a43 req-f543ab63-4ab3-4744-b391-4bcba044be57 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:25.840586 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-6ee6ee6b-53b9-41fa-a8d8-c0eb607c6a43 req-f543ab63-4ab3-4744-b391-4bcba044be57 service nova] Creating event network-vif-plugged:01c8109f-3864-4fe7-aab8-f7e9f1ac508b for instance c69901d5-72a5-4e1d-af30-b7c680f90b73 on hv-cinder-85596 Sep 05 17:14:25.845945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-6ee6ee6b-53b9-41fa-a8d8-c0eb607c6a43 req-f543ab63-4ab3-4744-b391-4bcba044be57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105304 Sep 05 17:14:25.846647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 830/1592] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:25.851928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-abd6e308-c94e-4be8-9ab5-8a8c800912ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:25.852648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-abd6e308-c94e-4be8-9ab5-8a8c800912ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:25.859223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abd6e308-c94e-4be8-9ab5-8a8c800912ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:25.859723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abd6e308-c94e-4be8-9ab5-8a8c800912ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:25.860141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abd6e308-c94e-4be8-9ab5-8a8c800912ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:25.860857 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abd6e308-c94e-4be8-9ab5-8a8c800912ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:25.861334 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abd6e308-c94e-4be8-9ab5-8a8c800912ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:25.861748 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abd6e308-c94e-4be8-9ab5-8a8c800912ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:25.929556 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-abd6e308-c94e-4be8-9ab5-8a8c800912ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:25.937636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-abd6e308-c94e-4be8-9ab5-8a8c800912ec tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.089908 Sep 05 17:14:25.938206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 831/1593] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:25 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:26.289128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-33dfaf46-65be-45fb-b1f6-62ec95451782 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:26.290133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-33dfaf46-65be-45fb-b1f6-62ec95451782 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:26.300625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33dfaf46-65be-45fb-b1f6-62ec95451782 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:26.301455 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33dfaf46-65be-45fb-b1f6-62ec95451782 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:26.302119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33dfaf46-65be-45fb-b1f6-62ec95451782 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:26.303246 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33dfaf46-65be-45fb-b1f6-62ec95451782 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:26.303982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33dfaf46-65be-45fb-b1f6-62ec95451782 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:26.304758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33dfaf46-65be-45fb-b1f6-62ec95451782 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:26.450977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-33dfaf46-65be-45fb-b1f6-62ec95451782 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:26.459508 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-33dfaf46-65be-45fb-b1f6-62ec95451782 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 200 len: 1366 microversion: 2.1 time: 0.177098 Sep 05 17:14:26.460045 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 832/1594] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:26 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:26.464756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e1536f2d-8d7a-4bdf-b308-776a7df29a79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:26.466977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e1536f2d-8d7a-4bdf-b308-776a7df29a79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:26.473305 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1536f2d-8d7a-4bdf-b308-776a7df29a79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:26.473778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1536f2d-8d7a-4bdf-b308-776a7df29a79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:26.474202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1536f2d-8d7a-4bdf-b308-776a7df29a79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:26.474881 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1536f2d-8d7a-4bdf-b308-776a7df29a79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:26.475321 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1536f2d-8d7a-4bdf-b308-776a7df29a79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:26.475752 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1536f2d-8d7a-4bdf-b308-776a7df29a79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:26.507934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e1536f2d-8d7a-4bdf-b308-776a7df29a79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046683 Sep 05 17:14:26.508600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 833/1595] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:26 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:26.965428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6ef97116-b333-410e-80be-cb7b758a7e72 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:26.966676 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6ef97116-b333-410e-80be-cb7b758a7e72 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:26.974734 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ef97116-b333-410e-80be-cb7b758a7e72 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:26.975221 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ef97116-b333-410e-80be-cb7b758a7e72 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:26.975645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ef97116-b333-410e-80be-cb7b758a7e72 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:26.976377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ef97116-b333-410e-80be-cb7b758a7e72 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:26.976826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ef97116-b333-410e-80be-cb7b758a7e72 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:26.977246 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ef97116-b333-410e-80be-cb7b758a7e72 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:27.046293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6ef97116-b333-410e-80be-cb7b758a7e72 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:27.054562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6ef97116-b333-410e-80be-cb7b758a7e72 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095727 Sep 05 17:14:27.055134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 834/1596] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:26 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:27.486714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-02049738-17d2-4844-94fd-a45ef58d38f4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:27.487646 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-02049738-17d2-4844-94fd-a45ef58d38f4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:27.497100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02049738-17d2-4844-94fd-a45ef58d38f4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:27.497839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02049738-17d2-4844-94fd-a45ef58d38f4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:27.498495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02049738-17d2-4844-94fd-a45ef58d38f4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:27.499403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02049738-17d2-4844-94fd-a45ef58d38f4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:27.499851 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02049738-17d2-4844-94fd-a45ef58d38f4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:27.500318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02049738-17d2-4844-94fd-a45ef58d38f4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:27.636539 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-02049738-17d2-4844-94fd-a45ef58d38f4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:27.646656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-02049738-17d2-4844-94fd-a45ef58d38f4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 200 len: 1366 microversion: 2.1 time: 0.165951 Sep 05 17:14:27.647590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 835/1597] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:27 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:27.652588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-118b24db-5a0c-4cc2-9ab6-240ef4aeeb2a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:27.654766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-118b24db-5a0c-4cc2-9ab6-240ef4aeeb2a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:27.661268 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-118b24db-5a0c-4cc2-9ab6-240ef4aeeb2a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:27.661752 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-118b24db-5a0c-4cc2-9ab6-240ef4aeeb2a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:27.662185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-118b24db-5a0c-4cc2-9ab6-240ef4aeeb2a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:27.662866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-118b24db-5a0c-4cc2-9ab6-240ef4aeeb2a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:27.663316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-118b24db-5a0c-4cc2-9ab6-240ef4aeeb2a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:27.663736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-118b24db-5a0c-4cc2-9ab6-240ef4aeeb2a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:27.688490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:14:27.695306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-118b24db-5a0c-4cc2-9ab6-240ef4aeeb2a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046678 Sep 05 17:14:27.695861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 836/1598] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:27 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:28.074548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:14:28.081028 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ae47be25-7dff-462e-a8bd-bf7ba7aa671a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:28.081633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ae47be25-7dff-462e-a8bd-bf7ba7aa671a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:28.087947 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae47be25-7dff-462e-a8bd-bf7ba7aa671a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:28.088439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae47be25-7dff-462e-a8bd-bf7ba7aa671a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:28.088910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae47be25-7dff-462e-a8bd-bf7ba7aa671a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:28.089587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae47be25-7dff-462e-a8bd-bf7ba7aa671a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:28.090023 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae47be25-7dff-462e-a8bd-bf7ba7aa671a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:28.090433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae47be25-7dff-462e-a8bd-bf7ba7aa671a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:28.152177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ae47be25-7dff-462e-a8bd-bf7ba7aa671a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:28.160180 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ae47be25-7dff-462e-a8bd-bf7ba7aa671a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086819 Sep 05 17:14:28.160791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 837/1599] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:28 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:28.675031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7ed57788-cc42-458c-b8c6-66fa8ec02b6a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:28.675684 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7ed57788-cc42-458c-b8c6-66fa8ec02b6a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:28.677897 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=12 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:14:28.684404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ed57788-cc42-458c-b8c6-66fa8ec02b6a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:28.684977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ed57788-cc42-458c-b8c6-66fa8ec02b6a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:28.685488 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ed57788-cc42-458c-b8c6-66fa8ec02b6a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:28.686317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ed57788-cc42-458c-b8c6-66fa8ec02b6a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:28.687215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ed57788-cc42-458c-b8c6-66fa8ec02b6a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:28.687837 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ed57788-cc42-458c-b8c6-66fa8ec02b6a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:29.051309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7ed57788-cc42-458c-b8c6-66fa8ec02b6a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:29.059076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7ed57788-cc42-458c-b8c6-66fa8ec02b6a tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 200 len: 1557 microversion: 2.1 time: 0.389841 Sep 05 17:14:29.059642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 838/1600] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:28 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 1557 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:29.064342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f2e397d9-06dd-4f3e-864a-e0e5265e93b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:29.066487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f2e397d9-06dd-4f3e-864a-e0e5265e93b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:29.072637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2e397d9-06dd-4f3e-864a-e0e5265e93b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:29.073138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2e397d9-06dd-4f3e-864a-e0e5265e93b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:29.073566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2e397d9-06dd-4f3e-864a-e0e5265e93b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:29.074248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2e397d9-06dd-4f3e-864a-e0e5265e93b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:29.074691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2e397d9-06dd-4f3e-864a-e0e5265e93b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:29.075332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2e397d9-06dd-4f3e-864a-e0e5265e93b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:29.105398 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f2e397d9-06dd-4f3e-864a-e0e5265e93b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044691 Sep 05 17:14:29.105953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 839/1601] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:29 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:29.110574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1b3e7859-405b-4e3e-bba8-c18320377c4d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:29.111072 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1b3e7859-405b-4e3e-bba8-c18320377c4d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:29.116771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b3e7859-405b-4e3e-bba8-c18320377c4d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:29.117261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b3e7859-405b-4e3e-bba8-c18320377c4d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:29.117723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b3e7859-405b-4e3e-bba8-c18320377c4d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:29.118424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b3e7859-405b-4e3e-bba8-c18320377c4d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:29.118875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b3e7859-405b-4e3e-bba8-c18320377c4d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:29.119296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b3e7859-405b-4e3e-bba8-c18320377c4d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:29.203778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1b3e7859-405b-4e3e-bba8-c18320377c4d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096492 Sep 05 17:14:29.204564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 840/1602] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Sep 5 17:14:29 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:29.276760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-14b0a622-542e-4f09-8b54-7a89332f8a4e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:29.277485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-14b0a622-542e-4f09-8b54-7a89332f8a4e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:29.283722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14b0a622-542e-4f09-8b54-7a89332f8a4e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:29.284324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14b0a622-542e-4f09-8b54-7a89332f8a4e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:29.284848 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14b0a622-542e-4f09-8b54-7a89332f8a4e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:29.285600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14b0a622-542e-4f09-8b54-7a89332f8a4e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:29.286112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14b0a622-542e-4f09-8b54-7a89332f8a4e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:29.286625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14b0a622-542e-4f09-8b54-7a89332f8a4e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:29.380472 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-14b0a622-542e-4f09-8b54-7a89332f8a4e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:29.388596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-14b0a622-542e-4f09-8b54-7a89332f8a4e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.182983 Sep 05 17:14:29.389487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 841/1603] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:29 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:30.118016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e4fba8a8-2178-4582-9d10-d1646017c66d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:30.120285 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e4fba8a8-2178-4582-9d10-d1646017c66d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:30.126964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4fba8a8-2178-4582-9d10-d1646017c66d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:30.127443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4fba8a8-2178-4582-9d10-d1646017c66d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:30.127871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4fba8a8-2178-4582-9d10-d1646017c66d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:30.128585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4fba8a8-2178-4582-9d10-d1646017c66d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:30.129003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4fba8a8-2178-4582-9d10-d1646017c66d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:30.129439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4fba8a8-2178-4582-9d10-d1646017c66d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:30.161919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e4fba8a8-2178-4582-9d10-d1646017c66d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047939 Sep 05 17:14:30.164119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 842/1604] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:30 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:30.234279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-cf65c420-6e84-4eb3-854a-591b821f3f48 req-920f4ea9-c228-49cb-9899-04c84e4dd92f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c69901d5-72a5-4e1d-af30-b7c680f90b73", "tag": "01c8109f-3864-4fe7-aab8-f7e9f1ac508b"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:14:30.243398 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-cf65c420-6e84-4eb3-854a-591b821f3f48 req-920f4ea9-c228-49cb-9899-04c84e4dd92f service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:30.243861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-cf65c420-6e84-4eb3-854a-591b821f3f48 req-920f4ea9-c228-49cb-9899-04c84e4dd92f service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:30.244301 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-cf65c420-6e84-4eb3-854a-591b821f3f48 req-920f4ea9-c228-49cb-9899-04c84e4dd92f service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:30.255298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-cf65c420-6e84-4eb3-854a-591b821f3f48 req-920f4ea9-c228-49cb-9899-04c84e4dd92f service nova] Creating event network-changed:01c8109f-3864-4fe7-aab8-f7e9f1ac508b for instance c69901d5-72a5-4e1d-af30-b7c680f90b73 on hv-cinder-85596 Sep 05 17:14:30.260672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-cf65c420-6e84-4eb3-854a-591b821f3f48 req-920f4ea9-c228-49cb-9899-04c84e4dd92f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080071 Sep 05 17:14:30.261349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 843/1605] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:14:30.411756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-43996fc9-5b55-4b0a-ad77-65d4908367b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:30.412494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-43996fc9-5b55-4b0a-ad77-65d4908367b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:30.418977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43996fc9-5b55-4b0a-ad77-65d4908367b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:30.419458 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43996fc9-5b55-4b0a-ad77-65d4908367b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:30.419888 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43996fc9-5b55-4b0a-ad77-65d4908367b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:30.421125 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43996fc9-5b55-4b0a-ad77-65d4908367b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:30.421589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43996fc9-5b55-4b0a-ad77-65d4908367b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:30.422011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43996fc9-5b55-4b0a-ad77-65d4908367b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:30.498507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-43996fc9-5b55-4b0a-ad77-65d4908367b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:30.507494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-43996fc9-5b55-4b0a-ad77-65d4908367b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.100009 Sep 05 17:14:30.508331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 844/1606] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:30 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:14:31.173948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2ee46bd6-ec66-46d3-a4e0-f83a521129cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:31.176327 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2ee46bd6-ec66-46d3-a4e0-f83a521129cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:31.184321 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee46bd6-ec66-46d3-a4e0-f83a521129cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:31.184843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee46bd6-ec66-46d3-a4e0-f83a521129cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:31.185272 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee46bd6-ec66-46d3-a4e0-f83a521129cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:31.185959 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee46bd6-ec66-46d3-a4e0-f83a521129cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:31.186450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee46bd6-ec66-46d3-a4e0-f83a521129cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:31.186851 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee46bd6-ec66-46d3-a4e0-f83a521129cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:31.218284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2ee46bd6-ec66-46d3-a4e0-f83a521129cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048374 Sep 05 17:14:31.218873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 845/1607] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:31 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:31.533564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-44d990e5-08b9-46f3-9d93-dbd39b0fe0f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:31.534313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-44d990e5-08b9-46f3-9d93-dbd39b0fe0f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:31.542050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d990e5-08b9-46f3-9d93-dbd39b0fe0f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:31.542652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d990e5-08b9-46f3-9d93-dbd39b0fe0f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:31.543185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d990e5-08b9-46f3-9d93-dbd39b0fe0f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:31.544036 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d990e5-08b9-46f3-9d93-dbd39b0fe0f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:31.544625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d990e5-08b9-46f3-9d93-dbd39b0fe0f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:31.545149 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d990e5-08b9-46f3-9d93-dbd39b0fe0f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:31.610587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-44d990e5-08b9-46f3-9d93-dbd39b0fe0f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:31.619052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-44d990e5-08b9-46f3-9d93-dbd39b0fe0f8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091283 Sep 05 17:14:31.619627 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 846/1608] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:31 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:32.235543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ee2690f4-4052-4482-b2cc-3f20cee56596 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:32.239067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ee2690f4-4052-4482-b2cc-3f20cee56596 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:32.249642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee2690f4-4052-4482-b2cc-3f20cee56596 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:32.250136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee2690f4-4052-4482-b2cc-3f20cee56596 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:32.250553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee2690f4-4052-4482-b2cc-3f20cee56596 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:32.251243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee2690f4-4052-4482-b2cc-3f20cee56596 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:32.251679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee2690f4-4052-4482-b2cc-3f20cee56596 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:32.252094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee2690f4-4052-4482-b2cc-3f20cee56596 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:32.283171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ee2690f4-4052-4482-b2cc-3f20cee56596 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054207 Sep 05 17:14:32.283744 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 847/1609] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:32 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:32.653584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-59e0f971-e666-4235-9485-49ab7407d4a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:32.654670 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-59e0f971-e666-4235-9485-49ab7407d4a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:32.665704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59e0f971-e666-4235-9485-49ab7407d4a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:32.666536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59e0f971-e666-4235-9485-49ab7407d4a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:32.667282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59e0f971-e666-4235-9485-49ab7407d4a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:32.668520 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59e0f971-e666-4235-9485-49ab7407d4a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:32.669297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59e0f971-e666-4235-9485-49ab7407d4a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:32.670034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59e0f971-e666-4235-9485-49ab7407d4a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:32.735142 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-59e0f971-e666-4235-9485-49ab7407d4a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:32.747818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-59e0f971-e666-4235-9485-49ab7407d4a5 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.100600 Sep 05 17:14:32.750328 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 848/1610] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:32 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:33.298725 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-66413da5-07a8-4877-830f-13918de84e55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:33.300869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-66413da5-07a8-4877-830f-13918de84e55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:33.307886 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66413da5-07a8-4877-830f-13918de84e55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:33.308404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66413da5-07a8-4877-830f-13918de84e55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:33.308839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66413da5-07a8-4877-830f-13918de84e55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:33.309534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66413da5-07a8-4877-830f-13918de84e55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:33.309982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66413da5-07a8-4877-830f-13918de84e55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:33.310397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66413da5-07a8-4877-830f-13918de84e55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:33.339649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-66413da5-07a8-4877-830f-13918de84e55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047108 Sep 05 17:14:33.340194 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 849/1611] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:33 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:33.775359 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7658364a-3cb3-47e4-a899-6d3409e2f581 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:33.776533 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7658364a-3cb3-47e4-a899-6d3409e2f581 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:33.779721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:14:33.786021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7658364a-3cb3-47e4-a899-6d3409e2f581 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:33.786503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7658364a-3cb3-47e4-a899-6d3409e2f581 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:33.786936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7658364a-3cb3-47e4-a899-6d3409e2f581 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:33.787635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7658364a-3cb3-47e4-a899-6d3409e2f581 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:33.788080 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7658364a-3cb3-47e4-a899-6d3409e2f581 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:33.788534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7658364a-3cb3-47e4-a899-6d3409e2f581 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:33.854954 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7658364a-3cb3-47e4-a899-6d3409e2f581 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:33.864167 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7658364a-3cb3-47e4-a899-6d3409e2f581 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095294 Sep 05 17:14:33.864728 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 850/1612] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:33 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:34.356411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d9772df7-889c-4f1f-a27a-9c14290df79a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:34.359689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d9772df7-889c-4f1f-a27a-9c14290df79a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:34.370003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9772df7-889c-4f1f-a27a-9c14290df79a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:34.371190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9772df7-889c-4f1f-a27a-9c14290df79a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:34.371867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9772df7-889c-4f1f-a27a-9c14290df79a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:34.373360 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9772df7-889c-4f1f-a27a-9c14290df79a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:34.374074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9772df7-889c-4f1f-a27a-9c14290df79a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:34.374728 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9772df7-889c-4f1f-a27a-9c14290df79a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:34.409415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d9772df7-889c-4f1f-a27a-9c14290df79a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059271 Sep 05 17:14:34.409980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 851/1613] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:34 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:34.892528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e76a9bed-60dc-4f55-9c61-593e0ded9785 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:34.893596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e76a9bed-60dc-4f55-9c61-593e0ded9785 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:34.901257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e76a9bed-60dc-4f55-9c61-593e0ded9785 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:34.901751 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e76a9bed-60dc-4f55-9c61-593e0ded9785 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:34.902177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e76a9bed-60dc-4f55-9c61-593e0ded9785 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:34.902859 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e76a9bed-60dc-4f55-9c61-593e0ded9785 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:34.903341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e76a9bed-60dc-4f55-9c61-593e0ded9785 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:34.903792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e76a9bed-60dc-4f55-9c61-593e0ded9785 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:34.973067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e76a9bed-60dc-4f55-9c61-593e0ded9785 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:34.985301 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e76a9bed-60dc-4f55-9c61-593e0ded9785 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.100294 Sep 05 17:14:34.986111 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 852/1614] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:34 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:35.428760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8eb651ee-7a64-4051-8768-a30d3a9c711d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:35.430936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8eb651ee-7a64-4051-8768-a30d3a9c711d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:35.437909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8eb651ee-7a64-4051-8768-a30d3a9c711d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:35.438392 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8eb651ee-7a64-4051-8768-a30d3a9c711d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:35.438813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8eb651ee-7a64-4051-8768-a30d3a9c711d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:35.440077 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8eb651ee-7a64-4051-8768-a30d3a9c711d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:35.440592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8eb651ee-7a64-4051-8768-a30d3a9c711d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:35.441020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8eb651ee-7a64-4051-8768-a30d3a9c711d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:35.474221 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8eb651ee-7a64-4051-8768-a30d3a9c711d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054809 Sep 05 17:14:35.474808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 853/1615] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:35 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:36.012716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f816f496-ee9d-4174-bfe4-e4fd81e0746e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:36.013704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f816f496-ee9d-4174-bfe4-e4fd81e0746e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:36.021516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f816f496-ee9d-4174-bfe4-e4fd81e0746e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:36.021995 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f816f496-ee9d-4174-bfe4-e4fd81e0746e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:36.022414 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f816f496-ee9d-4174-bfe4-e4fd81e0746e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:36.023093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f816f496-ee9d-4174-bfe4-e4fd81e0746e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:36.023542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f816f496-ee9d-4174-bfe4-e4fd81e0746e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:36.023953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f816f496-ee9d-4174-bfe4-e4fd81e0746e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:36.038661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:14:36.084856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f816f496-ee9d-4174-bfe4-e4fd81e0746e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:36.092692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f816f496-ee9d-4174-bfe4-e4fd81e0746e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086547 Sep 05 17:14:36.093251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 854/1616] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:36 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:36.493614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-43cadc97-f224-47b7-8e2b-69efbe6787a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:36.497210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-43cadc97-f224-47b7-8e2b-69efbe6787a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:36.505968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43cadc97-f224-47b7-8e2b-69efbe6787a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:36.506415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43cadc97-f224-47b7-8e2b-69efbe6787a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:36.506877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43cadc97-f224-47b7-8e2b-69efbe6787a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:36.507583 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43cadc97-f224-47b7-8e2b-69efbe6787a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:36.508031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43cadc97-f224-47b7-8e2b-69efbe6787a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:36.508471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43cadc97-f224-47b7-8e2b-69efbe6787a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:36.541171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-43cadc97-f224-47b7-8e2b-69efbe6787a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054320 Sep 05 17:14:36.541742 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 855/1617] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:36 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:14:37.062676 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:14:37.063205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:14:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 (ip 10.222.0.23) !!! Sep 05 17:14:37.115724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6dd04358-f8bc-4908-96bd-ad28e2eb7451 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:37.116395 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6dd04358-f8bc-4908-96bd-ad28e2eb7451 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:37.122970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd04358-f8bc-4908-96bd-ad28e2eb7451 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:37.123458 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd04358-f8bc-4908-96bd-ad28e2eb7451 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:37.123882 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd04358-f8bc-4908-96bd-ad28e2eb7451 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:37.124602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd04358-f8bc-4908-96bd-ad28e2eb7451 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:37.125043 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd04358-f8bc-4908-96bd-ad28e2eb7451 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:37.125456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd04358-f8bc-4908-96bd-ad28e2eb7451 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:37.188079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6dd04358-f8bc-4908-96bd-ad28e2eb7451 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:37.196617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6dd04358-f8bc-4908-96bd-ad28e2eb7451 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.084847 Sep 05 17:14:37.197185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 856/1618] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:37 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:37.554282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5a75fab3-3d52-4ba3-9415-f576e9cc6754 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:37.556595 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5a75fab3-3d52-4ba3-9415-f576e9cc6754 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:37.563384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a75fab3-3d52-4ba3-9415-f576e9cc6754 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:37.563858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a75fab3-3d52-4ba3-9415-f576e9cc6754 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:37.564390 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a75fab3-3d52-4ba3-9415-f576e9cc6754 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:37.565080 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a75fab3-3d52-4ba3-9415-f576e9cc6754 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:37.565525 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a75fab3-3d52-4ba3-9415-f576e9cc6754 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:37.565938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a75fab3-3d52-4ba3-9415-f576e9cc6754 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:37.596126 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5a75fab3-3d52-4ba3-9415-f576e9cc6754 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045971 Sep 05 17:14:37.596717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 857/1619] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:37 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:38.223696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ce674430-b3ef-422e-97e0-b24aa64953d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:38.224443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ce674430-b3ef-422e-97e0-b24aa64953d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:38.231869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce674430-b3ef-422e-97e0-b24aa64953d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:38.232483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce674430-b3ef-422e-97e0-b24aa64953d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:38.232990 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce674430-b3ef-422e-97e0-b24aa64953d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:38.233799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce674430-b3ef-422e-97e0-b24aa64953d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:38.234329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce674430-b3ef-422e-97e0-b24aa64953d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:38.234823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce674430-b3ef-422e-97e0-b24aa64953d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:38.296872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ce674430-b3ef-422e-97e0-b24aa64953d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:38.305154 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ce674430-b3ef-422e-97e0-b24aa64953d7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.088198 Sep 05 17:14:38.305725 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 858/1620] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:38 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:38.613958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e19df0ad-27e6-42c8-873e-ff014a022c74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:38.617532 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e19df0ad-27e6-42c8-873e-ff014a022c74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:38.628424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e19df0ad-27e6-42c8-873e-ff014a022c74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:38.629340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e19df0ad-27e6-42c8-873e-ff014a022c74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:38.629773 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e19df0ad-27e6-42c8-873e-ff014a022c74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:38.630475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e19df0ad-27e6-42c8-873e-ff014a022c74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:38.630927 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e19df0ad-27e6-42c8-873e-ff014a022c74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:38.631349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e19df0ad-27e6-42c8-873e-ff014a022c74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:38.663823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e19df0ad-27e6-42c8-873e-ff014a022c74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056969 Sep 05 17:14:38.664435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 859/1621] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:38 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:39.328571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c987453f-d8ec-463e-9fb8-d8bf3ee71e0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:39.329280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c987453f-d8ec-463e-9fb8-d8bf3ee71e0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:39.336507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c987453f-d8ec-463e-9fb8-d8bf3ee71e0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:39.336979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c987453f-d8ec-463e-9fb8-d8bf3ee71e0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:39.337404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c987453f-d8ec-463e-9fb8-d8bf3ee71e0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:39.338081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c987453f-d8ec-463e-9fb8-d8bf3ee71e0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:39.338526 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c987453f-d8ec-463e-9fb8-d8bf3ee71e0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:39.338935 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c987453f-d8ec-463e-9fb8-d8bf3ee71e0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:39.409776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c987453f-d8ec-463e-9fb8-d8bf3ee71e0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:39.417800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c987453f-d8ec-463e-9fb8-d8bf3ee71e0d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093969 Sep 05 17:14:39.418366 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 860/1622] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:39 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:39.680093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ac4ff590-f496-4f19-964b-d9423740601c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:39.682535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ac4ff590-f496-4f19-964b-d9423740601c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:39.689580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac4ff590-f496-4f19-964b-d9423740601c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:39.690081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac4ff590-f496-4f19-964b-d9423740601c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:39.690549 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac4ff590-f496-4f19-964b-d9423740601c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:39.691396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac4ff590-f496-4f19-964b-d9423740601c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:39.691869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac4ff590-f496-4f19-964b-d9423740601c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:39.692342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac4ff590-f496-4f19-964b-d9423740601c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:39.725890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ac4ff590-f496-4f19-964b-d9423740601c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051754 Sep 05 17:14:39.726454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 861/1623] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:39 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:40.440475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6f90fc43-2acb-4e09-95df-3a236c54fe17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:40.441463 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6f90fc43-2acb-4e09-95df-3a236c54fe17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:40.447493 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f90fc43-2acb-4e09-95df-3a236c54fe17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:40.447965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f90fc43-2acb-4e09-95df-3a236c54fe17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:40.448422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f90fc43-2acb-4e09-95df-3a236c54fe17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:40.449110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f90fc43-2acb-4e09-95df-3a236c54fe17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:40.449549 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f90fc43-2acb-4e09-95df-3a236c54fe17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:40.449958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f90fc43-2acb-4e09-95df-3a236c54fe17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:40.512363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6f90fc43-2acb-4e09-95df-3a236c54fe17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:40.520283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6f90fc43-2acb-4e09-95df-3a236c54fe17 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.083857 Sep 05 17:14:40.520962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 862/1624] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:40 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:40.741947 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7471314e-d83f-4696-9a3c-cf589279b724 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:40.744500 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7471314e-d83f-4696-9a3c-cf589279b724 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:40.752716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7471314e-d83f-4696-9a3c-cf589279b724 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:40.753353 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7471314e-d83f-4696-9a3c-cf589279b724 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:40.753981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7471314e-d83f-4696-9a3c-cf589279b724 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:40.754969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7471314e-d83f-4696-9a3c-cf589279b724 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:40.755536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7471314e-d83f-4696-9a3c-cf589279b724 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:40.756053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7471314e-d83f-4696-9a3c-cf589279b724 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:40.789191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7471314e-d83f-4696-9a3c-cf589279b724 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053147 Sep 05 17:14:40.789764 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 863/1625] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:40 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:41.547350 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-afaa436d-8de6-4f4f-954c-ecd133f2e3d1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:41.548428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-afaa436d-8de6-4f4f-954c-ecd133f2e3d1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:41.556504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afaa436d-8de6-4f4f-954c-ecd133f2e3d1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:41.557056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afaa436d-8de6-4f4f-954c-ecd133f2e3d1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:41.557536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afaa436d-8de6-4f4f-954c-ecd133f2e3d1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:41.558215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afaa436d-8de6-4f4f-954c-ecd133f2e3d1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:41.558710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afaa436d-8de6-4f4f-954c-ecd133f2e3d1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:41.559168 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afaa436d-8de6-4f4f-954c-ecd133f2e3d1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:41.634666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-afaa436d-8de6-4f4f-954c-ecd133f2e3d1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:41.643255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-afaa436d-8de6-4f4f-954c-ecd133f2e3d1 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.102402 Sep 05 17:14:41.643937 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 864/1626] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:41 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:41.806684 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-87a01357-c36a-45d8-b164-4f8b6ca93b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:41.810448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-87a01357-c36a-45d8-b164-4f8b6ca93b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:41.820016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87a01357-c36a-45d8-b164-4f8b6ca93b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:41.820517 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87a01357-c36a-45d8-b164-4f8b6ca93b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:41.820939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87a01357-c36a-45d8-b164-4f8b6ca93b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:41.821621 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87a01357-c36a-45d8-b164-4f8b6ca93b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:41.822031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87a01357-c36a-45d8-b164-4f8b6ca93b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:41.822443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87a01357-c36a-45d8-b164-4f8b6ca93b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:41.851901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-87a01357-c36a-45d8-b164-4f8b6ca93b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052391 Sep 05 17:14:41.852482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 865/1627] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:41 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:42.671256 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fd13d654-0ce1-4fff-b5d7-23fe66023e78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:42.672136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fd13d654-0ce1-4fff-b5d7-23fe66023e78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:42.680703 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd13d654-0ce1-4fff-b5d7-23fe66023e78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:42.681183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd13d654-0ce1-4fff-b5d7-23fe66023e78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:42.681604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd13d654-0ce1-4fff-b5d7-23fe66023e78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:42.682290 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd13d654-0ce1-4fff-b5d7-23fe66023e78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:42.682730 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd13d654-0ce1-4fff-b5d7-23fe66023e78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:42.683152 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd13d654-0ce1-4fff-b5d7-23fe66023e78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:42.753188 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fd13d654-0ce1-4fff-b5d7-23fe66023e78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:42.761869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fd13d654-0ce1-4fff-b5d7-23fe66023e78 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.097316 Sep 05 17:14:42.762432 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 866/1628] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:42 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:42.863843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6033631b-bacd-4556-b9cc-c7d23b1d7914 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:42.866665 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6033631b-bacd-4556-b9cc-c7d23b1d7914 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:42.873436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6033631b-bacd-4556-b9cc-c7d23b1d7914 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:42.873907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6033631b-bacd-4556-b9cc-c7d23b1d7914 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:42.874332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6033631b-bacd-4556-b9cc-c7d23b1d7914 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:42.875020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6033631b-bacd-4556-b9cc-c7d23b1d7914 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:42.875461 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6033631b-bacd-4556-b9cc-c7d23b1d7914 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:42.875870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6033631b-bacd-4556-b9cc-c7d23b1d7914 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:42.906375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6033631b-bacd-4556-b9cc-c7d23b1d7914 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046487 Sep 05 17:14:42.906927 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 867/1629] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:42 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:43.789197 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1deed08d-1ebd-488d-a3d9-7ec46da809ef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:43.789987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1deed08d-1ebd-488d-a3d9-7ec46da809ef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:43.799431 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1deed08d-1ebd-488d-a3d9-7ec46da809ef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:43.800096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1deed08d-1ebd-488d-a3d9-7ec46da809ef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:43.800736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1deed08d-1ebd-488d-a3d9-7ec46da809ef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:43.801781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1deed08d-1ebd-488d-a3d9-7ec46da809ef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:43.802215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1deed08d-1ebd-488d-a3d9-7ec46da809ef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:43.802863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1deed08d-1ebd-488d-a3d9-7ec46da809ef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:43.874075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1deed08d-1ebd-488d-a3d9-7ec46da809ef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:43.882175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1deed08d-1ebd-488d-a3d9-7ec46da809ef tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.099849 Sep 05 17:14:43.882747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 868/1630] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:43 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:43.918482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e3062538-e306-468d-99c9-18a2e304fb43 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:43.920763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e3062538-e306-468d-99c9-18a2e304fb43 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:43.927382 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3062538-e306-468d-99c9-18a2e304fb43 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:43.928015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3062538-e306-468d-99c9-18a2e304fb43 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:43.928558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3062538-e306-468d-99c9-18a2e304fb43 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:43.929259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3062538-e306-468d-99c9-18a2e304fb43 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:43.929709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3062538-e306-468d-99c9-18a2e304fb43 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:43.930134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3062538-e306-468d-99c9-18a2e304fb43 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:43.960396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e3062538-e306-468d-99c9-18a2e304fb43 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045846 Sep 05 17:14:43.961200 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 869/1631] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:43 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:14:44.905770 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-19a7ecae-dcfe-418a-8b1c-cb043d637ccc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:44.906576 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-19a7ecae-dcfe-418a-8b1c-cb043d637ccc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:44.914792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19a7ecae-dcfe-418a-8b1c-cb043d637ccc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:44.915274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19a7ecae-dcfe-418a-8b1c-cb043d637ccc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:44.915704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19a7ecae-dcfe-418a-8b1c-cb043d637ccc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:44.916436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19a7ecae-dcfe-418a-8b1c-cb043d637ccc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:44.916883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19a7ecae-dcfe-418a-8b1c-cb043d637ccc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:44.917308 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19a7ecae-dcfe-418a-8b1c-cb043d637ccc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:44.980039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-19a7ecae-dcfe-418a-8b1c-cb043d637ccc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:44.987934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-19a7ecae-dcfe-418a-8b1c-cb043d637ccc tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086882 Sep 05 17:14:44.988540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 870/1632] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:44 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:44.993888 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fdb488b4-214b-4a22-b198-7c03b5b10c47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:44.995982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fdb488b4-214b-4a22-b198-7c03b5b10c47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:45.001864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdb488b4-214b-4a22-b198-7c03b5b10c47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:45.002543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdb488b4-214b-4a22-b198-7c03b5b10c47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:45.002975 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdb488b4-214b-4a22-b198-7c03b5b10c47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:45.003663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdb488b4-214b-4a22-b198-7c03b5b10c47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:45.004103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdb488b4-214b-4a22-b198-7c03b5b10c47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:45.004582 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdb488b4-214b-4a22-b198-7c03b5b10c47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:45.007109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:14:45.035835 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fdb488b4-214b-4a22-b198-7c03b5b10c47 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046331 Sep 05 17:14:45.036482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 871/1633] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:44 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:46.015772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1a64284b-9ba8-48ef-9eac-9cb3b94f4653 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:46.016921 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1a64284b-9ba8-48ef-9eac-9cb3b94f4653 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:46.025642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a64284b-9ba8-48ef-9eac-9cb3b94f4653 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:46.026124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a64284b-9ba8-48ef-9eac-9cb3b94f4653 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:46.026552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a64284b-9ba8-48ef-9eac-9cb3b94f4653 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:46.027245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a64284b-9ba8-48ef-9eac-9cb3b94f4653 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:46.027694 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a64284b-9ba8-48ef-9eac-9cb3b94f4653 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:46.028111 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a64284b-9ba8-48ef-9eac-9cb3b94f4653 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:46.093460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1a64284b-9ba8-48ef-9eac-9cb3b94f4653 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:46.102600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1a64284b-9ba8-48ef-9eac-9cb3b94f4653 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093368 Sep 05 17:14:46.103171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 872/1634] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:46 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:46.107688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-de60241d-f3c2-4daa-990c-fb543ea47a6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:46.109854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-de60241d-f3c2-4daa-990c-fb543ea47a6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:46.115777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de60241d-f3c2-4daa-990c-fb543ea47a6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:46.116285 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de60241d-f3c2-4daa-990c-fb543ea47a6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:46.116721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de60241d-f3c2-4daa-990c-fb543ea47a6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:46.117412 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de60241d-f3c2-4daa-990c-fb543ea47a6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:46.117862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de60241d-f3c2-4daa-990c-fb543ea47a6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:46.118286 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de60241d-f3c2-4daa-990c-fb543ea47a6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:46.149323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-de60241d-f3c2-4daa-990c-fb543ea47a6e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045123 Sep 05 17:14:46.149867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 873/1635] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:46 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:47.126764 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d505ec73-81bb-45a6-b2c4-0476ed910063 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:47.127393 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d505ec73-81bb-45a6-b2c4-0476ed910063 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:47.135241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d505ec73-81bb-45a6-b2c4-0476ed910063 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:47.135692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d505ec73-81bb-45a6-b2c4-0476ed910063 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:47.136173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d505ec73-81bb-45a6-b2c4-0476ed910063 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:47.136840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d505ec73-81bb-45a6-b2c4-0476ed910063 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:47.137286 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d505ec73-81bb-45a6-b2c4-0476ed910063 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:47.137704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d505ec73-81bb-45a6-b2c4-0476ed910063 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:47.201218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d505ec73-81bb-45a6-b2c4-0476ed910063 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:47.209845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d505ec73-81bb-45a6-b2c4-0476ed910063 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.088184 Sep 05 17:14:47.224388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 874/1636] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:47 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:47.224388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dab87c95-880e-4560-aff7-8b1aad369f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:47.224388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dab87c95-880e-4560-aff7-8b1aad369f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:47.224388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dab87c95-880e-4560-aff7-8b1aad369f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:47.224852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dab87c95-880e-4560-aff7-8b1aad369f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:47.225110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dab87c95-880e-4560-aff7-8b1aad369f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:47.225775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dab87c95-880e-4560-aff7-8b1aad369f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:47.226227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dab87c95-880e-4560-aff7-8b1aad369f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:47.226679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dab87c95-880e-4560-aff7-8b1aad369f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:47.257106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dab87c95-880e-4560-aff7-8b1aad369f68 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045636 Sep 05 17:14:47.257722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 875/1637] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:47 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:48.238000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cda6a4cf-e1e4-4d34-af61-9eab96c1956b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:48.239115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cda6a4cf-e1e4-4d34-af61-9eab96c1956b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:48.246582 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cda6a4cf-e1e4-4d34-af61-9eab96c1956b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:48.247063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cda6a4cf-e1e4-4d34-af61-9eab96c1956b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:48.247495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cda6a4cf-e1e4-4d34-af61-9eab96c1956b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:48.248191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cda6a4cf-e1e4-4d34-af61-9eab96c1956b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:48.248649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cda6a4cf-e1e4-4d34-af61-9eab96c1956b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:48.249067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cda6a4cf-e1e4-4d34-af61-9eab96c1956b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:48.320879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cda6a4cf-e1e4-4d34-af61-9eab96c1956b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:48.329357 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cda6a4cf-e1e4-4d34-af61-9eab96c1956b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.097897 Sep 05 17:14:48.329936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 876/1638] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:48 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:48.334616 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7a8bafd7-3d66-44a7-bacd-67e9580f9b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:48.336796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7a8bafd7-3d66-44a7-bacd-67e9580f9b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:48.342995 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a8bafd7-3d66-44a7-bacd-67e9580f9b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:48.343479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a8bafd7-3d66-44a7-bacd-67e9580f9b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:48.343909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a8bafd7-3d66-44a7-bacd-67e9580f9b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:48.344670 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a8bafd7-3d66-44a7-bacd-67e9580f9b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:48.345119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a8bafd7-3d66-44a7-bacd-67e9580f9b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:48.345542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a8bafd7-3d66-44a7-bacd-67e9580f9b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:48.375403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7a8bafd7-3d66-44a7-bacd-67e9580f9b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044431 Sep 05 17:14:48.376006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 877/1639] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:48 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:49.356702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9bf17d54-fa87-401a-9cbb-90ec14460cf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:49.357772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9bf17d54-fa87-401a-9cbb-90ec14460cf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:49.369149 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9bf17d54-fa87-401a-9cbb-90ec14460cf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:49.369961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9bf17d54-fa87-401a-9cbb-90ec14460cf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:49.370690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9bf17d54-fa87-401a-9cbb-90ec14460cf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:49.372757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9bf17d54-fa87-401a-9cbb-90ec14460cf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:49.372757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9bf17d54-fa87-401a-9cbb-90ec14460cf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:49.373971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9bf17d54-fa87-401a-9cbb-90ec14460cf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:49.440333 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9bf17d54-fa87-401a-9cbb-90ec14460cf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:49.452777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9bf17d54-fa87-401a-9cbb-90ec14460cf7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.102383 Sep 05 17:14:49.453491 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 878/1640] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:49 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:49.458029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8aecf5d3-e842-4ee2-b3fb-cd6fc8e170be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:49.460953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8aecf5d3-e842-4ee2-b3fb-cd6fc8e170be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:49.467050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aecf5d3-e842-4ee2-b3fb-cd6fc8e170be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:49.467528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aecf5d3-e842-4ee2-b3fb-cd6fc8e170be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:49.467958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aecf5d3-e842-4ee2-b3fb-cd6fc8e170be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:49.468694 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aecf5d3-e842-4ee2-b3fb-cd6fc8e170be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:49.469140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aecf5d3-e842-4ee2-b3fb-cd6fc8e170be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:49.469566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aecf5d3-e842-4ee2-b3fb-cd6fc8e170be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:49.504425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8aecf5d3-e842-4ee2-b3fb-cd6fc8e170be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049836 Sep 05 17:14:49.504984 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 879/1641] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:49 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:50.479771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d5fa1126-5b3d-4367-99a3-7e33a5729cc7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:50.480974 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d5fa1126-5b3d-4367-99a3-7e33a5729cc7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:50.491206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5fa1126-5b3d-4367-99a3-7e33a5729cc7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:50.491681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5fa1126-5b3d-4367-99a3-7e33a5729cc7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:50.492113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5fa1126-5b3d-4367-99a3-7e33a5729cc7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:50.492824 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5fa1126-5b3d-4367-99a3-7e33a5729cc7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:50.493271 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5fa1126-5b3d-4367-99a3-7e33a5729cc7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:50.493697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5fa1126-5b3d-4367-99a3-7e33a5729cc7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:50.557611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d5fa1126-5b3d-4367-99a3-7e33a5729cc7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:50.565794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d5fa1126-5b3d-4367-99a3-7e33a5729cc7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093323 Sep 05 17:14:50.566356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 880/1642] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:50 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:50.571316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-457df983-e89e-4385-8f04-3cce29aff064 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:50.573472 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-457df983-e89e-4385-8f04-3cce29aff064 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:50.579288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-457df983-e89e-4385-8f04-3cce29aff064 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:50.579758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-457df983-e89e-4385-8f04-3cce29aff064 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:50.580193 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-457df983-e89e-4385-8f04-3cce29aff064 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:50.580878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-457df983-e89e-4385-8f04-3cce29aff064 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:50.581320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-457df983-e89e-4385-8f04-3cce29aff064 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:50.581731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-457df983-e89e-4385-8f04-3cce29aff064 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:50.613034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-457df983-e89e-4385-8f04-3cce29aff064 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045690 Sep 05 17:14:50.613574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 881/1643] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:50 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:51.593253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5f7fabed-8e5e-44b4-9374-2f68babd0087 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:51.594029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5f7fabed-8e5e-44b4-9374-2f68babd0087 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:51.602702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f7fabed-8e5e-44b4-9374-2f68babd0087 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:51.603176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f7fabed-8e5e-44b4-9374-2f68babd0087 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:51.603598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f7fabed-8e5e-44b4-9374-2f68babd0087 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:51.604312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f7fabed-8e5e-44b4-9374-2f68babd0087 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:51.604764 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f7fabed-8e5e-44b4-9374-2f68babd0087 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:51.605179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f7fabed-8e5e-44b4-9374-2f68babd0087 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:51.678371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f7fabed-8e5e-44b4-9374-2f68babd0087 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:51.686566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5f7fabed-8e5e-44b4-9374-2f68babd0087 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.099803 Sep 05 17:14:51.687148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 882/1644] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:51 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:51.691624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9698904c-f6ca-4f67-8a55-06006e153505 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:51.694640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9698904c-f6ca-4f67-8a55-06006e153505 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:51.700718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9698904c-f6ca-4f67-8a55-06006e153505 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:51.701201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9698904c-f6ca-4f67-8a55-06006e153505 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:51.701633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9698904c-f6ca-4f67-8a55-06006e153505 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:51.702322 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9698904c-f6ca-4f67-8a55-06006e153505 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:51.702769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9698904c-f6ca-4f67-8a55-06006e153505 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:51.703190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9698904c-f6ca-4f67-8a55-06006e153505 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:51.733978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9698904c-f6ca-4f67-8a55-06006e153505 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045825 Sep 05 17:14:51.734527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 883/1645] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:51 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:52.712749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2cfec920-88ab-448e-b870-d5eb62630b5f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:52.713609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2cfec920-88ab-448e-b870-d5eb62630b5f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:52.723733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cfec920-88ab-448e-b870-d5eb62630b5f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:52.724489 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cfec920-88ab-448e-b870-d5eb62630b5f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:52.725319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cfec920-88ab-448e-b870-d5eb62630b5f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:52.726375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cfec920-88ab-448e-b870-d5eb62630b5f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:52.727064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cfec920-88ab-448e-b870-d5eb62630b5f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:52.727671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cfec920-88ab-448e-b870-d5eb62630b5f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:52.798624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2cfec920-88ab-448e-b870-d5eb62630b5f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:52.812917 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2cfec920-88ab-448e-b870-d5eb62630b5f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.105814 Sep 05 17:14:52.813816 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 884/1646] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:52 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:52.818809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fbf1a1a7-acb7-4a23-ae48-f4022d9f45de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:52.820973 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fbf1a1a7-acb7-4a23-ae48-f4022d9f45de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:52.826753 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf1a1a7-acb7-4a23-ae48-f4022d9f45de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:52.827222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf1a1a7-acb7-4a23-ae48-f4022d9f45de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:52.827640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf1a1a7-acb7-4a23-ae48-f4022d9f45de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:52.828346 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf1a1a7-acb7-4a23-ae48-f4022d9f45de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:52.828788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf1a1a7-acb7-4a23-ae48-f4022d9f45de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:52.829197 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf1a1a7-acb7-4a23-ae48-f4022d9f45de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:52.858158 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fbf1a1a7-acb7-4a23-ae48-f4022d9f45de tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043136 Sep 05 17:14:52.858698 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 885/1647] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:52 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:53.846868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8b4e7150-4e3d-4968-a3ef-3b86150db330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:53.850741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8b4e7150-4e3d-4968-a3ef-3b86150db330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:53.857815 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b4e7150-4e3d-4968-a3ef-3b86150db330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:53.858436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b4e7150-4e3d-4968-a3ef-3b86150db330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:53.858883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b4e7150-4e3d-4968-a3ef-3b86150db330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:53.859810 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b4e7150-4e3d-4968-a3ef-3b86150db330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:53.860520 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b4e7150-4e3d-4968-a3ef-3b86150db330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:53.861129 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b4e7150-4e3d-4968-a3ef-3b86150db330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:53.929407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8b4e7150-4e3d-4968-a3ef-3b86150db330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:53.940248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8b4e7150-4e3d-4968-a3ef-3b86150db330 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.102866 Sep 05 17:14:53.941111 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 886/1648] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:53 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:53.947224 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8c892b4e-0b90-45ea-b720-b6906f781a06 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:53.949415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8c892b4e-0b90-45ea-b720-b6906f781a06 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:53.955550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c892b4e-0b90-45ea-b720-b6906f781a06 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:53.956031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c892b4e-0b90-45ea-b720-b6906f781a06 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:53.956498 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c892b4e-0b90-45ea-b720-b6906f781a06 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:53.957188 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c892b4e-0b90-45ea-b720-b6906f781a06 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:53.957639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c892b4e-0b90-45ea-b720-b6906f781a06 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:53.958059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c892b4e-0b90-45ea-b720-b6906f781a06 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:53.989237 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:14:53.996426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8c892b4e-0b90-45ea-b720-b6906f781a06 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054099 Sep 05 17:14:53.996997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 887/1649] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:53 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:54.968241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-02cb3fe0-9bbb-4664-bb82-bb290a26419d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:54.969362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-02cb3fe0-9bbb-4664-bb82-bb290a26419d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:54.980964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02cb3fe0-9bbb-4664-bb82-bb290a26419d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:54.981761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02cb3fe0-9bbb-4664-bb82-bb290a26419d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:54.982467 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02cb3fe0-9bbb-4664-bb82-bb290a26419d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:54.983593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02cb3fe0-9bbb-4664-bb82-bb290a26419d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:54.984383 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02cb3fe0-9bbb-4664-bb82-bb290a26419d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:54.985109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02cb3fe0-9bbb-4664-bb82-bb290a26419d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:55.049686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-02cb3fe0-9bbb-4664-bb82-bb290a26419d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:55.057961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-02cb3fe0-9bbb-4664-bb82-bb290a26419d tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.096205 Sep 05 17:14:55.058523 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 888/1650] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:54 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:14:55.063264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5b3948b7-7ce6-4028-8f0b-f4e5f86cef36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:55.065419 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5b3948b7-7ce6-4028-8f0b-f4e5f86cef36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:55.071377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b3948b7-7ce6-4028-8f0b-f4e5f86cef36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:55.071890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b3948b7-7ce6-4028-8f0b-f4e5f86cef36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:55.072372 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b3948b7-7ce6-4028-8f0b-f4e5f86cef36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:55.073067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b3948b7-7ce6-4028-8f0b-f4e5f86cef36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:55.073701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b3948b7-7ce6-4028-8f0b-f4e5f86cef36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:55.074335 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b3948b7-7ce6-4028-8f0b-f4e5f86cef36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:55.117487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5b3948b7-7ce6-4028-8f0b-f4e5f86cef36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057930 Sep 05 17:14:55.118058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 889/1651] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:55 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:56.085996 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-126325d9-9001-4477-afd3-74efb42b0634 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:56.087291 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-126325d9-9001-4477-afd3-74efb42b0634 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:56.098702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-126325d9-9001-4477-afd3-74efb42b0634 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:56.099548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-126325d9-9001-4477-afd3-74efb42b0634 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:56.100320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-126325d9-9001-4477-afd3-74efb42b0634 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:56.101228 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-126325d9-9001-4477-afd3-74efb42b0634 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:56.101672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-126325d9-9001-4477-afd3-74efb42b0634 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:56.102093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-126325d9-9001-4477-afd3-74efb42b0634 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:56.163679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-126325d9-9001-4477-afd3-74efb42b0634 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:56.171839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-126325d9-9001-4477-afd3-74efb42b0634 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093306 Sep 05 17:14:56.172449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 890/1652] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:56 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:56.177236 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b2293cdc-c72a-484d-8fea-463d5aa50381 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:56.179612 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b2293cdc-c72a-484d-8fea-463d5aa50381 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:56.185594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2293cdc-c72a-484d-8fea-463d5aa50381 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:56.186064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2293cdc-c72a-484d-8fea-463d5aa50381 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:56.186487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2293cdc-c72a-484d-8fea-463d5aa50381 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:56.187165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2293cdc-c72a-484d-8fea-463d5aa50381 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:56.187609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2293cdc-c72a-484d-8fea-463d5aa50381 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:56.188024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2293cdc-c72a-484d-8fea-463d5aa50381 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:56.218322 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b2293cdc-c72a-484d-8fea-463d5aa50381 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044873 Sep 05 17:14:56.218870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 891/1653] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:56 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:57.194081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bb87db53-87cb-45c6-a0e6-1edfc38376b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:57.194748 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bb87db53-87cb-45c6-a0e6-1edfc38376b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:57.201651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb87db53-87cb-45c6-a0e6-1edfc38376b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:57.202128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb87db53-87cb-45c6-a0e6-1edfc38376b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:57.202550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb87db53-87cb-45c6-a0e6-1edfc38376b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:57.203257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb87db53-87cb-45c6-a0e6-1edfc38376b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:57.203697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb87db53-87cb-45c6-a0e6-1edfc38376b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:57.204106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb87db53-87cb-45c6-a0e6-1edfc38376b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:57.268387 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bb87db53-87cb-45c6-a0e6-1edfc38376b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:57.277783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bb87db53-87cb-45c6-a0e6-1edfc38376b8 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087643 Sep 05 17:14:57.278385 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 892/1654] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:57 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:57.283008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c891a725-d009-4c35-8f10-95b8dd3480dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:57.285210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c891a725-d009-4c35-8f10-95b8dd3480dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:57.291886 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c891a725-d009-4c35-8f10-95b8dd3480dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:57.292051 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c891a725-d009-4c35-8f10-95b8dd3480dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:57.292402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c891a725-d009-4c35-8f10-95b8dd3480dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:57.293125 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c891a725-d009-4c35-8f10-95b8dd3480dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:57.293559 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c891a725-d009-4c35-8f10-95b8dd3480dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:57.293977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c891a725-d009-4c35-8f10-95b8dd3480dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:57.325690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c891a725-d009-4c35-8f10-95b8dd3480dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046162 Sep 05 17:14:57.326388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 893/1655] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:57 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:58.306573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ba49525e-a748-4c58-979d-55f4f5f70e6c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:58.307368 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ba49525e-a748-4c58-979d-55f4f5f70e6c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:58.314659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba49525e-a748-4c58-979d-55f4f5f70e6c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:58.315187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba49525e-a748-4c58-979d-55f4f5f70e6c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:58.315656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba49525e-a748-4c58-979d-55f4f5f70e6c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:58.316453 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba49525e-a748-4c58-979d-55f4f5f70e6c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:58.316945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba49525e-a748-4c58-979d-55f4f5f70e6c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:58.317400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba49525e-a748-4c58-979d-55f4f5f70e6c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:58.393047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ba49525e-a748-4c58-979d-55f4f5f70e6c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:58.401450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ba49525e-a748-4c58-979d-55f4f5f70e6c tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.101153 Sep 05 17:14:58.402032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 894/1656] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:58 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:58.406676 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fdf83d5f-bd20-4b13-80bb-bdba628fbc74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:58.408962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fdf83d5f-bd20-4b13-80bb-bdba628fbc74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:58.415041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdf83d5f-bd20-4b13-80bb-bdba628fbc74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:58.415487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdf83d5f-bd20-4b13-80bb-bdba628fbc74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:58.415920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdf83d5f-bd20-4b13-80bb-bdba628fbc74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:58.416679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdf83d5f-bd20-4b13-80bb-bdba628fbc74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:58.417110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdf83d5f-bd20-4b13-80bb-bdba628fbc74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:58.417532 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdf83d5f-bd20-4b13-80bb-bdba628fbc74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:58.450945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fdf83d5f-bd20-4b13-80bb-bdba628fbc74 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047889 Sep 05 17:14:58.451509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 895/1657] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:58 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:14:59.424816 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ab11c94a-7632-4f7b-bc26-75a9d9593369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:59.425510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ab11c94a-7632-4f7b-bc26-75a9d9593369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:59.432390 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab11c94a-7632-4f7b-bc26-75a9d9593369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:59.432877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab11c94a-7632-4f7b-bc26-75a9d9593369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:59.433307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab11c94a-7632-4f7b-bc26-75a9d9593369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:59.434003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab11c94a-7632-4f7b-bc26-75a9d9593369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:59.434450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab11c94a-7632-4f7b-bc26-75a9d9593369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:59.434878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab11c94a-7632-4f7b-bc26-75a9d9593369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:59.498006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ab11c94a-7632-4f7b-bc26-75a9d9593369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:14:59.506220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ab11c94a-7632-4f7b-bc26-75a9d9593369 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.085444 Sep 05 17:14:59.506813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 896/1658] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:14:59 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:14:59.511617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fcc294ab-517c-41ed-b7b4-52eb40b42237 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:14:59.513791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fcc294ab-517c-41ed-b7b4-52eb40b42237 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:14:59.519700 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcc294ab-517c-41ed-b7b4-52eb40b42237 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:59.520178 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcc294ab-517c-41ed-b7b4-52eb40b42237 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:59.520636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcc294ab-517c-41ed-b7b4-52eb40b42237 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:59.521325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcc294ab-517c-41ed-b7b4-52eb40b42237 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:14:59.521778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcc294ab-517c-41ed-b7b4-52eb40b42237 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:14:59.522198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcc294ab-517c-41ed-b7b4-52eb40b42237 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:14:59.551733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fcc294ab-517c-41ed-b7b4-52eb40b42237 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043917 Sep 05 17:14:59.552323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 897/1659] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:14:59 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:15:00.530442 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9dc895d3-82a4-4526-ab25-3278cdbb26f4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:00.531222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9dc895d3-82a4-4526-ab25-3278cdbb26f4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:00.537874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dc895d3-82a4-4526-ab25-3278cdbb26f4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:00.538368 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dc895d3-82a4-4526-ab25-3278cdbb26f4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:00.538796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dc895d3-82a4-4526-ab25-3278cdbb26f4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:00.539515 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dc895d3-82a4-4526-ab25-3278cdbb26f4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:00.540542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dc895d3-82a4-4526-ab25-3278cdbb26f4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:00.541031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dc895d3-82a4-4526-ab25-3278cdbb26f4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:00.610235 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9dc895d3-82a4-4526-ab25-3278cdbb26f4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:15:00.623018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9dc895d3-82a4-4526-ab25-3278cdbb26f4 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.096202 Sep 05 17:15:00.623965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 898/1660] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:15:00 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:15:00.631890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-15d3581e-072a-4f37-bb9c-c4bf03a1f297 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:00.635242 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-15d3581e-072a-4f37-bb9c-c4bf03a1f297 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:00.641568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15d3581e-072a-4f37-bb9c-c4bf03a1f297 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:00.642052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15d3581e-072a-4f37-bb9c-c4bf03a1f297 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:00.642484 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15d3581e-072a-4f37-bb9c-c4bf03a1f297 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:00.643181 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15d3581e-072a-4f37-bb9c-c4bf03a1f297 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:00.643631 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15d3581e-072a-4f37-bb9c-c4bf03a1f297 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:00.644051 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15d3581e-072a-4f37-bb9c-c4bf03a1f297 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:00.682053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-15d3581e-072a-4f37-bb9c-c4bf03a1f297 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056366 Sep 05 17:15:00.682898 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 899/1661] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:15:00 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:15:01.538837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:15:01.540680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:15:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 (ip 10.222.0.23) !!! Sep 05 17:15:01.647343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-61569b59-fc99-4b2f-96f3-9293f375a8d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:01.647964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-61569b59-fc99-4b2f-96f3-9293f375a8d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:01.650612 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:15:01.656095 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61569b59-fc99-4b2f-96f3-9293f375a8d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:01.656614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61569b59-fc99-4b2f-96f3-9293f375a8d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:01.657049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61569b59-fc99-4b2f-96f3-9293f375a8d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:01.657749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61569b59-fc99-4b2f-96f3-9293f375a8d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:01.658207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61569b59-fc99-4b2f-96f3-9293f375a8d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:01.658630 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61569b59-fc99-4b2f-96f3-9293f375a8d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:01.725859 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-61569b59-fc99-4b2f-96f3-9293f375a8d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:15:01.735275 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-61569b59-fc99-4b2f-96f3-9293f375a8d9 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.091911 Sep 05 17:15:01.735837 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 900/1662] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:15:01 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:15:01.740455 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d8aa78e9-77e8-4214-9475-9edda5bb75ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:01.742567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d8aa78e9-77e8-4214-9475-9edda5bb75ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:01.751571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8aa78e9-77e8-4214-9475-9edda5bb75ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:01.752045 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8aa78e9-77e8-4214-9475-9edda5bb75ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:01.752488 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8aa78e9-77e8-4214-9475-9edda5bb75ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:01.753643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8aa78e9-77e8-4214-9475-9edda5bb75ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:01.753643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8aa78e9-77e8-4214-9475-9edda5bb75ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:01.754009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8aa78e9-77e8-4214-9475-9edda5bb75ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:01.784637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d8aa78e9-77e8-4214-9475-9edda5bb75ab tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047683 Sep 05 17:15:01.785204 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 901/1663] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:15:01 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:15:02.249447 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-43b664ba-8828-4522-8272-d56e49190521 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:02.250098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-43b664ba-8828-4522-8272-d56e49190521 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:02.259139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43b664ba-8828-4522-8272-d56e49190521 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:02.259617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43b664ba-8828-4522-8272-d56e49190521 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:02.260050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43b664ba-8828-4522-8272-d56e49190521 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:02.260774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43b664ba-8828-4522-8272-d56e49190521 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:02.261228 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43b664ba-8828-4522-8272-d56e49190521 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:02.261651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43b664ba-8828-4522-8272-d56e49190521 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:02.286834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-43b664ba-8828-4522-8272-d56e49190521 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:15:02.339802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.compute.api [None req-43b664ba-8828-4522-8272-d56e49190521 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Instance is already in deleting state, ignoring this request Sep 05 17:15:02.340677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-43b664ba-8828-4522-8272-d56e49190521 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 204 len: 0 microversion: 2.1 time: 0.097213 Sep 05 17:15:02.341243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 902/1664] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:15:02 2022] DELETE /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:15:02.349792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-829ea3fa-d9e9-42d9-87c3-5b3e16b701fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:02.350398 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-829ea3fa-d9e9-42d9-87c3-5b3e16b701fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:02.356483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-829ea3fa-d9e9-42d9-87c3-5b3e16b701fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:02.357158 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-829ea3fa-d9e9-42d9-87c3-5b3e16b701fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:02.357603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-829ea3fa-d9e9-42d9-87c3-5b3e16b701fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:02.358295 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-829ea3fa-d9e9-42d9-87c3-5b3e16b701fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:02.358739 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-829ea3fa-d9e9-42d9-87c3-5b3e16b701fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:02.359155 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-829ea3fa-d9e9-42d9-87c3-5b3e16b701fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:02.361772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:15:02.427677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-829ea3fa-d9e9-42d9-87c3-5b3e16b701fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:15:02.436184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-829ea3fa-d9e9-42d9-87c3-5b3e16b701fd tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.090290 Sep 05 17:15:02.436795 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 903/1665] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:15:02 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:15:02.802112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f10f6c43-8899-4bfd-b51a-ce10c1940800 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:02.805581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f10f6c43-8899-4bfd-b51a-ce10c1940800 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:02.812694 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10f6c43-8899-4bfd-b51a-ce10c1940800 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:02.813186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10f6c43-8899-4bfd-b51a-ce10c1940800 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:02.813615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10f6c43-8899-4bfd-b51a-ce10c1940800 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:02.814304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10f6c43-8899-4bfd-b51a-ce10c1940800 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:02.814742 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10f6c43-8899-4bfd-b51a-ce10c1940800 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:02.815158 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10f6c43-8899-4bfd-b51a-ce10c1940800 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:02.846567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f10f6c43-8899-4bfd-b51a-ce10c1940800 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051335 Sep 05 17:15:02.847119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 904/1666] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:15:02 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:15:03.459425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bd26a67e-6e6d-4797-96df-78bbd924edc6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:03.459929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bd26a67e-6e6d-4797-96df-78bbd924edc6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:03.468229 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd26a67e-6e6d-4797-96df-78bbd924edc6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:03.468981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd26a67e-6e6d-4797-96df-78bbd924edc6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:03.469570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd26a67e-6e6d-4797-96df-78bbd924edc6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:03.470505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd26a67e-6e6d-4797-96df-78bbd924edc6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:03.470980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd26a67e-6e6d-4797-96df-78bbd924edc6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:03.471506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd26a67e-6e6d-4797-96df-78bbd924edc6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:03.539676 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bd26a67e-6e6d-4797-96df-78bbd924edc6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:15:03.547950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bd26a67e-6e6d-4797-96df-78bbd924edc6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.092661 Sep 05 17:15:03.548562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 905/1667] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:15:03 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:15:03.859568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-df2b81fd-69d2-4f3a-a5d3-9f3637a55531 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:03.861809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-df2b81fd-69d2-4f3a-a5d3-9f3637a55531 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:03.869101 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df2b81fd-69d2-4f3a-a5d3-9f3637a55531 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:03.869580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df2b81fd-69d2-4f3a-a5d3-9f3637a55531 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:03.870003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df2b81fd-69d2-4f3a-a5d3-9f3637a55531 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:03.870693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df2b81fd-69d2-4f3a-a5d3-9f3637a55531 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:03.871139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df2b81fd-69d2-4f3a-a5d3-9f3637a55531 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:03.871554 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df2b81fd-69d2-4f3a-a5d3-9f3637a55531 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:03.902607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-df2b81fd-69d2-4f3a-a5d3-9f3637a55531 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047150 Sep 05 17:15:03.903463 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 906/1668] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:15:03 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:15:04.573495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8549c64d-619d-464c-845f-5c3eeab0dc93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:04.574112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8549c64d-619d-464c-845f-5c3eeab0dc93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:04.580645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8549c64d-619d-464c-845f-5c3eeab0dc93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:04.581148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8549c64d-619d-464c-845f-5c3eeab0dc93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:04.581579 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8549c64d-619d-464c-845f-5c3eeab0dc93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:04.582267 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8549c64d-619d-464c-845f-5c3eeab0dc93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:04.582717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8549c64d-619d-464c-845f-5c3eeab0dc93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:04.583135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8549c64d-619d-464c-845f-5c3eeab0dc93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:04.646840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8549c64d-619d-464c-845f-5c3eeab0dc93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:15:04.655022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8549c64d-619d-464c-845f-5c3eeab0dc93 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.086895 Sep 05 17:15:04.655591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 907/1669] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:15:04 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:15:04.920759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-08c03616-4797-4376-a2ba-41c368ee03d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:04.924186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-08c03616-4797-4376-a2ba-41c368ee03d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:04.933413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08c03616-4797-4376-a2ba-41c368ee03d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:04.933893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08c03616-4797-4376-a2ba-41c368ee03d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:04.934319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08c03616-4797-4376-a2ba-41c368ee03d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:04.935005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08c03616-4797-4376-a2ba-41c368ee03d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:04.935454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08c03616-4797-4376-a2ba-41c368ee03d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:04.935868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08c03616-4797-4376-a2ba-41c368ee03d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:04.966284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-08c03616-4797-4376-a2ba-41c368ee03d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053216 Sep 05 17:15:04.966835 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 908/1670] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:15:04 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:15:05.452911 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.objects.instance [None req-feb7f353-83f7-4d06-bf00-8be8e51c7d35 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lazy-loading 'services' on Instance uuid cba4a1fa-a126-4e6b-9ac4-32290e275435 {{(pid=120733) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:15:05.679639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-777a651d-37f7-4b59-8306-0eabfd90a28b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:05.680633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-777a651d-37f7-4b59-8306-0eabfd90a28b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:05.687127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-777a651d-37f7-4b59-8306-0eabfd90a28b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:05.687614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-777a651d-37f7-4b59-8306-0eabfd90a28b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:05.688049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-777a651d-37f7-4b59-8306-0eabfd90a28b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:05.688785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-777a651d-37f7-4b59-8306-0eabfd90a28b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:05.689239 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-777a651d-37f7-4b59-8306-0eabfd90a28b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:05.689667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-777a651d-37f7-4b59-8306-0eabfd90a28b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:05.762012 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-777a651d-37f7-4b59-8306-0eabfd90a28b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:15:05.769980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-777a651d-37f7-4b59-8306-0eabfd90a28b tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.095686 Sep 05 17:15:05.770565 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 909/1671] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:15:05 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:15:05.984115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-961a770b-eb0f-4f29-b9cc-35405700f3e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:05.987491 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-961a770b-eb0f-4f29-b9cc-35405700f3e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:05.998690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-961a770b-eb0f-4f29-b9cc-35405700f3e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:05.999497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-961a770b-eb0f-4f29-b9cc-35405700f3e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:06.000199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-961a770b-eb0f-4f29-b9cc-35405700f3e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:06.001409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-961a770b-eb0f-4f29-b9cc-35405700f3e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:06.002203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-961a770b-eb0f-4f29-b9cc-35405700f3e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:06.002877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-961a770b-eb0f-4f29-b9cc-35405700f3e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:06.035691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-961a770b-eb0f-4f29-b9cc-35405700f3e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058739 Sep 05 17:15:06.036264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 910/1672] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:15:05 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:15:06.794019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a6d3364b-9b59-46c1-83a7-1817261956c2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:06.794530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a6d3364b-9b59-46c1-83a7-1817261956c2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:06.800976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6d3364b-9b59-46c1-83a7-1817261956c2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:06.801449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6d3364b-9b59-46c1-83a7-1817261956c2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:06.801875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6d3364b-9b59-46c1-83a7-1817261956c2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:06.802562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6d3364b-9b59-46c1-83a7-1817261956c2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:06.803010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6d3364b-9b59-46c1-83a7-1817261956c2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:06.803425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6d3364b-9b59-46c1-83a7-1817261956c2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:06.871185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a6d3364b-9b59-46c1-83a7-1817261956c2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:15:06.879429 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a6d3364b-9b59-46c1-83a7-1817261956c2 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.090064 Sep 05 17:15:06.879963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 911/1673] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:15:06 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:15:07.054618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-04053751-a860-40bf-9442-6e1984d54cd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:07.058545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-04053751-a860-40bf-9442-6e1984d54cd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:07.068626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04053751-a860-40bf-9442-6e1984d54cd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:07.069534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04053751-a860-40bf-9442-6e1984d54cd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:07.070139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04053751-a860-40bf-9442-6e1984d54cd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:07.071122 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04053751-a860-40bf-9442-6e1984d54cd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:07.071897 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04053751-a860-40bf-9442-6e1984d54cd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:07.072667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04053751-a860-40bf-9442-6e1984d54cd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:07.103468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-04053751-a860-40bf-9442-6e1984d54cd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057674 Sep 05 17:15:07.104029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 912/1674] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:15:07 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:15:07.906592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ff569f29-b4ce-4e26-b08d-70a232f4f5a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:07.907594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ff569f29-b4ce-4e26-b08d-70a232f4f5a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:07.918367 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff569f29-b4ce-4e26-b08d-70a232f4f5a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:07.919212 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff569f29-b4ce-4e26-b08d-70a232f4f5a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:07.919919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff569f29-b4ce-4e26-b08d-70a232f4f5a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:07.921093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff569f29-b4ce-4e26-b08d-70a232f4f5a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:07.921833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff569f29-b4ce-4e26-b08d-70a232f4f5a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:07.922523 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff569f29-b4ce-4e26-b08d-70a232f4f5a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:07.989762 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ff569f29-b4ce-4e26-b08d-70a232f4f5a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:15:07.998033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ff569f29-b4ce-4e26-b08d-70a232f4f5a6 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.098239 Sep 05 17:15:07.998592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 913/1675] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:15:07 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:15:08.116955 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-61a277d6-b14f-4017-a698-0fa8bd4d886c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:08.119307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-61a277d6-b14f-4017-a698-0fa8bd4d886c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:08.126820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61a277d6-b14f-4017-a698-0fa8bd4d886c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:08.127379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61a277d6-b14f-4017-a698-0fa8bd4d886c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:08.127855 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61a277d6-b14f-4017-a698-0fa8bd4d886c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:08.128683 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61a277d6-b14f-4017-a698-0fa8bd4d886c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:08.129179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61a277d6-b14f-4017-a698-0fa8bd4d886c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:08.129640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61a277d6-b14f-4017-a698-0fa8bd4d886c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:08.160195 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-61a277d6-b14f-4017-a698-0fa8bd4d886c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047510 Sep 05 17:15:08.160685 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 914/1676] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:15:08 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:15:09.025430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ac38c02b-42c5-48aa-8435-4c99d2b3551a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:09.026388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ac38c02b-42c5-48aa-8435-4c99d2b3551a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:09.037142 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac38c02b-42c5-48aa-8435-4c99d2b3551a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:09.037965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac38c02b-42c5-48aa-8435-4c99d2b3551a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:09.038698 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac38c02b-42c5-48aa-8435-4c99d2b3551a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:09.039817 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac38c02b-42c5-48aa-8435-4c99d2b3551a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:09.040718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac38c02b-42c5-48aa-8435-4c99d2b3551a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:09.041087 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac38c02b-42c5-48aa-8435-4c99d2b3551a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:09.104203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ac38c02b-42c5-48aa-8435-4c99d2b3551a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:15:09.112182 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ac38c02b-42c5-48aa-8435-4c99d2b3551a tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.093467 Sep 05 17:15:09.112754 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 915/1677] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:15:09 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:15:09.176684 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b31552e2-f605-4993-9f9f-5fa62dabe84b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:09.180207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b31552e2-f605-4993-9f9f-5fa62dabe84b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:09.191489 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b31552e2-f605-4993-9f9f-5fa62dabe84b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:09.192326 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b31552e2-f605-4993-9f9f-5fa62dabe84b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:09.193082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b31552e2-f605-4993-9f9f-5fa62dabe84b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:09.194212 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b31552e2-f605-4993-9f9f-5fa62dabe84b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:09.194975 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b31552e2-f605-4993-9f9f-5fa62dabe84b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:09.195654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b31552e2-f605-4993-9f9f-5fa62dabe84b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:09.226876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b31552e2-f605-4993-9f9f-5fa62dabe84b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056613 Sep 05 17:15:09.227384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 916/1678] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:15:09 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:15:10.139854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d0b69fba-14e9-4973-a7f3-ad1ef20d904e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:10.140950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d0b69fba-14e9-4973-a7f3-ad1ef20d904e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:10.151281 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0b69fba-14e9-4973-a7f3-ad1ef20d904e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:10.151766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0b69fba-14e9-4973-a7f3-ad1ef20d904e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:10.152196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0b69fba-14e9-4973-a7f3-ad1ef20d904e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:10.152920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0b69fba-14e9-4973-a7f3-ad1ef20d904e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:10.153369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0b69fba-14e9-4973-a7f3-ad1ef20d904e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:10.153790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0b69fba-14e9-4973-a7f3-ad1ef20d904e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:10.227884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d0b69fba-14e9-4973-a7f3-ad1ef20d904e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:15:10.236466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d0b69fba-14e9-4973-a7f3-ad1ef20d904e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.103496 Sep 05 17:15:10.237006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 917/1679] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:15:10 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:15:10.241526 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b6858337-88c0-43fd-a5d7-4afefa19bea3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:10.244043 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b6858337-88c0-43fd-a5d7-4afefa19bea3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:10.250020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6858337-88c0-43fd-a5d7-4afefa19bea3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:10.250496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6858337-88c0-43fd-a5d7-4afefa19bea3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:10.250922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6858337-88c0-43fd-a5d7-4afefa19bea3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:10.251615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6858337-88c0-43fd-a5d7-4afefa19bea3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:10.252133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6858337-88c0-43fd-a5d7-4afefa19bea3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:10.252583 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6858337-88c0-43fd-a5d7-4afefa19bea3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:10.281353 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b6858337-88c0-43fd-a5d7-4afefa19bea3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043323 Sep 05 17:15:10.281911 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 918/1680] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:15:10 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:15:11.261919 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ca42bd23-18ad-4382-b65c-fbdab2220047 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:11.262659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ca42bd23-18ad-4382-b65c-fbdab2220047 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:11.269347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca42bd23-18ad-4382-b65c-fbdab2220047 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:11.269833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca42bd23-18ad-4382-b65c-fbdab2220047 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:11.270251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca42bd23-18ad-4382-b65c-fbdab2220047 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:11.270928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca42bd23-18ad-4382-b65c-fbdab2220047 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:11.271371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca42bd23-18ad-4382-b65c-fbdab2220047 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:11.271796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca42bd23-18ad-4382-b65c-fbdab2220047 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:11.335152 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ca42bd23-18ad-4382-b65c-fbdab2220047 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:15:11.337786 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:15:11.344638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ca42bd23-18ad-4382-b65c-fbdab2220047 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087756 Sep 05 17:15:11.345183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 919/1681] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:15:11 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:15:11.350257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b6a0a90c-b588-4f53-8ace-a22f49261802 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:11.352541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b6a0a90c-b588-4f53-8ace-a22f49261802 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:11.358651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6a0a90c-b588-4f53-8ace-a22f49261802 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:11.359121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6a0a90c-b588-4f53-8ace-a22f49261802 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:11.359544 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6a0a90c-b588-4f53-8ace-a22f49261802 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:11.360249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6a0a90c-b588-4f53-8ace-a22f49261802 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:11.360693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6a0a90c-b588-4f53-8ace-a22f49261802 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:11.361102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6a0a90c-b588-4f53-8ace-a22f49261802 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:11.391171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b6a0a90c-b588-4f53-8ace-a22f49261802 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044929 Sep 05 17:15:11.391702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 920/1682] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:15:11 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:15:11.396241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-49f104c1-b4d4-436c-b8c4-268ed5040d77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:15:11.396701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-49f104c1-b4d4-436c-b8c4-268ed5040d77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:15:11.402382 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49f104c1-b4d4-436c-b8c4-268ed5040d77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:11.402848 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49f104c1-b4d4-436c-b8c4-268ed5040d77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:11.403272 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49f104c1-b4d4-436c-b8c4-268ed5040d77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:11.403946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49f104c1-b4d4-436c-b8c4-268ed5040d77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:15:11.404421 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49f104c1-b4d4-436c-b8c4-268ed5040d77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:15:11.404832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49f104c1-b4d4-436c-b8c4-268ed5040d77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:15:15.457055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=4 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:15:20.621499 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:15:20.622463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:15:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 (ip 10.222.0.23) !!! Sep 05 17:15:21.400543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=43 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:15:21.423238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=11 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:16:11.344541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-feb7f353-83f7-4d06-bf00-8be8e51c7d35 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748" status: 202 len: 0 microversion: 2.1 time: 120.027656 Sep 05 17:16:11.345186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 763/1683] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Sep 5 17:14:11 2022] DELETE /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 => generated 0 bytes in 120029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:16:11.351555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1f5db955-6d84-4854-829f-6e8828c4934e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:16:11.352318 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1f5db955-6d84-4854-829f-6e8828c4934e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:16:11.360808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f5db955-6d84-4854-829f-6e8828c4934e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:16:11.361318 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f5db955-6d84-4854-829f-6e8828c4934e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:16:11.361797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f5db955-6d84-4854-829f-6e8828c4934e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:16:11.362477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f5db955-6d84-4854-829f-6e8828c4934e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:16:11.362925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f5db955-6d84-4854-829f-6e8828c4934e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:16:11.363340 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1f5db955-6d84-4854-829f-6e8828c4934e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:16:11.433214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1f5db955-6d84-4854-829f-6e8828c4934e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:16:11.445884 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1f5db955-6d84-4854-829f-6e8828c4934e tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.099550 Sep 05 17:16:11.446436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 764/1684] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:16:11 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:16:11.452489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-90bc0c6d-02ae-43f5-a0c9-77742b33290d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:16:11.454709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-90bc0c6d-02ae-43f5-a0c9-77742b33290d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:16:11.463632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90bc0c6d-02ae-43f5-a0c9-77742b33290d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:16:11.464338 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90bc0c6d-02ae-43f5-a0c9-77742b33290d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:16:11.465174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90bc0c6d-02ae-43f5-a0c9-77742b33290d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:16:11.465916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90bc0c6d-02ae-43f5-a0c9-77742b33290d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:16:11.466358 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90bc0c6d-02ae-43f5-a0c9-77742b33290d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:16:11.466771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90bc0c6d-02ae-43f5-a0c9-77742b33290d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:16:11.475562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-49f104c1-b4d4-436c-b8c4-268ed5040d77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lazy-loading 'services' on Instance uuid cba4a1fa-a126-4e6b-9ac4-32290e275435 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:16:11.501843 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-90bc0c6d-02ae-43f5-a0c9-77742b33290d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054361 Sep 05 17:16:11.502420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 765/1685] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:16:11 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:16:11.507059 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-43513764-670f-4901-b44b-b4137a30bcec tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:16:11.507548 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-43513764-670f-4901-b44b-b4137a30bcec tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:16:11.513809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43513764-670f-4901-b44b-b4137a30bcec tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:16:11.514303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43513764-670f-4901-b44b-b4137a30bcec tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:16:11.514823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43513764-670f-4901-b44b-b4137a30bcec tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:16:11.515414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43513764-670f-4901-b44b-b4137a30bcec tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:16:11.515984 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43513764-670f-4901-b44b-b4137a30bcec tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:16:11.516432 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43513764-670f-4901-b44b-b4137a30bcec tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:16:11.540912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-43513764-670f-4901-b44b-b4137a30bcec tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73/ips" status: 200 len: 150 microversion: 2.1 time: 0.037345 Sep 05 17:16:11.541420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 766/1686] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Sep 5 17:16:11 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:16:11.546151 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-769c737e-634b-4611-95eb-590febc6e660 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:16:11.546637 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-769c737e-634b-4611-95eb-590febc6e660 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:16:11.552486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-769c737e-634b-4611-95eb-590febc6e660 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:16:11.552968 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-769c737e-634b-4611-95eb-590febc6e660 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:16:11.553399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-769c737e-634b-4611-95eb-590febc6e660 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:16:11.554089 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-769c737e-634b-4611-95eb-590febc6e660 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:16:11.554776 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-769c737e-634b-4611-95eb-590febc6e660 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:16:11.555236 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-769c737e-634b-4611-95eb-590febc6e660 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:16:21.482958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=4 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:16:21.551080 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=8 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:16:21.575805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:16:41.654024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:16:41.654992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:16:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 (ip 10.222.0.23) !!! Sep 05 17:16:45.994583 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:16:45.995648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:16:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 (ip 10.222.0.23) !!! Sep 05 17:17:00.060965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:17:00.062153 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:17:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 (ip 10.222.0.23) !!! Sep 05 17:17:05.728520 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-49f104c1-b4d4-436c-b8c4-268ed5040d77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95d621ff-668f-4e09-994d-4ce396b7c892) Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-49f104c1-b4d4-436c-b8c4-268ed5040d77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Request method failure captured: Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 HTTP/1.1 Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFiv047nns6uD-wGeK0APYfmPcpVx3CCKv5sjmDl9k5BfSQQcGDjxae1Hoku_TFUfk_UjneJKy_7-R4qOOvWRCP-6IunVIGnx5AiCwIGQh3yw7DnLIg4vTUMAQo_JWV0Oz6P6VXKWsBRDRxjCAKXg6e6hyMEC2vWV5yjpuZDQ8EY9oAs Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: 375cd031a57847ed99991340bf65d3d3 Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-VolumesSnapshotTestJSON-437066400 Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:17:05.730929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:17:05.732497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/375cd031a57847ed99991340bf65d3d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/375cd031a57847ed99991340bf65d3d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/375cd031a57847ed99991340bf65d3d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_375cd031a57847ed99991340bf65d3d3"}]}] Sep 05 17:17:05.732497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-VolumesSnapshotTestJSON-437066400 Sep 05 17:17:05.732497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 375cd031a57847ed99991340bf65d3d3 Sep 05 17:17:05.732497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-437066400 Sep 05 17:17:05.732497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-VolumesSnapshotTestJSON-437066400-project Sep 05 17:17:05.732497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:17:05.732497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:17:05.732497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: dc83779cc4e54be794873d62e3ac9061 Sep 05 17:17:05.732497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-VolumesSnapshotTestJSON-437066400-project Sep 05 17:17:05.732497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95d621ff-668f-4e09-994d-4ce396b7c892) Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'server_id': 'cba4a1fa-a126-4e6b-9ac4-32290e275435', 'id': 'd9048c06-9ac3-455a-91d4-52977e0f0748'} Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 17:17:05.733150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95d621ff-668f-4e09-994d-4ce396b7c892) Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:17:05.734318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95d621ff-668f-4e09-994d-4ce396b7c892) Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:17:05.735760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95d621ff-668f-4e09-994d-4ce396b7c892) Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:17:05.736858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95d621ff-668f-4e09-994d-4ce396b7c892) Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95d621ff-668f-4e09-994d-4ce396b7c892) Sep 05 17:17:05.738127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:17:05.739316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-49f104c1-b4d4-436c-b8c4-268ed5040d77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95d621ff-668f-4e09-994d-4ce396b7c892) {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:17:05.739316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-49f104c1-b4d4-436c-b8c4-268ed5040d77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748" status: 400 len: 269 microversion: 2.1 time: 114.339864 Sep 05 17:17:05.739316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 921/1687] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Sep 5 17:15:11 2022] DELETE /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 => generated 269 bytes in 114341 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 17:17:05.739316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ef7e6491-2200-49cb-a2fb-d98a1d697f25 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:17:05.739633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ef7e6491-2200-49cb-a2fb-d98a1d697f25 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:17:05.745539 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef7e6491-2200-49cb-a2fb-d98a1d697f25 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:17:05.746025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef7e6491-2200-49cb-a2fb-d98a1d697f25 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:17:05.746571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef7e6491-2200-49cb-a2fb-d98a1d697f25 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:17:05.747251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef7e6491-2200-49cb-a2fb-d98a1d697f25 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:17:05.747702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef7e6491-2200-49cb-a2fb-d98a1d697f25 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:17:05.748119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef7e6491-2200-49cb-a2fb-d98a1d697f25 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:17:05.810680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ef7e6491-2200-49cb-a2fb-d98a1d697f25 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:17:05.818385 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ef7e6491-2200-49cb-a2fb-d98a1d697f25 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.084330 Sep 05 17:17:05.818920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 922/1688] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:17:05 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:17:05.986019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-76353f5c-48d6-4cbe-9de8-63b68f55c442 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:17:05.986809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-76353f5c-48d6-4cbe-9de8-63b68f55c442 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:17:05.992883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76353f5c-48d6-4cbe-9de8-63b68f55c442 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:17:05.993357 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76353f5c-48d6-4cbe-9de8-63b68f55c442 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:17:05.993788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76353f5c-48d6-4cbe-9de8-63b68f55c442 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:17:05.994477 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76353f5c-48d6-4cbe-9de8-63b68f55c442 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:17:05.995134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76353f5c-48d6-4cbe-9de8-63b68f55c442 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:17:05.995552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76353f5c-48d6-4cbe-9de8-63b68f55c442 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:17:06.055042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.objects.instance [None req-769c737e-634b-4611-95eb-590febc6e660 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lazy-loading 'services' on Instance uuid cba4a1fa-a126-4e6b-9ac4-32290e275435 {{(pid=120733) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:17:06.101902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-76353f5c-48d6-4cbe-9de8-63b68f55c442 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "POST /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/action" status: 200 len: 82099 microversion: 2.1 time: 0.267490 Sep 05 17:17:06.102855 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 923/1689] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Sep 5 17:17:05 2022] POST /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/action => generated 82099 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:17:06.119362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-452c0ed3-5d64-461b-ae7e-b05f7612d934 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:17:06.120276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-452c0ed3-5d64-461b-ae7e-b05f7612d934 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:17:06.128274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-452c0ed3-5d64-461b-ae7e-b05f7612d934 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:17:06.128754 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-452c0ed3-5d64-461b-ae7e-b05f7612d934 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:17:06.129179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-452c0ed3-5d64-461b-ae7e-b05f7612d934 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:17:06.129864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-452c0ed3-5d64-461b-ae7e-b05f7612d934 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:17:06.130304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-452c0ed3-5d64-461b-ae7e-b05f7612d934 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:17:06.130715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-452c0ed3-5d64-461b-ae7e-b05f7612d934 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:17:16.060588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=4 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:17:16.125731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=6 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:17:16.153186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=14 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:17:57.073413 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:17:57.074449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:17:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 (ip 10.222.0.23) !!! Sep 05 17:18:11.716212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-769c737e-634b-4611-95eb-590febc6e660 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f75ddbc-534a-43cf-8e35-30bc89f7ffbb) Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-769c737e-634b-4611-95eb-590febc6e660 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Request method failure captured: Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: DELETE /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 HTTP/1.1 Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFiv047nns6uD-wGeK0APYfmPcpVx3CCKv5sjmDl9k5BfSQQcGDjxae1Hoku_TFUfk_UjneJKy_7-R4qOOvWRCP-6IunVIGnx5AiCwIGQh3yw7DnLIg4vTUMAQo_JWV0Oz6P6VXKWsBRDRxjCAKXg6e6hyMEC2vWV5yjpuZDQ8EY9oAs Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: 375cd031a57847ed99991340bf65d3d3 Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-VolumesSnapshotTestJSON-437066400 Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:18:11.719073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:18:11.720923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/375cd031a57847ed99991340bf65d3d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/375cd031a57847ed99991340bf65d3d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/375cd031a57847ed99991340bf65d3d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_375cd031a57847ed99991340bf65d3d3"}]}] Sep 05 17:18:11.720923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-VolumesSnapshotTestJSON-437066400 Sep 05 17:18:11.720923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: 375cd031a57847ed99991340bf65d3d3 Sep 05 17:18:11.720923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-437066400 Sep 05 17:18:11.720923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-VolumesSnapshotTestJSON-437066400-project Sep 05 17:18:11.720923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:18:11.720923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:18:11.720923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: dc83779cc4e54be794873d62e3ac9061 Sep 05 17:18:11.720923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-VolumesSnapshotTestJSON-437066400-project Sep 05 17:18:11.720923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f75ddbc-534a-43cf-8e35-30bc89f7ffbb) Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'server_id': 'cba4a1fa-a126-4e6b-9ac4-32290e275435', 'id': 'd9048c06-9ac3-455a-91d4-52977e0f0748'} Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 17:18:11.721773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f75ddbc-534a-43cf-8e35-30bc89f7ffbb) Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:18:11.724822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f75ddbc-534a-43cf-8e35-30bc89f7ffbb) Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:18:11.726414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f75ddbc-534a-43cf-8e35-30bc89f7ffbb) Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:18:11.727748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f75ddbc-534a-43cf-8e35-30bc89f7ffbb) Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f75ddbc-534a-43cf-8e35-30bc89f7ffbb) Sep 05 17:18:11.729378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:18:11.730886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-769c737e-634b-4611-95eb-590febc6e660 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f75ddbc-534a-43cf-8e35-30bc89f7ffbb) {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:18:11.730886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-769c737e-634b-4611-95eb-590febc6e660 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748" status: 400 len: 269 microversion: 2.1 time: 120.178071 Sep 05 17:18:11.730886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 767/1690] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Sep 5 17:16:11 2022] DELETE /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 => generated 269 bytes in 120179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 17:18:11.730886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-75de3ade-5ad4-4cca-b56f-dc5c1ed909fa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:18:11.731534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-75de3ade-5ad4-4cca-b56f-dc5c1ed909fa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:18:11.733437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-75de3ade-5ad4-4cca-b56f-dc5c1ed909fa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:18:11.733914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-75de3ade-5ad4-4cca-b56f-dc5c1ed909fa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:18:11.734336 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-75de3ade-5ad4-4cca-b56f-dc5c1ed909fa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:18:11.735081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-75de3ade-5ad4-4cca-b56f-dc5c1ed909fa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:18:11.735524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-75de3ade-5ad4-4cca-b56f-dc5c1ed909fa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:18:11.736063 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-75de3ade-5ad4-4cca-b56f-dc5c1ed909fa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:18:11.765994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-452c0ed3-5d64-461b-ae7e-b05f7612d934 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lazy-loading 'services' on Instance uuid c8c420ca-19c4-4f51-8091-e83672ea54ca {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:18:11.801899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-75de3ade-5ad4-4cca-b56f-dc5c1ed909fa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:18:11.809868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-75de3ade-5ad4-4cca-b56f-dc5c1ed909fa tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1226 microversion: 2.1 time: 0.087707 Sep 05 17:18:11.810421 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 768/1691] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:18:11 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:18:11.815028 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b2fe427c-71b8-4cd0-b8f2-451e726fd41c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:18:11.815504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b2fe427c-71b8-4cd0-b8f2-451e726fd41c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:18:11.821168 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b2fe427c-71b8-4cd0-b8f2-451e726fd41c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:18:11.821642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b2fe427c-71b8-4cd0-b8f2-451e726fd41c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:18:11.822063 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b2fe427c-71b8-4cd0-b8f2-451e726fd41c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:18:11.822733 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b2fe427c-71b8-4cd0-b8f2-451e726fd41c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:18:11.823176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b2fe427c-71b8-4cd0-b8f2-451e726fd41c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:18:11.823586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b2fe427c-71b8-4cd0-b8f2-451e726fd41c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:18:21.553761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:18:21.555267 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:18:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 (ip 10.222.0.23) !!! Sep 05 17:18:21.778732 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=4 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:18:21.818591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=4 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:18:21.843637 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=10 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:18:40.637789 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:18:40.638863 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:18:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 (ip 10.222.0.23) !!! Sep 05 17:19:06.215856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-452c0ed3-5d64-461b-ae7e-b05f7612d934 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0f5ec92f-325e-4718-996c-dcf5e764227c) Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-452c0ed3-5d64-461b-ae7e-b05f7612d934 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Request method failure captured: Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments/845219e9-5e7d-4f7d-97f1-99b468c4eca7 HTTP/1.1 Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFiyD5q4nbQUUUlfkHiG44biV1s4pkm__-yWwjZJzHdBuTk1hh8VBqq5PlVcY3Dx9EJWjE5iQo7m7J9jupQP1XT1XzEvJBBnRrYRoVc2szDFE0uKgLkYJyznGa5Tfi4X7dsb3VTaS5AtCn5AZhwlqO7-duSw28k6au-bfwahHNQC8pe4 Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: 0b2e9de2e0a64e67beb01dc673c653e5 Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-TestMinimumBasicScenario-1817762964 Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:19:06.218253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:19:06.220709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0b2e9de2e0a64e67beb01dc673c653e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b2e9de2e0a64e67beb01dc673c653e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b2e9de2e0a64e67beb01dc673c653e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0b2e9de2e0a64e67beb01dc673c653e5"}]}] Sep 05 17:19:06.220709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-TestMinimumBasicScenario-1817762964 Sep 05 17:19:06.220709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 0b2e9de2e0a64e67beb01dc673c653e5 Sep 05 17:19:06.220709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1817762964 Sep 05 17:19:06.220709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-TestMinimumBasicScenario-1817762964-project Sep 05 17:19:06.220709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:19:06.220709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:19:06.220709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: c8b8aa2ae43a4d89ad579a5fdd87d564 Sep 05 17:19:06.220709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-TestMinimumBasicScenario-1817762964-project Sep 05 17:19:06.220709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0f5ec92f-325e-4718-996c-dcf5e764227c) Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'server_id': 'c8c420ca-19c4-4f51-8091-e83672ea54ca', 'id': '845219e9-5e7d-4f7d-97f1-99b468c4eca7'} Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 17:19:06.222276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0f5ec92f-325e-4718-996c-dcf5e764227c) Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:19:06.223925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0f5ec92f-325e-4718-996c-dcf5e764227c) Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.225714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0f5ec92f-325e-4718-996c-dcf5e764227c) Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:19:06.226871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0f5ec92f-325e-4718-996c-dcf5e764227c) Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0f5ec92f-325e-4718-996c-dcf5e764227c) Sep 05 17:19:06.228039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.231471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-452c0ed3-5d64-461b-ae7e-b05f7612d934 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0f5ec92f-325e-4718-996c-dcf5e764227c) {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:19:06.231471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-452c0ed3-5d64-461b-ae7e-b05f7612d934 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments/845219e9-5e7d-4f7d-97f1-99b468c4eca7" status: 400 len: 269 microversion: 2.1 time: 120.106261 Sep 05 17:19:06.231471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 924/1692] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Sep 5 17:17:06 2022] DELETE /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments/845219e9-5e7d-4f7d-97f1-99b468c4eca7 => generated 269 bytes in 120108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 05 17:19:06.231471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2d9df591-675b-44d8-885d-dfb9157e7b34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:19:06.231854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2d9df591-675b-44d8-885d-dfb9157e7b34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:19:06.238571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d9df591-675b-44d8-885d-dfb9157e7b34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:19:06.239423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d9df591-675b-44d8-885d-dfb9157e7b34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:19:06.239871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d9df591-675b-44d8-885d-dfb9157e7b34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:19:06.240642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d9df591-675b-44d8-885d-dfb9157e7b34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:19:06.241329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d9df591-675b-44d8-885d-dfb9157e7b34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:19:06.242473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d9df591-675b-44d8-885d-dfb9157e7b34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:19:06.283985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.objects.instance [None req-b2fe427c-71b8-4cd0-b8f2-451e726fd41c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lazy-loading 'services' on Instance uuid cba4a1fa-a126-4e6b-9ac4-32290e275435 {{(pid=120733) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:19:06.477757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-2d9df591-675b-44d8-885d-dfb9157e7b34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lazy-loading 'services' on Instance uuid c8c420ca-19c4-4f51-8091-e83672ea54ca {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:19:06.515538 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-b2fe427c-71b8-4cd0-b8f2-451e726fd41c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d0298329-f4f4-4071-818d-70c2202412e1) Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b2fe427c-71b8-4cd0-b8f2-451e726fd41c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Request method failure captured: Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: DELETE /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 HTTP/1.1 Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFiv047nns6uD-wGeK0APYfmPcpVx3CCKv5sjmDl9k5BfSQQcGDjxae1Hoku_TFUfk_UjneJKy_7-R4qOOvWRCP-6IunVIGnx5AiCwIGQh3yw7DnLIg4vTUMAQo_JWV0Oz6P6VXKWsBRDRxjCAKXg6e6hyMEC2vWV5yjpuZDQ8EY9oAs Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: 375cd031a57847ed99991340bf65d3d3 Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-VolumesSnapshotTestJSON-437066400 Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:19:06.517886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:19:06.520126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/375cd031a57847ed99991340bf65d3d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/375cd031a57847ed99991340bf65d3d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/375cd031a57847ed99991340bf65d3d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_375cd031a57847ed99991340bf65d3d3"}]}] Sep 05 17:19:06.520126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-VolumesSnapshotTestJSON-437066400 Sep 05 17:19:06.520126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: 375cd031a57847ed99991340bf65d3d3 Sep 05 17:19:06.520126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-437066400 Sep 05 17:19:06.520126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-VolumesSnapshotTestJSON-437066400-project Sep 05 17:19:06.520126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:19:06.520126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:19:06.520126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: dc83779cc4e54be794873d62e3ac9061 Sep 05 17:19:06.520126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-VolumesSnapshotTestJSON-437066400-project Sep 05 17:19:06.520126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d0298329-f4f4-4071-818d-70c2202412e1) Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'server_id': 'cba4a1fa-a126-4e6b-9ac4-32290e275435', 'id': 'd9048c06-9ac3-455a-91d4-52977e0f0748'} Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 17:19:06.521233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d0298329-f4f4-4071-818d-70c2202412e1) Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:19:06.522468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d0298329-f4f4-4071-818d-70c2202412e1) Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.524075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d0298329-f4f4-4071-818d-70c2202412e1) Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:19:06.525176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d0298329-f4f4-4071-818d-70c2202412e1) Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d0298329-f4f4-4071-818d-70c2202412e1) Sep 05 17:19:06.526542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.531953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b2fe427c-71b8-4cd0-b8f2-451e726fd41c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d0298329-f4f4-4071-818d-70c2202412e1) {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:19:06.531953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b2fe427c-71b8-4cd0-b8f2-451e726fd41c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748" status: 400 len: 269 microversion: 2.1 time: 54.708831 Sep 05 17:19:06.531953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 769/1693] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Sep 5 17:18:11 2022] DELETE /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 => generated 269 bytes in 54711 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 17:19:06.531953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9b0b5af2-9d89-4386-bf93-a5123a5b7572 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:19:06.532821 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9b0b5af2-9d89-4386-bf93-a5123a5b7572 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:19:06.534870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9b0b5af2-9d89-4386-bf93-a5123a5b7572 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:19:06.535357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9b0b5af2-9d89-4386-bf93-a5123a5b7572 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:19:06.537395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9b0b5af2-9d89-4386-bf93-a5123a5b7572 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:19:06.537395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9b0b5af2-9d89-4386-bf93-a5123a5b7572 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:19:06.537395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9b0b5af2-9d89-4386-bf93-a5123a5b7572 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:19:06.537395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9b0b5af2-9d89-4386-bf93-a5123a5b7572 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:19:06.558938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-2d9df591-675b-44d8-885d-dfb9157e7b34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79436e23-0c71-4092-a365-79324f3299dd) Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2d9df591-675b-44d8-885d-dfb9157e7b34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Request method failure captured: Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments/845219e9-5e7d-4f7d-97f1-99b468c4eca7 HTTP/1.1 Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFiyD5q4nbQUUUlfkHiG44biV1s4pkm__-yWwjZJzHdBuTk1hh8VBqq5PlVcY3Dx9EJWjE5iQo7m7J9jupQP1XT1XzEvJBBnRrYRoVc2szDFE0uKgLkYJyznGa5Tfi4X7dsb3VTaS5AtCn5AZhwlqO7-duSw28k6au-bfwahHNQC8pe4 Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: 0b2e9de2e0a64e67beb01dc673c653e5 Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-TestMinimumBasicScenario-1817762964 Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:19:06.561994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:19:06.563373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0b2e9de2e0a64e67beb01dc673c653e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b2e9de2e0a64e67beb01dc673c653e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b2e9de2e0a64e67beb01dc673c653e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0b2e9de2e0a64e67beb01dc673c653e5"}]}] Sep 05 17:19:06.563373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-TestMinimumBasicScenario-1817762964 Sep 05 17:19:06.563373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 0b2e9de2e0a64e67beb01dc673c653e5 Sep 05 17:19:06.563373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1817762964 Sep 05 17:19:06.563373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-TestMinimumBasicScenario-1817762964-project Sep 05 17:19:06.563373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:19:06.563373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:19:06.563373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: c8b8aa2ae43a4d89ad579a5fdd87d564 Sep 05 17:19:06.563373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-TestMinimumBasicScenario-1817762964-project Sep 05 17:19:06.563373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79436e23-0c71-4092-a365-79324f3299dd) Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'server_id': 'c8c420ca-19c4-4f51-8091-e83672ea54ca', 'id': '845219e9-5e7d-4f7d-97f1-99b468c4eca7'} Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 17:19:06.564141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79436e23-0c71-4092-a365-79324f3299dd) Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:19:06.565252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79436e23-0c71-4092-a365-79324f3299dd) Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.566566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79436e23-0c71-4092-a365-79324f3299dd) Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:19:06.567643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79436e23-0c71-4092-a365-79324f3299dd) Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79436e23-0c71-4092-a365-79324f3299dd) Sep 05 17:19:06.570277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.572101 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2d9df591-675b-44d8-885d-dfb9157e7b34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79436e23-0c71-4092-a365-79324f3299dd) {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:19:06.572101 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2d9df591-675b-44d8-885d-dfb9157e7b34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments/845219e9-5e7d-4f7d-97f1-99b468c4eca7" status: 400 len: 269 microversion: 2.1 time: 0.341021 Sep 05 17:19:06.572101 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 925/1694] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Sep 5 17:19:06 2022] DELETE /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments/845219e9-5e7d-4f7d-97f1-99b468c4eca7 => generated 269 bytes in 342 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 17:19:06.572101 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8497a020-5762-4712-a9f4-25fa4317fbe2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:19:06.572515 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8497a020-5762-4712-a9f4-25fa4317fbe2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:19:06.576580 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9b0b5af2-9d89-4386-bf93-a5123a5b7572 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:19:06.577153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9b0b5af2-9d89-4386-bf93-a5123a5b7572 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:19:06.577299 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8497a020-5762-4712-a9f4-25fa4317fbe2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:19:06.577812 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9b0b5af2-9d89-4386-bf93-a5123a5b7572 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:19:06.577953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8497a020-5762-4712-a9f4-25fa4317fbe2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:19:06.578298 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.objects.instance [None req-9b0b5af2-9d89-4386-bf93-a5123a5b7572 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lazy-loading 'fault' on Instance uuid 3820bb09-911a-4093-952b-3487f165122f {{(pid=120733) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:19:06.578519 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8497a020-5762-4712-a9f4-25fa4317fbe2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:19:06.578992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8497a020-5762-4712-a9f4-25fa4317fbe2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:19:06.579456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8497a020-5762-4712-a9f4-25fa4317fbe2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:19:06.579858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8497a020-5762-4712-a9f4-25fa4317fbe2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:19:06.623249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9b0b5af2-9d89-4386-bf93-a5123a5b7572 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3a59d52ce8432c964f8c94a6e96a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c32d7007a1428a8bde1b73e5883db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:19:06.631729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9b0b5af2-9d89-4386-bf93-a5123a5b7572 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 200 len: 1231 microversion: 2.1 time: 0.108359 Sep 05 17:19:06.632411 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 770/1695] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:19:06 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 1231 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:19:06.637046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d80cbb00-7caf-453a-9cac-2badbfb1c907 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:19:06.637531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d80cbb00-7caf-453a-9cac-2badbfb1c907 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:19:06.643966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d80cbb00-7caf-453a-9cac-2badbfb1c907 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:19:06.644653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d80cbb00-7caf-453a-9cac-2badbfb1c907 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:19:06.645109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d80cbb00-7caf-453a-9cac-2badbfb1c907 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:19:06.645787 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d80cbb00-7caf-453a-9cac-2badbfb1c907 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:19:06.646235 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d80cbb00-7caf-453a-9cac-2badbfb1c907 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:19:06.646776 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d80cbb00-7caf-453a-9cac-2badbfb1c907 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:19:06.670841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-8497a020-5762-4712-a9f4-25fa4317fbe2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lazy-loading 'services' on Instance uuid cba4a1fa-a126-4e6b-9ac4-32290e275435 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:19:06.731775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.objects.instance [None req-d80cbb00-7caf-453a-9cac-2badbfb1c907 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lazy-loading 'services' on Instance uuid c8c420ca-19c4-4f51-8091-e83672ea54ca {{(pid=120733) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:19:06.759812 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-8497a020-5762-4712-a9f4-25fa4317fbe2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb243f5d-11f3-4995-b6c8-63c7cb191742) Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8497a020-5762-4712-a9f4-25fa4317fbe2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Request method failure captured: Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 HTTP/1.1 Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFiv047nns6uD-wGeK0APYfmPcpVx3CCKv5sjmDl9k5BfSQQcGDjxae1Hoku_TFUfk_UjneJKy_7-R4qOOvWRCP-6IunVIGnx5AiCwIGQh3yw7DnLIg4vTUMAQo_JWV0Oz6P6VXKWsBRDRxjCAKXg6e6hyMEC2vWV5yjpuZDQ8EY9oAs Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: 375cd031a57847ed99991340bf65d3d3 Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-VolumesSnapshotTestJSON-437066400 Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:19:06.762176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:19:06.763760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/375cd031a57847ed99991340bf65d3d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/375cd031a57847ed99991340bf65d3d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/375cd031a57847ed99991340bf65d3d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_375cd031a57847ed99991340bf65d3d3"}]}] Sep 05 17:19:06.763760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-VolumesSnapshotTestJSON-437066400 Sep 05 17:19:06.763760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 375cd031a57847ed99991340bf65d3d3 Sep 05 17:19:06.763760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-437066400 Sep 05 17:19:06.763760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-VolumesSnapshotTestJSON-437066400-project Sep 05 17:19:06.763760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:19:06.763760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:19:06.763760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: dc83779cc4e54be794873d62e3ac9061 Sep 05 17:19:06.763760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-VolumesSnapshotTestJSON-437066400-project Sep 05 17:19:06.763760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb243f5d-11f3-4995-b6c8-63c7cb191742) Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'server_id': 'cba4a1fa-a126-4e6b-9ac4-32290e275435', 'id': 'd9048c06-9ac3-455a-91d4-52977e0f0748'} Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 17:19:06.764905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb243f5d-11f3-4995-b6c8-63c7cb191742) Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:19:06.766004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb243f5d-11f3-4995-b6c8-63c7cb191742) Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.767199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb243f5d-11f3-4995-b6c8-63c7cb191742) Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:19:06.768718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb243f5d-11f3-4995-b6c8-63c7cb191742) Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb243f5d-11f3-4995-b6c8-63c7cb191742) Sep 05 17:19:06.770056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.771456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8497a020-5762-4712-a9f4-25fa4317fbe2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fb243f5d-11f3-4995-b6c8-63c7cb191742) {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:19:06.771456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8497a020-5762-4712-a9f4-25fa4317fbe2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748" status: 400 len: 269 microversion: 2.1 time: 0.198872 Sep 05 17:19:06.771456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 926/1696] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Sep 5 17:19:06 2022] DELETE /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435/os-volume_attachments/d9048c06-9ac3-455a-91d4-52977e0f0748 => generated 269 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 17:19:06.795501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-d80cbb00-7caf-453a-9cac-2badbfb1c907 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-db325231-3e4f-4e17-8f8f-b9a748723f0b) Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d80cbb00-7caf-453a-9cac-2badbfb1c907 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Request method failure captured: Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: DELETE /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments/845219e9-5e7d-4f7d-97f1-99b468c4eca7 HTTP/1.1 Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFiyD5q4nbQUUUlfkHiG44biV1s4pkm__-yWwjZJzHdBuTk1hh8VBqq5PlVcY3Dx9EJWjE5iQo7m7J9jupQP1XT1XzEvJBBnRrYRoVc2szDFE0uKgLkYJyznGa5Tfi4X7dsb3VTaS5AtCn5AZhwlqO7-duSw28k6au-bfwahHNQC8pe4 Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: 0b2e9de2e0a64e67beb01dc673c653e5 Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-TestMinimumBasicScenario-1817762964 Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:19:06.797707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:19:06.799165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0b2e9de2e0a64e67beb01dc673c653e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b2e9de2e0a64e67beb01dc673c653e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0b2e9de2e0a64e67beb01dc673c653e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0b2e9de2e0a64e67beb01dc673c653e5"}]}] Sep 05 17:19:06.799165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-TestMinimumBasicScenario-1817762964 Sep 05 17:19:06.799165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: 0b2e9de2e0a64e67beb01dc673c653e5 Sep 05 17:19:06.799165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1817762964 Sep 05 17:19:06.799165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-TestMinimumBasicScenario-1817762964-project Sep 05 17:19:06.799165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:19:06.799165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:19:06.799165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: c8b8aa2ae43a4d89ad579a5fdd87d564 Sep 05 17:19:06.799165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-TestMinimumBasicScenario-1817762964-project Sep 05 17:19:06.799165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-db325231-3e4f-4e17-8f8f-b9a748723f0b) Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'server_id': 'c8c420ca-19c4-4f51-8091-e83672ea54ca', 'id': '845219e9-5e7d-4f7d-97f1-99b468c4eca7'} Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 17:19:06.800680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-db325231-3e4f-4e17-8f8f-b9a748723f0b) Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:19:06.801715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-db325231-3e4f-4e17-8f8f-b9a748723f0b) Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.802894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-db325231-3e4f-4e17-8f8f-b9a748723f0b) Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:19:06.805627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-db325231-3e4f-4e17-8f8f-b9a748723f0b) Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-db325231-3e4f-4e17-8f8f-b9a748723f0b) Sep 05 17:19:06.806840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:19:06.807928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d80cbb00-7caf-453a-9cac-2badbfb1c907 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-db325231-3e4f-4e17-8f8f-b9a748723f0b) {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:19:06.807928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d80cbb00-7caf-453a-9cac-2badbfb1c907 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments/845219e9-5e7d-4f7d-97f1-99b468c4eca7" status: 400 len: 269 microversion: 2.1 time: 0.165780 Sep 05 17:19:06.807928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 771/1697] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Sep 5 17:19:06 2022] DELETE /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca/os-volume_attachments/845219e9-5e7d-4f7d-97f1-99b468c4eca7 => generated 269 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 17:19:07.660366 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-23311b71-8338-47cc-bf15-961778cd0f1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:19:07.660995 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-23311b71-8338-47cc-bf15-961778cd0f1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] [instance: 3820bb09-911a-4093-952b-3487f165122f] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:19:07.669525 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23311b71-8338-47cc-bf15-961778cd0f1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:19:07.670031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23311b71-8338-47cc-bf15-961778cd0f1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:19:07.670483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23311b71-8338-47cc-bf15-961778cd0f1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:19:07.671211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23311b71-8338-47cc-bf15-961778cd0f1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:19:07.671685 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23311b71-8338-47cc-bf15-961778cd0f1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:19:07.672127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23311b71-8338-47cc-bf15-961778cd0f1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:19:07.686711 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-23311b71-8338-47cc-bf15-961778cd0f1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] HTTP exception thrown: Instance 3820bb09-911a-4093-952b-3487f165122f could not be found. Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-23311b71-8338-47cc-bf15-961778cd0f1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Request method failure captured: Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f HTTP/1.1 Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFiwWxe5KrGQbnuQpCcdC1Th87nG_tmtRCB1tolBPeYnb59LA2ZiF42ogs0rLbq12Hk3RKnMH8_0qBnit12_fF_R1_EMNVj3GCMVYT55iBCoc3Yjmnk3laUVYAQf0qrtRX-rVBg3xVoBJSs5B3FdeRVfx1PYFl97w9NNRv2Sb2Y7QsuU Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: e6c32d7007a1428a8bde1b73e5883db6 Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-TestVolumeBootPattern-1331929111 Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:19:07.688379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:19:07.690202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e6c32d7007a1428a8bde1b73e5883db6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e6c32d7007a1428a8bde1b73e5883db6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e6c32d7007a1428a8bde1b73e5883db6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e6c32d7007a1428a8bde1b73e5883db6"}]}] Sep 05 17:19:07.690202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-TestVolumeBootPattern-1331929111 Sep 05 17:19:07.690202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: e6c32d7007a1428a8bde1b73e5883db6 Sep 05 17:19:07.690202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-TestVolumeBootPattern-1331929111 Sep 05 17:19:07.690202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-TestVolumeBootPattern-1331929111-project Sep 05 17:19:07.690202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:19:07.690202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:19:07.690202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: 9b3a59d52ce8432c964f8c94a6e96a4d Sep 05 17:19:07.690202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-TestVolumeBootPattern-1331929111-project Sep 05 17:19:07.690202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:19:07.690202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Instance 3820bb09-911a-4093-952b-3487f165122f could not be found. Sep 05 17:19:07.690202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': '3820bb09-911a-4093-952b-3487f165122f'} Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3820bb09-911a-4093-952b-3487f165122f could not be found. Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:19:07.691259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3820bb09-911a-4093-952b-3487f165122f could not be found. Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3820bb09-911a-4093-952b-3487f165122f could not be found. Sep 05 17:19:07.692553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:19:07.693722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-23311b71-8338-47cc-bf15-961778cd0f1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Returning 404 to user: Instance 3820bb09-911a-4093-952b-3487f165122f could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:19:07.693722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-23311b71-8338-47cc-bf15-961778cd0f1f tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f" status: 404 len: 111 microversion: 2.1 time: 0.037605 Sep 05 17:19:07.693722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 927/1698] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:19:07 2022] GET /compute/v2.1/servers/3820bb09-911a-4093-952b-3487f165122f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:20:11.599130 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=6 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:20:11.599909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=20 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:20:11.606506 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f93e8bc9-d550-4859-af9a-e57351c53ee5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:11.607231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f93e8bc9-d550-4859-af9a-e57351c53ee5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:11.616597 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f93e8bc9-d550-4859-af9a-e57351c53ee5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:11.617072 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f93e8bc9-d550-4859-af9a-e57351c53ee5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:11.617496 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f93e8bc9-d550-4859-af9a-e57351c53ee5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:11.618175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f93e8bc9-d550-4859-af9a-e57351c53ee5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:11.618623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f93e8bc9-d550-4859-af9a-e57351c53ee5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:11.619037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f93e8bc9-d550-4859-af9a-e57351c53ee5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:11.647235 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f93e8bc9-d550-4859-af9a-e57351c53ee5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Going to try to terminate instance {{(pid=120733) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:20:11.743843 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f93e8bc9-d550-4859-af9a-e57351c53ee5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 204 len: 0 microversion: 2.20 time: 0.147011 Sep 05 17:20:11.744585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 772/1699] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Sep 5 17:20:11 2022] DELETE /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 05 17:20:11.754309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-067a8c6d-6f09-4d14-8f09-06606235d288 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:11.754953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-067a8c6d-6f09-4d14-8f09-06606235d288 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:11.757227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=6 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:20:11.757963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=18 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:20:11.758658 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:20:11.758786 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:20:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 (ip 10.222.0.23) !!! Sep 05 17:20:11.760810 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:20:11.760963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:20:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 (ip 10.222.0.23) !!! Sep 05 17:20:11.775211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-067a8c6d-6f09-4d14-8f09-06606235d288 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:11.775686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-067a8c6d-6f09-4d14-8f09-06606235d288 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:11.776113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-067a8c6d-6f09-4d14-8f09-06606235d288 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:11.776873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-067a8c6d-6f09-4d14-8f09-06606235d288 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:11.777314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-067a8c6d-6f09-4d14-8f09-06606235d288 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:11.777728 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-067a8c6d-6f09-4d14-8f09-06606235d288 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:11.915448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-067a8c6d-6f09-4d14-8f09-06606235d288 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:11.924171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-067a8c6d-6f09-4d14-8f09-06606235d288 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:11.926017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-067a8c6d-6f09-4d14-8f09-06606235d288 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:11.927202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-067a8c6d-6f09-4d14-8f09-06606235d288 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1800 microversion: 2.20 time: 0.177663 Sep 05 17:20:11.927781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 928/1700] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:11 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 17:20:12.958160 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f1296f15-a6b2-412b-87dd-965df28a2d95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:12.958851 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f1296f15-a6b2-412b-87dd-965df28a2d95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:12.965402 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1296f15-a6b2-412b-87dd-965df28a2d95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:12.965881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1296f15-a6b2-412b-87dd-965df28a2d95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:12.966303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1296f15-a6b2-412b-87dd-965df28a2d95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:12.966983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1296f15-a6b2-412b-87dd-965df28a2d95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:12.967431 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1296f15-a6b2-412b-87dd-965df28a2d95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:12.967837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1296f15-a6b2-412b-87dd-965df28a2d95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:13.120369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f1296f15-a6b2-412b-87dd-965df28a2d95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:13.129917 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f1296f15-a6b2-412b-87dd-965df28a2d95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:13.131358 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f1296f15-a6b2-412b-87dd-965df28a2d95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:13.132558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f1296f15-a6b2-412b-87dd-965df28a2d95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1800 microversion: 2.20 time: 0.181703 Sep 05 17:20:13.142735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 773/1701] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:12 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1800 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:14.159492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a1b3930a-6c99-4e95-a515-2db4cedc85e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:14.160096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a1b3930a-6c99-4e95-a515-2db4cedc85e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:14.167477 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1b3930a-6c99-4e95-a515-2db4cedc85e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:14.167963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1b3930a-6c99-4e95-a515-2db4cedc85e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:14.168423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1b3930a-6c99-4e95-a515-2db4cedc85e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:14.169127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1b3930a-6c99-4e95-a515-2db4cedc85e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:14.169571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1b3930a-6c99-4e95-a515-2db4cedc85e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:14.169991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1b3930a-6c99-4e95-a515-2db4cedc85e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:14.310384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a1b3930a-6c99-4e95-a515-2db4cedc85e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:14.321274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a1b3930a-6c99-4e95-a515-2db4cedc85e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:14.323023 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a1b3930a-6c99-4e95-a515-2db4cedc85e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:14.324509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a1b3930a-6c99-4e95-a515-2db4cedc85e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1800 microversion: 2.20 time: 0.169158 Sep 05 17:20:14.336183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 929/1702] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:14 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:14.995826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-c5a832d3-f4af-49ae-8a25-23d204053da6 req-526ef2ee-72a6-43dc-a175-8f311cd6e0af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97cc15c7-947d-4daf-80e8-8edc37c01e68", "name": "network-vif-deleted", "tag": "4a115af6-123d-4baf-bd17-df6792943a2d"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:20:15.008667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-c5a832d3-f4af-49ae-8a25-23d204053da6 req-526ef2ee-72a6-43dc-a175-8f311cd6e0af service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:15.009502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-c5a832d3-f4af-49ae-8a25-23d204053da6 req-526ef2ee-72a6-43dc-a175-8f311cd6e0af service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:15.010029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-c5a832d3-f4af-49ae-8a25-23d204053da6 req-526ef2ee-72a6-43dc-a175-8f311cd6e0af service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:15.025430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-c5a832d3-f4af-49ae-8a25-23d204053da6 req-526ef2ee-72a6-43dc-a175-8f311cd6e0af service nova] Creating event network-vif-deleted:4a115af6-123d-4baf-bd17-df6792943a2d for instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 on hv-cinder-85596 Sep 05 17:20:15.030927 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-c5a832d3-f4af-49ae-8a25-23d204053da6 req-526ef2ee-72a6-43dc-a175-8f311cd6e0af service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107922 Sep 05 17:20:15.032064 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 774/1703] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:20:15.352372 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d1150fb6-aa9c-46b9-a499-b6bde087f6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:15.352967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d1150fb6-aa9c-46b9-a499-b6bde087f6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:15.359555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1150fb6-aa9c-46b9-a499-b6bde087f6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:15.360108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1150fb6-aa9c-46b9-a499-b6bde087f6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:15.360582 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1150fb6-aa9c-46b9-a499-b6bde087f6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:15.361624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1150fb6-aa9c-46b9-a499-b6bde087f6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:15.362116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1150fb6-aa9c-46b9-a499-b6bde087f6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:15.362598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1150fb6-aa9c-46b9-a499-b6bde087f6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:15.426029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d1150fb6-aa9c-46b9-a499-b6bde087f6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:15.435997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d1150fb6-aa9c-46b9-a499-b6bde087f6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:15.437476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d1150fb6-aa9c-46b9-a499-b6bde087f6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:15.438627 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d1150fb6-aa9c-46b9-a499-b6bde087f6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.090350 Sep 05 17:20:15.439187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 930/1704] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:15 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 17:20:16.469285 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b0ba03b9-691e-4605-aa74-add94f934d8f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:16.470681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b0ba03b9-691e-4605-aa74-add94f934d8f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:16.477480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b0ba03b9-691e-4605-aa74-add94f934d8f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:16.477961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b0ba03b9-691e-4605-aa74-add94f934d8f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:16.478382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b0ba03b9-691e-4605-aa74-add94f934d8f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:16.479060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b0ba03b9-691e-4605-aa74-add94f934d8f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:16.479504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b0ba03b9-691e-4605-aa74-add94f934d8f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:16.479914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b0ba03b9-691e-4605-aa74-add94f934d8f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:16.552529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b0ba03b9-691e-4605-aa74-add94f934d8f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:16.561553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b0ba03b9-691e-4605-aa74-add94f934d8f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:16.562990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b0ba03b9-691e-4605-aa74-add94f934d8f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:16.564166 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b0ba03b9-691e-4605-aa74-add94f934d8f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102622 Sep 05 17:20:16.564809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 775/1705] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:16 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:17.589154 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cfb40a27-0842-4039-98ab-609433fc6047 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:17.589773 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cfb40a27-0842-4039-98ab-609433fc6047 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:17.596329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cfb40a27-0842-4039-98ab-609433fc6047 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:17.596839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cfb40a27-0842-4039-98ab-609433fc6047 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:17.597294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cfb40a27-0842-4039-98ab-609433fc6047 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:17.598196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cfb40a27-0842-4039-98ab-609433fc6047 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:17.598652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cfb40a27-0842-4039-98ab-609433fc6047 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:17.599079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cfb40a27-0842-4039-98ab-609433fc6047 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:17.662593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cfb40a27-0842-4039-98ab-609433fc6047 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:17.671709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cfb40a27-0842-4039-98ab-609433fc6047 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:17.673240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cfb40a27-0842-4039-98ab-609433fc6047 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:17.674377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cfb40a27-0842-4039-98ab-609433fc6047 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.089217 Sep 05 17:20:17.674939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 931/1706] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:17 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:18.703897 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5530cb26-9878-4cf6-a651-5a34cd29a205 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:18.704829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5530cb26-9878-4cf6-a651-5a34cd29a205 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:18.715670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5530cb26-9878-4cf6-a651-5a34cd29a205 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:18.716708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5530cb26-9878-4cf6-a651-5a34cd29a205 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:18.717496 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5530cb26-9878-4cf6-a651-5a34cd29a205 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:18.718621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5530cb26-9878-4cf6-a651-5a34cd29a205 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:18.719740 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5530cb26-9878-4cf6-a651-5a34cd29a205 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:18.720481 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5530cb26-9878-4cf6-a651-5a34cd29a205 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:18.784177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5530cb26-9878-4cf6-a651-5a34cd29a205 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:18.793118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5530cb26-9878-4cf6-a651-5a34cd29a205 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:18.794574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5530cb26-9878-4cf6-a651-5a34cd29a205 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:18.795766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5530cb26-9878-4cf6-a651-5a34cd29a205 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098705 Sep 05 17:20:18.796340 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 776/1707] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:18 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:19.832688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-63f44937-bc7b-438a-98c5-16a782d29778 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:19.833331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-63f44937-bc7b-438a-98c5-16a782d29778 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:19.840593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63f44937-bc7b-438a-98c5-16a782d29778 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:19.841045 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63f44937-bc7b-438a-98c5-16a782d29778 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:19.841471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63f44937-bc7b-438a-98c5-16a782d29778 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:19.842158 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63f44937-bc7b-438a-98c5-16a782d29778 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:19.842604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63f44937-bc7b-438a-98c5-16a782d29778 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:19.843047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63f44937-bc7b-438a-98c5-16a782d29778 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:19.911233 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-63f44937-bc7b-438a-98c5-16a782d29778 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:19.920459 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-63f44937-bc7b-438a-98c5-16a782d29778 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:19.921889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-63f44937-bc7b-438a-98c5-16a782d29778 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:19.923026 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-63f44937-bc7b-438a-98c5-16a782d29778 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.096899 Sep 05 17:20:19.923580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 932/1708] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:19 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:20.952986 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-47064218-5027-473d-8181-cd1027885572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:20.953986 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-47064218-5027-473d-8181-cd1027885572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:20.965370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47064218-5027-473d-8181-cd1027885572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:20.966150 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47064218-5027-473d-8181-cd1027885572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:20.966896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47064218-5027-473d-8181-cd1027885572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:20.968065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47064218-5027-473d-8181-cd1027885572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:20.968852 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47064218-5027-473d-8181-cd1027885572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:20.969915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47064218-5027-473d-8181-cd1027885572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:21.035229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-47064218-5027-473d-8181-cd1027885572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:21.044714 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-47064218-5027-473d-8181-cd1027885572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:21.046141 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-47064218-5027-473d-8181-cd1027885572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:21.047277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-47064218-5027-473d-8181-cd1027885572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101053 Sep 05 17:20:21.047845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 777/1709] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:20 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:22.077248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7a5b51c8-f910-4fa0-b54f-7ffa762117ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:22.078195 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7a5b51c8-f910-4fa0-b54f-7ffa762117ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:22.081324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:20:22.081682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:20:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 (ip 10.222.0.23) !!! Sep 05 17:20:22.090680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a5b51c8-f910-4fa0-b54f-7ffa762117ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:22.091156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a5b51c8-f910-4fa0-b54f-7ffa762117ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:22.091577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a5b51c8-f910-4fa0-b54f-7ffa762117ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:22.092289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a5b51c8-f910-4fa0-b54f-7ffa762117ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:22.092735 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a5b51c8-f910-4fa0-b54f-7ffa762117ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:22.093177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a5b51c8-f910-4fa0-b54f-7ffa762117ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:22.161697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7a5b51c8-f910-4fa0-b54f-7ffa762117ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:22.170746 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7a5b51c8-f910-4fa0-b54f-7ffa762117ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:22.172202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7a5b51c8-f910-4fa0-b54f-7ffa762117ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:22.173375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7a5b51c8-f910-4fa0-b54f-7ffa762117ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102815 Sep 05 17:20:22.174366 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 933/1710] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:22 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:23.204615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fb096cb5-6be4-41ad-b6a8-bf3247e83473 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:23.205626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fb096cb5-6be4-41ad-b6a8-bf3247e83473 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:23.217099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb096cb5-6be4-41ad-b6a8-bf3247e83473 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:23.217899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb096cb5-6be4-41ad-b6a8-bf3247e83473 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:23.218608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb096cb5-6be4-41ad-b6a8-bf3247e83473 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:23.220142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb096cb5-6be4-41ad-b6a8-bf3247e83473 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:23.220938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb096cb5-6be4-41ad-b6a8-bf3247e83473 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:23.221642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb096cb5-6be4-41ad-b6a8-bf3247e83473 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:23.298782 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fb096cb5-6be4-41ad-b6a8-bf3247e83473 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:23.312747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fb096cb5-6be4-41ad-b6a8-bf3247e83473 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:23.315137 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fb096cb5-6be4-41ad-b6a8-bf3247e83473 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:23.316804 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fb096cb5-6be4-41ad-b6a8-bf3247e83473 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.118779 Sep 05 17:20:23.317366 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 778/1711] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:23 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:24.346840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-da86933a-208f-46e6-91ef-0cc83e66b757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:24.348501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-da86933a-208f-46e6-91ef-0cc83e66b757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:24.359234 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da86933a-208f-46e6-91ef-0cc83e66b757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:24.360021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da86933a-208f-46e6-91ef-0cc83e66b757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:24.360788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da86933a-208f-46e6-91ef-0cc83e66b757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:24.361912 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da86933a-208f-46e6-91ef-0cc83e66b757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:24.362979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da86933a-208f-46e6-91ef-0cc83e66b757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:24.363238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da86933a-208f-46e6-91ef-0cc83e66b757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:24.426796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-da86933a-208f-46e6-91ef-0cc83e66b757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:24.435714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-da86933a-208f-46e6-91ef-0cc83e66b757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:24.437221 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-da86933a-208f-46e6-91ef-0cc83e66b757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:24.438380 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-da86933a-208f-46e6-91ef-0cc83e66b757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098556 Sep 05 17:20:24.438918 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 934/1712] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:24 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:25.467813 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-aed18571-60d9-41d4-85c6-66e690c1284c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:25.468883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-aed18571-60d9-41d4-85c6-66e690c1284c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:25.477036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aed18571-60d9-41d4-85c6-66e690c1284c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:25.477519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aed18571-60d9-41d4-85c6-66e690c1284c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:25.477948 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aed18571-60d9-41d4-85c6-66e690c1284c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:25.478662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aed18571-60d9-41d4-85c6-66e690c1284c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:25.479116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aed18571-60d9-41d4-85c6-66e690c1284c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:25.479534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aed18571-60d9-41d4-85c6-66e690c1284c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:25.543745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-aed18571-60d9-41d4-85c6-66e690c1284c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:25.552675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-aed18571-60d9-41d4-85c6-66e690c1284c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:25.554118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-aed18571-60d9-41d4-85c6-66e690c1284c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:25.555258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-aed18571-60d9-41d4-85c6-66e690c1284c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.093997 Sep 05 17:20:25.555818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 779/1713] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:25 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:26.580840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5bdfbc95-fc76-4c42-9627-c17915afed9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:26.581813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5bdfbc95-fc76-4c42-9627-c17915afed9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:26.588709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5bdfbc95-fc76-4c42-9627-c17915afed9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:26.589186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5bdfbc95-fc76-4c42-9627-c17915afed9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:26.589608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5bdfbc95-fc76-4c42-9627-c17915afed9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:26.590288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5bdfbc95-fc76-4c42-9627-c17915afed9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:26.590731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5bdfbc95-fc76-4c42-9627-c17915afed9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:26.591143 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5bdfbc95-fc76-4c42-9627-c17915afed9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:26.654880 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5bdfbc95-fc76-4c42-9627-c17915afed9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:26.667949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5bdfbc95-fc76-4c42-9627-c17915afed9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:26.670184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5bdfbc95-fc76-4c42-9627-c17915afed9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:26.671887 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5bdfbc95-fc76-4c42-9627-c17915afed9a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.095920 Sep 05 17:20:26.672727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 935/1714] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:26 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:27.702317 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5f40c493-a11d-4981-94c7-6c4f1752fbad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:27.703171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5f40c493-a11d-4981-94c7-6c4f1752fbad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:27.714139 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f40c493-a11d-4981-94c7-6c4f1752fbad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:27.714938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f40c493-a11d-4981-94c7-6c4f1752fbad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:27.715646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f40c493-a11d-4981-94c7-6c4f1752fbad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:27.716860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f40c493-a11d-4981-94c7-6c4f1752fbad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:27.717578 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f40c493-a11d-4981-94c7-6c4f1752fbad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:27.718303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f40c493-a11d-4981-94c7-6c4f1752fbad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:27.784520 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5f40c493-a11d-4981-94c7-6c4f1752fbad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:27.793485 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5f40c493-a11d-4981-94c7-6c4f1752fbad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:27.794979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5f40c493-a11d-4981-94c7-6c4f1752fbad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:27.796128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5f40c493-a11d-4981-94c7-6c4f1752fbad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100659 Sep 05 17:20:27.796718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 780/1715] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:27 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:28.823405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-59dbc8e8-d107-4773-a7a7-6e902640d4ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:28.824083 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-59dbc8e8-d107-4773-a7a7-6e902640d4ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:28.831089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59dbc8e8-d107-4773-a7a7-6e902640d4ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:28.831729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59dbc8e8-d107-4773-a7a7-6e902640d4ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:28.832170 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59dbc8e8-d107-4773-a7a7-6e902640d4ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:28.832866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59dbc8e8-d107-4773-a7a7-6e902640d4ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:28.833309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59dbc8e8-d107-4773-a7a7-6e902640d4ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:28.833724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59dbc8e8-d107-4773-a7a7-6e902640d4ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:28.894888 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-59dbc8e8-d107-4773-a7a7-6e902640d4ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:28.903915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-59dbc8e8-d107-4773-a7a7-6e902640d4ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:28.905402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-59dbc8e8-d107-4773-a7a7-6e902640d4ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:28.906577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-59dbc8e8-d107-4773-a7a7-6e902640d4ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.087797 Sep 05 17:20:28.907138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 936/1716] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:28 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:29.935611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-63a8ad95-ac4a-41f8-b12e-7f64fcdc243c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:29.936287 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-63a8ad95-ac4a-41f8-b12e-7f64fcdc243c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:29.944464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63a8ad95-ac4a-41f8-b12e-7f64fcdc243c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:29.944949 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63a8ad95-ac4a-41f8-b12e-7f64fcdc243c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:29.945374 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63a8ad95-ac4a-41f8-b12e-7f64fcdc243c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:29.946063 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63a8ad95-ac4a-41f8-b12e-7f64fcdc243c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:29.946509 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63a8ad95-ac4a-41f8-b12e-7f64fcdc243c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:29.946930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-63a8ad95-ac4a-41f8-b12e-7f64fcdc243c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:30.014676 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-63a8ad95-ac4a-41f8-b12e-7f64fcdc243c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:30.023847 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-63a8ad95-ac4a-41f8-b12e-7f64fcdc243c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:30.025308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-63a8ad95-ac4a-41f8-b12e-7f64fcdc243c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:30.026455 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-63a8ad95-ac4a-41f8-b12e-7f64fcdc243c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097043 Sep 05 17:20:30.027095 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 781/1717] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:29 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:31.054552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d13f3cab-b3f4-46ce-8d6e-0d08b7f4a222 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:31.055356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d13f3cab-b3f4-46ce-8d6e-0d08b7f4a222 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:31.063638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d13f3cab-b3f4-46ce-8d6e-0d08b7f4a222 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:31.064269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d13f3cab-b3f4-46ce-8d6e-0d08b7f4a222 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:31.064802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d13f3cab-b3f4-46ce-8d6e-0d08b7f4a222 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:31.065658 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d13f3cab-b3f4-46ce-8d6e-0d08b7f4a222 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:31.066561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d13f3cab-b3f4-46ce-8d6e-0d08b7f4a222 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:31.067412 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d13f3cab-b3f4-46ce-8d6e-0d08b7f4a222 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:31.132672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d13f3cab-b3f4-46ce-8d6e-0d08b7f4a222 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:31.141814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d13f3cab-b3f4-46ce-8d6e-0d08b7f4a222 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:31.143324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d13f3cab-b3f4-46ce-8d6e-0d08b7f4a222 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:31.144577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d13f3cab-b3f4-46ce-8d6e-0d08b7f4a222 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.095798 Sep 05 17:20:31.145142 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 937/1718] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:31 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:32.173625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-83b7a5c3-e4a3-4626-93ec-2cdae74f30ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:32.174593 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-83b7a5c3-e4a3-4626-93ec-2cdae74f30ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:32.185571 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83b7a5c3-e4a3-4626-93ec-2cdae74f30ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:32.186367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83b7a5c3-e4a3-4626-93ec-2cdae74f30ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:32.187093 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83b7a5c3-e4a3-4626-93ec-2cdae74f30ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:32.188228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83b7a5c3-e4a3-4626-93ec-2cdae74f30ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:32.189030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83b7a5c3-e4a3-4626-93ec-2cdae74f30ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:32.189750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-83b7a5c3-e4a3-4626-93ec-2cdae74f30ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:32.253819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-83b7a5c3-e4a3-4626-93ec-2cdae74f30ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:32.263311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-83b7a5c3-e4a3-4626-93ec-2cdae74f30ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:32.264791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-83b7a5c3-e4a3-4626-93ec-2cdae74f30ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:32.265942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-83b7a5c3-e4a3-4626-93ec-2cdae74f30ea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098957 Sep 05 17:20:32.266501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 782/1719] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:32 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:33.296002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-19228244-0649-42dc-9b5c-1bfec772425b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:33.297031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-19228244-0649-42dc-9b5c-1bfec772425b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:33.305622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19228244-0649-42dc-9b5c-1bfec772425b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:33.306125 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19228244-0649-42dc-9b5c-1bfec772425b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:33.306548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19228244-0649-42dc-9b5c-1bfec772425b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:33.307232 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19228244-0649-42dc-9b5c-1bfec772425b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:33.307672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19228244-0649-42dc-9b5c-1bfec772425b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:33.308085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19228244-0649-42dc-9b5c-1bfec772425b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:33.369783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-19228244-0649-42dc-9b5c-1bfec772425b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:33.378991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-19228244-0649-42dc-9b5c-1bfec772425b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:33.380475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-19228244-0649-42dc-9b5c-1bfec772425b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:33.381637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-19228244-0649-42dc-9b5c-1bfec772425b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.092375 Sep 05 17:20:33.382199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 938/1720] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:33 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:34.412200 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-dbb7edd4-f138-4896-b49f-42e8bd28a5dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:34.412832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-dbb7edd4-f138-4896-b49f-42e8bd28a5dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:34.419765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbb7edd4-f138-4896-b49f-42e8bd28a5dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:34.420260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbb7edd4-f138-4896-b49f-42e8bd28a5dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:34.420687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbb7edd4-f138-4896-b49f-42e8bd28a5dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:34.421364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbb7edd4-f138-4896-b49f-42e8bd28a5dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:34.421809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbb7edd4-f138-4896-b49f-42e8bd28a5dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:34.422217 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbb7edd4-f138-4896-b49f-42e8bd28a5dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:34.493337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-dbb7edd4-f138-4896-b49f-42e8bd28a5dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:34.502697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-dbb7edd4-f138-4896-b49f-42e8bd28a5dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:34.504883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-dbb7edd4-f138-4896-b49f-42e8bd28a5dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:34.506034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-dbb7edd4-f138-4896-b49f-42e8bd28a5dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098346 Sep 05 17:20:34.506588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 783/1721] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:34 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:35.531509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b3c47b78-b418-4acd-8626-f9bab82ccac5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:35.532165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b3c47b78-b418-4acd-8626-f9bab82ccac5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:35.539080 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3c47b78-b418-4acd-8626-f9bab82ccac5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:35.539562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3c47b78-b418-4acd-8626-f9bab82ccac5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:35.539993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3c47b78-b418-4acd-8626-f9bab82ccac5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:35.540719 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3c47b78-b418-4acd-8626-f9bab82ccac5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:35.541166 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3c47b78-b418-4acd-8626-f9bab82ccac5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:35.541585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3c47b78-b418-4acd-8626-f9bab82ccac5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:35.825708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b3c47b78-b418-4acd-8626-f9bab82ccac5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:35.840944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b3c47b78-b418-4acd-8626-f9bab82ccac5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:35.843396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b3c47b78-b418-4acd-8626-f9bab82ccac5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:35.845698 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b3c47b78-b418-4acd-8626-f9bab82ccac5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.317977 Sep 05 17:20:35.846573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 939/1722] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:35 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:36.875649 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-17cf55a4-9420-4a54-975c-2b11f32076aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:36.876684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-17cf55a4-9420-4a54-975c-2b11f32076aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:36.885349 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17cf55a4-9420-4a54-975c-2b11f32076aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:36.885754 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17cf55a4-9420-4a54-975c-2b11f32076aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:36.886178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17cf55a4-9420-4a54-975c-2b11f32076aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:36.886863 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17cf55a4-9420-4a54-975c-2b11f32076aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:36.887306 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17cf55a4-9420-4a54-975c-2b11f32076aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:36.887718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17cf55a4-9420-4a54-975c-2b11f32076aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:36.957881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-17cf55a4-9420-4a54-975c-2b11f32076aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:36.967611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-17cf55a4-9420-4a54-975c-2b11f32076aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:36.969089 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-17cf55a4-9420-4a54-975c-2b11f32076aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:36.970579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-17cf55a4-9420-4a54-975c-2b11f32076aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101456 Sep 05 17:20:36.971141 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 784/1723] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:36 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:38.000487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d5c418e1-e676-4ae6-b5d9-2c6c4a9839f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:38.001440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d5c418e1-e676-4ae6-b5d9-2c6c4a9839f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:38.010032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5c418e1-e676-4ae6-b5d9-2c6c4a9839f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:38.010520 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5c418e1-e676-4ae6-b5d9-2c6c4a9839f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:38.010955 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5c418e1-e676-4ae6-b5d9-2c6c4a9839f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:38.011653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5c418e1-e676-4ae6-b5d9-2c6c4a9839f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:38.012106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5c418e1-e676-4ae6-b5d9-2c6c4a9839f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:38.012569 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5c418e1-e676-4ae6-b5d9-2c6c4a9839f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:38.076413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d5c418e1-e676-4ae6-b5d9-2c6c4a9839f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:38.089097 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d5c418e1-e676-4ae6-b5d9-2c6c4a9839f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:38.091106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d5c418e1-e676-4ae6-b5d9-2c6c4a9839f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:38.093063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d5c418e1-e676-4ae6-b5d9-2c6c4a9839f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098897 Sep 05 17:20:38.093667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 940/1724] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:37 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:39.123045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3d05e721-c8e1-4221-9c1d-21ae4ae4eaec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:39.123808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3d05e721-c8e1-4221-9c1d-21ae4ae4eaec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:39.133251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d05e721-c8e1-4221-9c1d-21ae4ae4eaec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:39.133896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d05e721-c8e1-4221-9c1d-21ae4ae4eaec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:39.134490 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d05e721-c8e1-4221-9c1d-21ae4ae4eaec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:39.135436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d05e721-c8e1-4221-9c1d-21ae4ae4eaec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:39.136054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d05e721-c8e1-4221-9c1d-21ae4ae4eaec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:39.136670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d05e721-c8e1-4221-9c1d-21ae4ae4eaec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:39.201062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3d05e721-c8e1-4221-9c1d-21ae4ae4eaec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:39.210347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3d05e721-c8e1-4221-9c1d-21ae4ae4eaec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:39.211824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3d05e721-c8e1-4221-9c1d-21ae4ae4eaec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:39.213003 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3d05e721-c8e1-4221-9c1d-21ae4ae4eaec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.095358 Sep 05 17:20:39.213563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 785/1725] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:39 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:40.242147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-07bd2fca-447b-4d14-8835-ff1ec020172e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:40.242822 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-07bd2fca-447b-4d14-8835-ff1ec020172e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:40.250462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-07bd2fca-447b-4d14-8835-ff1ec020172e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:40.250996 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-07bd2fca-447b-4d14-8835-ff1ec020172e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:40.251474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-07bd2fca-447b-4d14-8835-ff1ec020172e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:40.252269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-07bd2fca-447b-4d14-8835-ff1ec020172e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:40.252771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-07bd2fca-447b-4d14-8835-ff1ec020172e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:40.253264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-07bd2fca-447b-4d14-8835-ff1ec020172e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:40.316691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-07bd2fca-447b-4d14-8835-ff1ec020172e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:40.325652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-07bd2fca-447b-4d14-8835-ff1ec020172e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:40.327093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-07bd2fca-447b-4d14-8835-ff1ec020172e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:40.328269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-07bd2fca-447b-4d14-8835-ff1ec020172e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.092302 Sep 05 17:20:40.328837 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 941/1726] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:40 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:41.358045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0e6c2cb8-3cdd-48ed-821d-d4621cb3e76f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:41.360066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0e6c2cb8-3cdd-48ed-821d-d4621cb3e76f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:41.369055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0e6c2cb8-3cdd-48ed-821d-d4621cb3e76f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:41.369565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0e6c2cb8-3cdd-48ed-821d-d4621cb3e76f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:41.369989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0e6c2cb8-3cdd-48ed-821d-d4621cb3e76f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:41.370679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0e6c2cb8-3cdd-48ed-821d-d4621cb3e76f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:41.371099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0e6c2cb8-3cdd-48ed-821d-d4621cb3e76f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:41.371544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0e6c2cb8-3cdd-48ed-821d-d4621cb3e76f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:41.437073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0e6c2cb8-3cdd-48ed-821d-d4621cb3e76f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:41.452491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0e6c2cb8-3cdd-48ed-821d-d4621cb3e76f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:41.454945 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0e6c2cb8-3cdd-48ed-821d-d4621cb3e76f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:41.456821 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0e6c2cb8-3cdd-48ed-821d-d4621cb3e76f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.105121 Sep 05 17:20:41.457719 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 786/1727] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:41 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:42.487530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6a296ad5-615d-4b67-962d-b9864171c26c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:42.488466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6a296ad5-615d-4b67-962d-b9864171c26c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:42.492204 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=29 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:20:42.501066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a296ad5-615d-4b67-962d-b9864171c26c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:42.501858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a296ad5-615d-4b67-962d-b9864171c26c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:42.502561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a296ad5-615d-4b67-962d-b9864171c26c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:42.503693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a296ad5-615d-4b67-962d-b9864171c26c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:42.504498 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a296ad5-615d-4b67-962d-b9864171c26c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:42.505205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a296ad5-615d-4b67-962d-b9864171c26c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:42.509145 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=85 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:20:42.569521 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6a296ad5-615d-4b67-962d-b9864171c26c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:42.578629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6a296ad5-615d-4b67-962d-b9864171c26c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:42.580091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6a296ad5-615d-4b67-962d-b9864171c26c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:42.581279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6a296ad5-615d-4b67-962d-b9864171c26c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100411 Sep 05 17:20:42.581843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 942/1728] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:42 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:43.608890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4d5b6291-e8e2-4417-b810-099f134a95f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:43.609541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4d5b6291-e8e2-4417-b810-099f134a95f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:43.611451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:20:43.616873 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d5b6291-e8e2-4417-b810-099f134a95f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:43.617362 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d5b6291-e8e2-4417-b810-099f134a95f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:43.617786 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d5b6291-e8e2-4417-b810-099f134a95f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:43.618480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d5b6291-e8e2-4417-b810-099f134a95f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:43.618930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d5b6291-e8e2-4417-b810-099f134a95f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:43.619344 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d5b6291-e8e2-4417-b810-099f134a95f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:43.622585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:20:43.694212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4d5b6291-e8e2-4417-b810-099f134a95f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:43.704624 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4d5b6291-e8e2-4417-b810-099f134a95f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:43.706056 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4d5b6291-e8e2-4417-b810-099f134a95f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:43.707193 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4d5b6291-e8e2-4417-b810-099f134a95f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.103333 Sep 05 17:20:43.707771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 787/1729] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:43 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:44.732821 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3b4a3687-8e3e-4448-b967-5421332b9e78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:44.733406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3b4a3687-8e3e-4448-b967-5421332b9e78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:44.740347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b4a3687-8e3e-4448-b967-5421332b9e78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:44.740821 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b4a3687-8e3e-4448-b967-5421332b9e78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:44.741253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b4a3687-8e3e-4448-b967-5421332b9e78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:44.741939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b4a3687-8e3e-4448-b967-5421332b9e78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:44.742384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b4a3687-8e3e-4448-b967-5421332b9e78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:44.742801 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b4a3687-8e3e-4448-b967-5421332b9e78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:44.808477 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3b4a3687-8e3e-4448-b967-5421332b9e78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:44.817438 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3b4a3687-8e3e-4448-b967-5421332b9e78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:44.818874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3b4a3687-8e3e-4448-b967-5421332b9e78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:44.820009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3b4a3687-8e3e-4448-b967-5421332b9e78 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.091402 Sep 05 17:20:44.820590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 943/1730] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:44 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:45.849886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-767f8342-b695-4bea-aed2-dcb3ce5e9bad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:45.850810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-767f8342-b695-4bea-aed2-dcb3ce5e9bad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:45.859419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-767f8342-b695-4bea-aed2-dcb3ce5e9bad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:45.859894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-767f8342-b695-4bea-aed2-dcb3ce5e9bad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:45.860351 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-767f8342-b695-4bea-aed2-dcb3ce5e9bad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:45.861034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-767f8342-b695-4bea-aed2-dcb3ce5e9bad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:45.861474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-767f8342-b695-4bea-aed2-dcb3ce5e9bad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:45.861846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-767f8342-b695-4bea-aed2-dcb3ce5e9bad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:45.923107 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-767f8342-b695-4bea-aed2-dcb3ce5e9bad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:45.932263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-767f8342-b695-4bea-aed2-dcb3ce5e9bad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:45.933688 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-767f8342-b695-4bea-aed2-dcb3ce5e9bad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:45.934824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-767f8342-b695-4bea-aed2-dcb3ce5e9bad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.091945 Sep 05 17:20:45.935368 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 788/1731] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:45 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:46.961305 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d84d95c6-87df-4350-85c9-ce4ce0b93367 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:46.961918 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d84d95c6-87df-4350-85c9-ce4ce0b93367 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:46.968805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d84d95c6-87df-4350-85c9-ce4ce0b93367 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:46.969627 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d84d95c6-87df-4350-85c9-ce4ce0b93367 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:46.970053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d84d95c6-87df-4350-85c9-ce4ce0b93367 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:46.970729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d84d95c6-87df-4350-85c9-ce4ce0b93367 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:46.971173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d84d95c6-87df-4350-85c9-ce4ce0b93367 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:46.971587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d84d95c6-87df-4350-85c9-ce4ce0b93367 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:47.039914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d84d95c6-87df-4350-85c9-ce4ce0b93367 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:47.049393 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d84d95c6-87df-4350-85c9-ce4ce0b93367 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:47.050979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d84d95c6-87df-4350-85c9-ce4ce0b93367 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:47.052179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d84d95c6-87df-4350-85c9-ce4ce0b93367 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.094938 Sep 05 17:20:47.052837 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 944/1732] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:46 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:48.082525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b7b89a08-ede3-4962-bd5f-897a17bcd2b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:48.083458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b7b89a08-ede3-4962-bd5f-897a17bcd2b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:48.094621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7b89a08-ede3-4962-bd5f-897a17bcd2b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:48.095405 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7b89a08-ede3-4962-bd5f-897a17bcd2b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:48.096108 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7b89a08-ede3-4962-bd5f-897a17bcd2b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:48.097271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7b89a08-ede3-4962-bd5f-897a17bcd2b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:48.098013 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7b89a08-ede3-4962-bd5f-897a17bcd2b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:48.098696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7b89a08-ede3-4962-bd5f-897a17bcd2b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:48.163568 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b7b89a08-ede3-4962-bd5f-897a17bcd2b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:48.172409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b7b89a08-ede3-4962-bd5f-897a17bcd2b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:48.173826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b7b89a08-ede3-4962-bd5f-897a17bcd2b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:48.174960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b7b89a08-ede3-4962-bd5f-897a17bcd2b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.099154 Sep 05 17:20:48.175819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 789/1733] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:48 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:49.201534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d6d28156-8b1e-47aa-84a0-885861d6a98e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:49.202133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d6d28156-8b1e-47aa-84a0-885861d6a98e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:49.209393 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6d28156-8b1e-47aa-84a0-885861d6a98e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:49.209878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6d28156-8b1e-47aa-84a0-885861d6a98e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:49.210309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6d28156-8b1e-47aa-84a0-885861d6a98e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:49.211011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6d28156-8b1e-47aa-84a0-885861d6a98e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:49.211459 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6d28156-8b1e-47aa-84a0-885861d6a98e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:49.211879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6d28156-8b1e-47aa-84a0-885861d6a98e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:49.278591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d6d28156-8b1e-47aa-84a0-885861d6a98e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:49.287288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d6d28156-8b1e-47aa-84a0-885861d6a98e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:49.288753 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d6d28156-8b1e-47aa-84a0-885861d6a98e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:49.289901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d6d28156-8b1e-47aa-84a0-885861d6a98e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.093387 Sep 05 17:20:49.290480 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 945/1734] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:49 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:50.320417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4a265813-01fd-4481-bda3-377d14655075 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:50.321368 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4a265813-01fd-4481-bda3-377d14655075 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:50.328989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a265813-01fd-4481-bda3-377d14655075 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:50.329473 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a265813-01fd-4481-bda3-377d14655075 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:50.329904 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a265813-01fd-4481-bda3-377d14655075 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:50.330598 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a265813-01fd-4481-bda3-377d14655075 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:50.331050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a265813-01fd-4481-bda3-377d14655075 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:50.331471 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a265813-01fd-4481-bda3-377d14655075 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:50.395297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4a265813-01fd-4481-bda3-377d14655075 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:50.404513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4a265813-01fd-4481-bda3-377d14655075 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:50.405956 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4a265813-01fd-4481-bda3-377d14655075 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:50.407100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4a265813-01fd-4481-bda3-377d14655075 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.093428 Sep 05 17:20:50.407658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 790/1735] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:50 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:51.432721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0873aeb2-e279-43a8-bf31-74ee68c02ed9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:51.433546 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0873aeb2-e279-43a8-bf31-74ee68c02ed9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:51.440478 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0873aeb2-e279-43a8-bf31-74ee68c02ed9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:51.440952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0873aeb2-e279-43a8-bf31-74ee68c02ed9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:51.441378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0873aeb2-e279-43a8-bf31-74ee68c02ed9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:51.442059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0873aeb2-e279-43a8-bf31-74ee68c02ed9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:51.442500 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0873aeb2-e279-43a8-bf31-74ee68c02ed9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:51.442922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0873aeb2-e279-43a8-bf31-74ee68c02ed9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:51.508361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0873aeb2-e279-43a8-bf31-74ee68c02ed9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:51.517323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0873aeb2-e279-43a8-bf31-74ee68c02ed9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:51.518753 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0873aeb2-e279-43a8-bf31-74ee68c02ed9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:51.519895 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0873aeb2-e279-43a8-bf31-74ee68c02ed9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.091412 Sep 05 17:20:51.520513 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 946/1736] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:51 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:52.546311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9ab65f84-1912-49f0-a983-3f19d39bab94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:52.546938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9ab65f84-1912-49f0-a983-3f19d39bab94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:52.553769 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ab65f84-1912-49f0-a983-3f19d39bab94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:52.554250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ab65f84-1912-49f0-a983-3f19d39bab94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:52.554679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ab65f84-1912-49f0-a983-3f19d39bab94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:52.555365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ab65f84-1912-49f0-a983-3f19d39bab94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:52.555815 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ab65f84-1912-49f0-a983-3f19d39bab94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:52.556263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ab65f84-1912-49f0-a983-3f19d39bab94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:52.618711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9ab65f84-1912-49f0-a983-3f19d39bab94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:52.628745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9ab65f84-1912-49f0-a983-3f19d39bab94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:52.630131 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9ab65f84-1912-49f0-a983-3f19d39bab94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:52.631282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9ab65f84-1912-49f0-a983-3f19d39bab94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.089090 Sep 05 17:20:52.631859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 791/1737] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:52 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:53.661726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7cde8279-464f-4eea-97c6-fffefa1f7700 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:53.662620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7cde8279-464f-4eea-97c6-fffefa1f7700 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:53.673775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cde8279-464f-4eea-97c6-fffefa1f7700 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:53.674575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cde8279-464f-4eea-97c6-fffefa1f7700 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:53.675355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cde8279-464f-4eea-97c6-fffefa1f7700 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:53.676573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cde8279-464f-4eea-97c6-fffefa1f7700 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:53.677336 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cde8279-464f-4eea-97c6-fffefa1f7700 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:53.678046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cde8279-464f-4eea-97c6-fffefa1f7700 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:53.744938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7cde8279-464f-4eea-97c6-fffefa1f7700 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:53.753942 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7cde8279-464f-4eea-97c6-fffefa1f7700 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:53.755381 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7cde8279-464f-4eea-97c6-fffefa1f7700 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:53.756547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7cde8279-464f-4eea-97c6-fffefa1f7700 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101946 Sep 05 17:20:53.757106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 947/1738] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:53 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:54.782059 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4abeec03-2cda-4079-8800-b51245607e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:54.782674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4abeec03-2cda-4079-8800-b51245607e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:54.789602 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4abeec03-2cda-4079-8800-b51245607e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:54.790083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4abeec03-2cda-4079-8800-b51245607e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:54.790516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4abeec03-2cda-4079-8800-b51245607e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:54.791204 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4abeec03-2cda-4079-8800-b51245607e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:54.791653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4abeec03-2cda-4079-8800-b51245607e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:54.792074 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4abeec03-2cda-4079-8800-b51245607e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:54.854240 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4abeec03-2cda-4079-8800-b51245607e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:54.863541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4abeec03-2cda-4079-8800-b51245607e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:54.865024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4abeec03-2cda-4079-8800-b51245607e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:54.866192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4abeec03-2cda-4079-8800-b51245607e86 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.088143 Sep 05 17:20:54.866787 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 792/1739] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:54 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:55.895537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7ca7b624-39f6-43fc-b05d-ffe173acb7ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:55.896526 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7ca7b624-39f6-43fc-b05d-ffe173acb7ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:55.905631 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ca7b624-39f6-43fc-b05d-ffe173acb7ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:55.906108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ca7b624-39f6-43fc-b05d-ffe173acb7ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:55.906532 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ca7b624-39f6-43fc-b05d-ffe173acb7ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:55.907218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ca7b624-39f6-43fc-b05d-ffe173acb7ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:55.907667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ca7b624-39f6-43fc-b05d-ffe173acb7ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:55.908081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ca7b624-39f6-43fc-b05d-ffe173acb7ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:55.979389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7ca7b624-39f6-43fc-b05d-ffe173acb7ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:55.992908 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7ca7b624-39f6-43fc-b05d-ffe173acb7ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:55.995046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7ca7b624-39f6-43fc-b05d-ffe173acb7ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:55.996833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7ca7b624-39f6-43fc-b05d-ffe173acb7ce tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.107882 Sep 05 17:20:55.997403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 948/1740] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:55 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:57.035912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-71135347-8b3a-4051-a38d-ea0de22e1f35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:57.036838 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-71135347-8b3a-4051-a38d-ea0de22e1f35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:57.046018 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71135347-8b3a-4051-a38d-ea0de22e1f35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:57.046497 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71135347-8b3a-4051-a38d-ea0de22e1f35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:57.046930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71135347-8b3a-4051-a38d-ea0de22e1f35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:57.047620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71135347-8b3a-4051-a38d-ea0de22e1f35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:57.048069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71135347-8b3a-4051-a38d-ea0de22e1f35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:57.048524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71135347-8b3a-4051-a38d-ea0de22e1f35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:57.114731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-71135347-8b3a-4051-a38d-ea0de22e1f35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:57.123961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-71135347-8b3a-4051-a38d-ea0de22e1f35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:57.125432 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-71135347-8b3a-4051-a38d-ea0de22e1f35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:57.126651 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-71135347-8b3a-4051-a38d-ea0de22e1f35 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097776 Sep 05 17:20:57.127345 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 793/1741] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:57 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:58.154247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e52e38ba-86ed-40f4-a0b8-89180f5c3fd1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:58.154881 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e52e38ba-86ed-40f4-a0b8-89180f5c3fd1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:58.161304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e52e38ba-86ed-40f4-a0b8-89180f5c3fd1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:58.161781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e52e38ba-86ed-40f4-a0b8-89180f5c3fd1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:58.162205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e52e38ba-86ed-40f4-a0b8-89180f5c3fd1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:58.162890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e52e38ba-86ed-40f4-a0b8-89180f5c3fd1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:58.163360 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e52e38ba-86ed-40f4-a0b8-89180f5c3fd1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:58.163777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e52e38ba-86ed-40f4-a0b8-89180f5c3fd1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:58.235701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e52e38ba-86ed-40f4-a0b8-89180f5c3fd1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:58.248743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e52e38ba-86ed-40f4-a0b8-89180f5c3fd1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:58.250192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e52e38ba-86ed-40f4-a0b8-89180f5c3fd1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:58.251329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e52e38ba-86ed-40f4-a0b8-89180f5c3fd1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102821 Sep 05 17:20:58.251899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 949/1742] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:58 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:20:59.290459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1be162e3-850b-4725-a71e-f0704a9a95b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:20:59.291512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1be162e3-850b-4725-a71e-f0704a9a95b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:20:59.299074 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1be162e3-850b-4725-a71e-f0704a9a95b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:59.299555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1be162e3-850b-4725-a71e-f0704a9a95b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:59.299983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1be162e3-850b-4725-a71e-f0704a9a95b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:59.300721 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1be162e3-850b-4725-a71e-f0704a9a95b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:20:59.301173 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1be162e3-850b-4725-a71e-f0704a9a95b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:20:59.301683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1be162e3-850b-4725-a71e-f0704a9a95b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:20:59.364602 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1be162e3-850b-4725-a71e-f0704a9a95b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:59.373845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1be162e3-850b-4725-a71e-f0704a9a95b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:59.375295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1be162e3-850b-4725-a71e-f0704a9a95b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:20:59.376589 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1be162e3-850b-4725-a71e-f0704a9a95b7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.093464 Sep 05 17:20:59.377184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 794/1743] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:20:59 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:00.405448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f986089c-8e38-4cc7-8de0-47d9a841c187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:00.406110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f986089c-8e38-4cc7-8de0-47d9a841c187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:00.413276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f986089c-8e38-4cc7-8de0-47d9a841c187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:00.413756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f986089c-8e38-4cc7-8de0-47d9a841c187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:00.414187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f986089c-8e38-4cc7-8de0-47d9a841c187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:00.414879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f986089c-8e38-4cc7-8de0-47d9a841c187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:00.415328 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f986089c-8e38-4cc7-8de0-47d9a841c187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:00.415749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f986089c-8e38-4cc7-8de0-47d9a841c187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:00.483171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f986089c-8e38-4cc7-8de0-47d9a841c187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:00.492399 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f986089c-8e38-4cc7-8de0-47d9a841c187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:00.493843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f986089c-8e38-4cc7-8de0-47d9a841c187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:00.495004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f986089c-8e38-4cc7-8de0-47d9a841c187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.094239 Sep 05 17:21:00.495820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 950/1744] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:00 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:01.520717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0679e437-a9e2-4100-8721-909b55ac341a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:01.521319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0679e437-a9e2-4100-8721-909b55ac341a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:01.528429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0679e437-a9e2-4100-8721-909b55ac341a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:01.528912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0679e437-a9e2-4100-8721-909b55ac341a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:01.529344 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0679e437-a9e2-4100-8721-909b55ac341a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:01.530035 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0679e437-a9e2-4100-8721-909b55ac341a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:01.530487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0679e437-a9e2-4100-8721-909b55ac341a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:01.530904 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0679e437-a9e2-4100-8721-909b55ac341a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:01.598049 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0679e437-a9e2-4100-8721-909b55ac341a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:01.607264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0679e437-a9e2-4100-8721-909b55ac341a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:01.608750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0679e437-a9e2-4100-8721-909b55ac341a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:01.609904 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0679e437-a9e2-4100-8721-909b55ac341a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.093491 Sep 05 17:21:01.610474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 795/1745] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:01 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:02.638578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9dcdc91b-c8ec-4a49-a351-29b9806301b9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:02.639173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9dcdc91b-c8ec-4a49-a351-29b9806301b9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:02.646327 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dcdc91b-c8ec-4a49-a351-29b9806301b9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:02.646804 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dcdc91b-c8ec-4a49-a351-29b9806301b9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:02.647263 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dcdc91b-c8ec-4a49-a351-29b9806301b9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:02.648010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dcdc91b-c8ec-4a49-a351-29b9806301b9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:02.648516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dcdc91b-c8ec-4a49-a351-29b9806301b9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:02.648963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dcdc91b-c8ec-4a49-a351-29b9806301b9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:02.719448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9dcdc91b-c8ec-4a49-a351-29b9806301b9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:02.733935 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9dcdc91b-c8ec-4a49-a351-29b9806301b9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:02.736260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9dcdc91b-c8ec-4a49-a351-29b9806301b9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:02.738069 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9dcdc91b-c8ec-4a49-a351-29b9806301b9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.105414 Sep 05 17:21:02.738965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 951/1746] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:02 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:03.771010 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-02d43287-421c-498e-b233-3c4932445a9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:03.771865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-02d43287-421c-498e-b233-3c4932445a9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:03.783191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02d43287-421c-498e-b233-3c4932445a9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:03.783942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02d43287-421c-498e-b233-3c4932445a9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:03.784739 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02d43287-421c-498e-b233-3c4932445a9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:03.785860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02d43287-421c-498e-b233-3c4932445a9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:03.786599 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02d43287-421c-498e-b233-3c4932445a9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:03.787282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02d43287-421c-498e-b233-3c4932445a9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:03.854235 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-02d43287-421c-498e-b233-3c4932445a9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:03.863070 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-02d43287-421c-498e-b233-3c4932445a9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:03.864529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-02d43287-421c-498e-b233-3c4932445a9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:03.865661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-02d43287-421c-498e-b233-3c4932445a9c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101398 Sep 05 17:21:03.866218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 796/1747] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:03 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:04.893714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5fef05c6-0a25-48c0-97e6-0c45af244309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:04.894401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5fef05c6-0a25-48c0-97e6-0c45af244309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:04.903127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fef05c6-0a25-48c0-97e6-0c45af244309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:04.903605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fef05c6-0a25-48c0-97e6-0c45af244309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:04.904033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fef05c6-0a25-48c0-97e6-0c45af244309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:04.904759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fef05c6-0a25-48c0-97e6-0c45af244309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:04.905212 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fef05c6-0a25-48c0-97e6-0c45af244309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:04.905628 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fef05c6-0a25-48c0-97e6-0c45af244309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:04.978560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5fef05c6-0a25-48c0-97e6-0c45af244309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:04.992752 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5fef05c6-0a25-48c0-97e6-0c45af244309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:04.994999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5fef05c6-0a25-48c0-97e6-0c45af244309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:04.996404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5fef05c6-0a25-48c0-97e6-0c45af244309 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.109197 Sep 05 17:21:04.996949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 952/1748] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:04 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:06.036529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6453bf97-dfb9-4e7b-865f-6239d30d67ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:06.037534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6453bf97-dfb9-4e7b-865f-6239d30d67ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:06.047562 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6453bf97-dfb9-4e7b-865f-6239d30d67ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:06.048040 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6453bf97-dfb9-4e7b-865f-6239d30d67ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:06.048504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6453bf97-dfb9-4e7b-865f-6239d30d67ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:06.049194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6453bf97-dfb9-4e7b-865f-6239d30d67ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:06.049641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6453bf97-dfb9-4e7b-865f-6239d30d67ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:06.050059 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6453bf97-dfb9-4e7b-865f-6239d30d67ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:06.113914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6453bf97-dfb9-4e7b-865f-6239d30d67ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:06.123434 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6453bf97-dfb9-4e7b-865f-6239d30d67ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:06.124921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6453bf97-dfb9-4e7b-865f-6239d30d67ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:06.126065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6453bf97-dfb9-4e7b-865f-6239d30d67ef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.096292 Sep 05 17:21:06.126626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 797/1749] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:06 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:07.153767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e1934755-5a43-4504-88a0-1ec6cab894d3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:07.154373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e1934755-5a43-4504-88a0-1ec6cab894d3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:07.161218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1934755-5a43-4504-88a0-1ec6cab894d3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:07.161693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1934755-5a43-4504-88a0-1ec6cab894d3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:07.162116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1934755-5a43-4504-88a0-1ec6cab894d3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:07.162803 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1934755-5a43-4504-88a0-1ec6cab894d3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:07.163236 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1934755-5a43-4504-88a0-1ec6cab894d3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:07.163645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1934755-5a43-4504-88a0-1ec6cab894d3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:07.236826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e1934755-5a43-4504-88a0-1ec6cab894d3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:07.245902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e1934755-5a43-4504-88a0-1ec6cab894d3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:07.247219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e1934755-5a43-4504-88a0-1ec6cab894d3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:07.248389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e1934755-5a43-4504-88a0-1ec6cab894d3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.099655 Sep 05 17:21:07.248951 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 953/1750] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:07 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:08.277725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1af495be-431b-4e0f-87c0-1e61b7c76e7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:08.278737 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1af495be-431b-4e0f-87c0-1e61b7c76e7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:08.290221 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1af495be-431b-4e0f-87c0-1e61b7c76e7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:08.291030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1af495be-431b-4e0f-87c0-1e61b7c76e7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:08.291738 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1af495be-431b-4e0f-87c0-1e61b7c76e7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:08.292814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1af495be-431b-4e0f-87c0-1e61b7c76e7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:08.293355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1af495be-431b-4e0f-87c0-1e61b7c76e7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:08.293777 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1af495be-431b-4e0f-87c0-1e61b7c76e7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:08.367923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1af495be-431b-4e0f-87c0-1e61b7c76e7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:08.379037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1af495be-431b-4e0f-87c0-1e61b7c76e7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:08.380502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1af495be-431b-4e0f-87c0-1e61b7c76e7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:08.382157 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1af495be-431b-4e0f-87c0-1e61b7c76e7d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.110998 Sep 05 17:21:08.383001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 798/1751] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:08 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:09.411167 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0bfe28f1-3022-4ae8-bbf8-f87b75b7a0f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:09.412122 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0bfe28f1-3022-4ae8-bbf8-f87b75b7a0f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:09.423677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bfe28f1-3022-4ae8-bbf8-f87b75b7a0f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:09.424534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bfe28f1-3022-4ae8-bbf8-f87b75b7a0f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:09.425210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bfe28f1-3022-4ae8-bbf8-f87b75b7a0f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:09.426674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bfe28f1-3022-4ae8-bbf8-f87b75b7a0f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:09.427427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bfe28f1-3022-4ae8-bbf8-f87b75b7a0f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:09.428127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bfe28f1-3022-4ae8-bbf8-f87b75b7a0f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:09.498031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0bfe28f1-3022-4ae8-bbf8-f87b75b7a0f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:09.506969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0bfe28f1-3022-4ae8-bbf8-f87b75b7a0f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:09.508430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0bfe28f1-3022-4ae8-bbf8-f87b75b7a0f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:09.509546 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0bfe28f1-3022-4ae8-bbf8-f87b75b7a0f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.105304 Sep 05 17:21:09.510100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 954/1752] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:09 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:10.538562 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-54732cc9-d0e4-4ecf-a418-f0b0abb57eaa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:10.539486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-54732cc9-d0e4-4ecf-a418-f0b0abb57eaa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:10.548032 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54732cc9-d0e4-4ecf-a418-f0b0abb57eaa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:10.548544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54732cc9-d0e4-4ecf-a418-f0b0abb57eaa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:10.548970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54732cc9-d0e4-4ecf-a418-f0b0abb57eaa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:10.549648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54732cc9-d0e4-4ecf-a418-f0b0abb57eaa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:10.550093 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54732cc9-d0e4-4ecf-a418-f0b0abb57eaa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:10.550508 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54732cc9-d0e4-4ecf-a418-f0b0abb57eaa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:10.626082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-54732cc9-d0e4-4ecf-a418-f0b0abb57eaa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:10.634830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-54732cc9-d0e4-4ecf-a418-f0b0abb57eaa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:10.636639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-54732cc9-d0e4-4ecf-a418-f0b0abb57eaa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:10.637662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-54732cc9-d0e4-4ecf-a418-f0b0abb57eaa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.105671 Sep 05 17:21:10.638228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 799/1753] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:10 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:11.668524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-74f9abf2-af9a-40d9-8c31-838efc04ca7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:11.669491 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-74f9abf2-af9a-40d9-8c31-838efc04ca7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:11.683891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-74f9abf2-af9a-40d9-8c31-838efc04ca7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:11.684778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-74f9abf2-af9a-40d9-8c31-838efc04ca7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:11.685499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-74f9abf2-af9a-40d9-8c31-838efc04ca7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:11.686746 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-74f9abf2-af9a-40d9-8c31-838efc04ca7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:11.687522 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-74f9abf2-af9a-40d9-8c31-838efc04ca7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:11.688216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-74f9abf2-af9a-40d9-8c31-838efc04ca7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:11.771706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-74f9abf2-af9a-40d9-8c31-838efc04ca7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:11.783071 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-74f9abf2-af9a-40d9-8c31-838efc04ca7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:11.784548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-74f9abf2-af9a-40d9-8c31-838efc04ca7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:11.785708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-74f9abf2-af9a-40d9-8c31-838efc04ca7f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.125212 Sep 05 17:21:11.786266 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 955/1754] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:11 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:12.812807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c2946179-0b82-4356-b6d8-5553e38230b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:12.813583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c2946179-0b82-4356-b6d8-5553e38230b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:12.822023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c2946179-0b82-4356-b6d8-5553e38230b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:12.822615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c2946179-0b82-4356-b6d8-5553e38230b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:12.823141 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c2946179-0b82-4356-b6d8-5553e38230b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:12.824074 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c2946179-0b82-4356-b6d8-5553e38230b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:12.824539 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c2946179-0b82-4356-b6d8-5553e38230b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:12.824944 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c2946179-0b82-4356-b6d8-5553e38230b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:12.889178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c2946179-0b82-4356-b6d8-5553e38230b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:12.904213 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c2946179-0b82-4356-b6d8-5553e38230b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:12.906767 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c2946179-0b82-4356-b6d8-5553e38230b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:12.908522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c2946179-0b82-4356-b6d8-5553e38230b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100540 Sep 05 17:21:12.909353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 800/1755] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:12 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:13.939179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dc63522e-527c-457e-b714-6da6e910f399 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:13.939875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dc63522e-527c-457e-b714-6da6e910f399 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:13.942645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=28 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:21:13.948969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc63522e-527c-457e-b714-6da6e910f399 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:13.949535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc63522e-527c-457e-b714-6da6e910f399 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:13.950041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc63522e-527c-457e-b714-6da6e910f399 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:13.950852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc63522e-527c-457e-b714-6da6e910f399 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:13.951384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc63522e-527c-457e-b714-6da6e910f399 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:13.951861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc63522e-527c-457e-b714-6da6e910f399 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:13.955119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=84 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:21:14.021407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dc63522e-527c-457e-b714-6da6e910f399 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:14.032497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dc63522e-527c-457e-b714-6da6e910f399 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:14.033954 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dc63522e-527c-457e-b714-6da6e910f399 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:14.035109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dc63522e-527c-457e-b714-6da6e910f399 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100689 Sep 05 17:21:14.035794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 956/1756] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:13 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:15.065684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6ca03906-2342-4e4c-9851-585ad0b4799d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:15.066581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6ca03906-2342-4e4c-9851-585ad0b4799d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:15.069503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=28 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:21:15.077396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ca03906-2342-4e4c-9851-585ad0b4799d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:15.077877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ca03906-2342-4e4c-9851-585ad0b4799d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:15.078306 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ca03906-2342-4e4c-9851-585ad0b4799d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:15.078995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ca03906-2342-4e4c-9851-585ad0b4799d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:15.079445 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ca03906-2342-4e4c-9851-585ad0b4799d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:15.079890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ca03906-2342-4e4c-9851-585ad0b4799d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:15.082697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=84 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:21:15.144673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6ca03906-2342-4e4c-9851-585ad0b4799d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:15.154240 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6ca03906-2342-4e4c-9851-585ad0b4799d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:15.155684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6ca03906-2342-4e4c-9851-585ad0b4799d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:15.156983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6ca03906-2342-4e4c-9851-585ad0b4799d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098812 Sep 05 17:21:15.157522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 801/1757] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:15 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:16.186000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fddaed7d-8d02-4b8a-940d-5b85aaf1e5bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:16.186651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fddaed7d-8d02-4b8a-940d-5b85aaf1e5bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:16.194327 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fddaed7d-8d02-4b8a-940d-5b85aaf1e5bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:16.194860 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fddaed7d-8d02-4b8a-940d-5b85aaf1e5bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:16.195331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fddaed7d-8d02-4b8a-940d-5b85aaf1e5bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:16.196088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fddaed7d-8d02-4b8a-940d-5b85aaf1e5bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:16.196615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fddaed7d-8d02-4b8a-940d-5b85aaf1e5bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:16.197088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fddaed7d-8d02-4b8a-940d-5b85aaf1e5bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:16.263818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fddaed7d-8d02-4b8a-940d-5b85aaf1e5bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:16.272552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fddaed7d-8d02-4b8a-940d-5b85aaf1e5bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:16.273979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fddaed7d-8d02-4b8a-940d-5b85aaf1e5bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:16.275113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fddaed7d-8d02-4b8a-940d-5b85aaf1e5bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.095043 Sep 05 17:21:16.275669 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 957/1758] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:16 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:17.304306 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-249e7a9a-19c1-425c-84af-259efb9bd25c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:17.305249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-249e7a9a-19c1-425c-84af-259efb9bd25c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:17.317265 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-249e7a9a-19c1-425c-84af-259efb9bd25c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:17.318058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-249e7a9a-19c1-425c-84af-259efb9bd25c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:17.318771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-249e7a9a-19c1-425c-84af-259efb9bd25c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:17.319899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-249e7a9a-19c1-425c-84af-259efb9bd25c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:17.320686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-249e7a9a-19c1-425c-84af-259efb9bd25c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:17.321374 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-249e7a9a-19c1-425c-84af-259efb9bd25c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:17.394001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-249e7a9a-19c1-425c-84af-259efb9bd25c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:17.403178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-249e7a9a-19c1-425c-84af-259efb9bd25c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:17.404639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-249e7a9a-19c1-425c-84af-259efb9bd25c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:17.405814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-249e7a9a-19c1-425c-84af-259efb9bd25c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.108193 Sep 05 17:21:17.406379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 802/1759] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:17 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:18.431216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aaca052a-4254-4818-b3bb-70994d7f9d8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:18.431796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aaca052a-4254-4818-b3bb-70994d7f9d8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:18.439231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaca052a-4254-4818-b3bb-70994d7f9d8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:18.439716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaca052a-4254-4818-b3bb-70994d7f9d8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:18.440142 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaca052a-4254-4818-b3bb-70994d7f9d8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:18.440862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaca052a-4254-4818-b3bb-70994d7f9d8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:18.441308 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaca052a-4254-4818-b3bb-70994d7f9d8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:18.441727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaca052a-4254-4818-b3bb-70994d7f9d8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:18.505802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aaca052a-4254-4818-b3bb-70994d7f9d8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:18.519138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aaca052a-4254-4818-b3bb-70994d7f9d8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:18.521506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aaca052a-4254-4818-b3bb-70994d7f9d8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:18.523272 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aaca052a-4254-4818-b3bb-70994d7f9d8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.095964 Sep 05 17:21:18.524179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 958/1760] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:18 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:19.553757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-32348cab-5705-4809-9656-dae4babb9ac7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:19.554678 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-32348cab-5705-4809-9656-dae4babb9ac7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:19.565847 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32348cab-5705-4809-9656-dae4babb9ac7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:19.566640 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32348cab-5705-4809-9656-dae4babb9ac7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:19.567342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32348cab-5705-4809-9656-dae4babb9ac7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:19.568519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32348cab-5705-4809-9656-dae4babb9ac7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:19.569264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32348cab-5705-4809-9656-dae4babb9ac7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:19.569947 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32348cab-5705-4809-9656-dae4babb9ac7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:19.633024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-32348cab-5705-4809-9656-dae4babb9ac7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:19.642434 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-32348cab-5705-4809-9656-dae4babb9ac7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:19.643864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-32348cab-5705-4809-9656-dae4babb9ac7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:19.645043 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-32348cab-5705-4809-9656-dae4babb9ac7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098042 Sep 05 17:21:19.645591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 803/1761] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:19 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:20.674249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fed34ffb-ff6f-419c-ac26-5686e61f9a49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:20.675210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fed34ffb-ff6f-419c-ac26-5686e61f9a49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:20.685201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fed34ffb-ff6f-419c-ac26-5686e61f9a49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:20.685685 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fed34ffb-ff6f-419c-ac26-5686e61f9a49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:20.686098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fed34ffb-ff6f-419c-ac26-5686e61f9a49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:20.686816 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fed34ffb-ff6f-419c-ac26-5686e61f9a49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:20.687267 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fed34ffb-ff6f-419c-ac26-5686e61f9a49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:20.687692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fed34ffb-ff6f-419c-ac26-5686e61f9a49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:20.763058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fed34ffb-ff6f-419c-ac26-5686e61f9a49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:20.772280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fed34ffb-ff6f-419c-ac26-5686e61f9a49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:20.773724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fed34ffb-ff6f-419c-ac26-5686e61f9a49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:20.774873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fed34ffb-ff6f-419c-ac26-5686e61f9a49 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.107789 Sep 05 17:21:20.775409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 959/1762] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:20 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:21.804091 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1b4bfa75-ae97-4b42-a90b-73a47b68be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:21.805042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1b4bfa75-ae97-4b42-a90b-73a47b68be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:21.815998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b4bfa75-ae97-4b42-a90b-73a47b68be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:21.816844 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b4bfa75-ae97-4b42-a90b-73a47b68be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:21.817546 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b4bfa75-ae97-4b42-a90b-73a47b68be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:21.818666 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b4bfa75-ae97-4b42-a90b-73a47b68be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:21.819403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b4bfa75-ae97-4b42-a90b-73a47b68be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:21.820089 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b4bfa75-ae97-4b42-a90b-73a47b68be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:21.900101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1b4bfa75-ae97-4b42-a90b-73a47b68be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:21.913746 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1b4bfa75-ae97-4b42-a90b-73a47b68be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:21.915933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1b4bfa75-ae97-4b42-a90b-73a47b68be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:21.917543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1b4bfa75-ae97-4b42-a90b-73a47b68be19 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.120132 Sep 05 17:21:21.918150 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 804/1763] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:21 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:22.946281 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d10fd8df-75d6-4332-82d9-df366ae0a48f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:22.947273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d10fd8df-75d6-4332-82d9-df366ae0a48f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:22.958333 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d10fd8df-75d6-4332-82d9-df366ae0a48f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:22.959127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d10fd8df-75d6-4332-82d9-df366ae0a48f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:22.959842 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d10fd8df-75d6-4332-82d9-df366ae0a48f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:22.961115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d10fd8df-75d6-4332-82d9-df366ae0a48f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:22.961807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d10fd8df-75d6-4332-82d9-df366ae0a48f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:22.962522 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d10fd8df-75d6-4332-82d9-df366ae0a48f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:23.029431 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d10fd8df-75d6-4332-82d9-df366ae0a48f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:23.038242 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d10fd8df-75d6-4332-82d9-df366ae0a48f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:23.039679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d10fd8df-75d6-4332-82d9-df366ae0a48f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:23.040861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d10fd8df-75d6-4332-82d9-df366ae0a48f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101168 Sep 05 17:21:23.041430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 960/1764] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:22 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:24.071154 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fa7aa13a-b20e-4611-b96d-6adfd1d8d22a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:24.072207 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fa7aa13a-b20e-4611-b96d-6adfd1d8d22a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:24.080247 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa7aa13a-b20e-4611-b96d-6adfd1d8d22a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:24.080697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa7aa13a-b20e-4611-b96d-6adfd1d8d22a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:24.081136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa7aa13a-b20e-4611-b96d-6adfd1d8d22a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:24.081828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa7aa13a-b20e-4611-b96d-6adfd1d8d22a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:24.082282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa7aa13a-b20e-4611-b96d-6adfd1d8d22a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:24.082705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa7aa13a-b20e-4611-b96d-6adfd1d8d22a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:24.144981 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fa7aa13a-b20e-4611-b96d-6adfd1d8d22a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:24.153899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fa7aa13a-b20e-4611-b96d-6adfd1d8d22a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:24.155324 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fa7aa13a-b20e-4611-b96d-6adfd1d8d22a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:24.156511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fa7aa13a-b20e-4611-b96d-6adfd1d8d22a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.092053 Sep 05 17:21:24.157074 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 805/1765] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:24 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:25.185736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-adc98ee4-6eff-4f6f-9f7c-181e4c048720 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:25.186435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-adc98ee4-6eff-4f6f-9f7c-181e4c048720 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:25.194056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adc98ee4-6eff-4f6f-9f7c-181e4c048720 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:25.194587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adc98ee4-6eff-4f6f-9f7c-181e4c048720 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:25.195063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adc98ee4-6eff-4f6f-9f7c-181e4c048720 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:25.195829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adc98ee4-6eff-4f6f-9f7c-181e4c048720 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:25.196572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adc98ee4-6eff-4f6f-9f7c-181e4c048720 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:25.197052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adc98ee4-6eff-4f6f-9f7c-181e4c048720 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:25.266946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-adc98ee4-6eff-4f6f-9f7c-181e4c048720 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:25.275904 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-adc98ee4-6eff-4f6f-9f7c-181e4c048720 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:25.277370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-adc98ee4-6eff-4f6f-9f7c-181e4c048720 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:25.278807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-adc98ee4-6eff-4f6f-9f7c-181e4c048720 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100049 Sep 05 17:21:25.279401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 961/1766] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:25 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:26.308736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8c920007-3955-4614-b52f-59a01e90ccfe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:26.309826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8c920007-3955-4614-b52f-59a01e90ccfe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:26.320763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c920007-3955-4614-b52f-59a01e90ccfe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:26.321564 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c920007-3955-4614-b52f-59a01e90ccfe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:26.322290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c920007-3955-4614-b52f-59a01e90ccfe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:26.323432 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c920007-3955-4614-b52f-59a01e90ccfe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:26.324450 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c920007-3955-4614-b52f-59a01e90ccfe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:26.324930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c920007-3955-4614-b52f-59a01e90ccfe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:26.397371 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8c920007-3955-4614-b52f-59a01e90ccfe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:26.406561 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8c920007-3955-4614-b52f-59a01e90ccfe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:26.408003 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8c920007-3955-4614-b52f-59a01e90ccfe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:26.409179 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8c920007-3955-4614-b52f-59a01e90ccfe tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.107181 Sep 05 17:21:26.409743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 806/1767] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:26 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:27.434116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bd75c542-c38b-45ba-b4a5-1ae76782399e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:27.434936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bd75c542-c38b-45ba-b4a5-1ae76782399e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:27.441808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd75c542-c38b-45ba-b4a5-1ae76782399e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:27.442297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd75c542-c38b-45ba-b4a5-1ae76782399e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:27.442720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd75c542-c38b-45ba-b4a5-1ae76782399e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:27.443410 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd75c542-c38b-45ba-b4a5-1ae76782399e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:27.443867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd75c542-c38b-45ba-b4a5-1ae76782399e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:27.444317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd75c542-c38b-45ba-b4a5-1ae76782399e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:27.515293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bd75c542-c38b-45ba-b4a5-1ae76782399e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:27.524726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bd75c542-c38b-45ba-b4a5-1ae76782399e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:27.526169 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bd75c542-c38b-45ba-b4a5-1ae76782399e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:27.527312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bd75c542-c38b-45ba-b4a5-1ae76782399e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097201 Sep 05 17:21:27.527892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 962/1768] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:27 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:28.566982 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-643e2f7a-ab8b-4023-a638-05167696030a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:28.567947 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-643e2f7a-ab8b-4023-a638-05167696030a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:28.577259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-643e2f7a-ab8b-4023-a638-05167696030a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:28.577746 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-643e2f7a-ab8b-4023-a638-05167696030a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:28.578181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-643e2f7a-ab8b-4023-a638-05167696030a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:28.578866 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-643e2f7a-ab8b-4023-a638-05167696030a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:28.579325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-643e2f7a-ab8b-4023-a638-05167696030a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:28.579736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-643e2f7a-ab8b-4023-a638-05167696030a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:28.642913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-643e2f7a-ab8b-4023-a638-05167696030a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:28.653085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-643e2f7a-ab8b-4023-a638-05167696030a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:28.654845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-643e2f7a-ab8b-4023-a638-05167696030a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:28.656006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-643e2f7a-ab8b-4023-a638-05167696030a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.096856 Sep 05 17:21:28.656638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 807/1769] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:28 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:29.685869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d9dbf1cf-432f-4c84-be0d-5f7c70c06712 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:29.686853 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d9dbf1cf-432f-4c84-be0d-5f7c70c06712 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:29.697325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9dbf1cf-432f-4c84-be0d-5f7c70c06712 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:29.698137 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9dbf1cf-432f-4c84-be0d-5f7c70c06712 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:29.698850 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9dbf1cf-432f-4c84-be0d-5f7c70c06712 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:29.699984 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9dbf1cf-432f-4c84-be0d-5f7c70c06712 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:29.700776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9dbf1cf-432f-4c84-be0d-5f7c70c06712 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:29.701481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9dbf1cf-432f-4c84-be0d-5f7c70c06712 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:29.766820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d9dbf1cf-432f-4c84-be0d-5f7c70c06712 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:29.779789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d9dbf1cf-432f-4c84-be0d-5f7c70c06712 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:29.782562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d9dbf1cf-432f-4c84-be0d-5f7c70c06712 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:29.784019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d9dbf1cf-432f-4c84-be0d-5f7c70c06712 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.104952 Sep 05 17:21:29.784934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 963/1770] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:29 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:30.817214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cc18c86b-89c9-4c47-9d59-470cf7d2ef02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:30.817877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cc18c86b-89c9-4c47-9d59-470cf7d2ef02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:30.825216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc18c86b-89c9-4c47-9d59-470cf7d2ef02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:30.825721 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc18c86b-89c9-4c47-9d59-470cf7d2ef02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:30.826173 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc18c86b-89c9-4c47-9d59-470cf7d2ef02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:30.826893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc18c86b-89c9-4c47-9d59-470cf7d2ef02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:30.827366 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc18c86b-89c9-4c47-9d59-470cf7d2ef02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:30.827808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc18c86b-89c9-4c47-9d59-470cf7d2ef02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:30.892183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cc18c86b-89c9-4c47-9d59-470cf7d2ef02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:30.901504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cc18c86b-89c9-4c47-9d59-470cf7d2ef02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:30.902979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cc18c86b-89c9-4c47-9d59-470cf7d2ef02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:30.904182 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cc18c86b-89c9-4c47-9d59-470cf7d2ef02 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.092727 Sep 05 17:21:30.904871 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 808/1771] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:30 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:31.933753 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b03c3524-bf8f-4480-a82e-202e72ae0dfc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:31.934788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b03c3524-bf8f-4480-a82e-202e72ae0dfc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:31.945778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b03c3524-bf8f-4480-a82e-202e72ae0dfc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:31.946575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b03c3524-bf8f-4480-a82e-202e72ae0dfc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:31.947278 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b03c3524-bf8f-4480-a82e-202e72ae0dfc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:31.948462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b03c3524-bf8f-4480-a82e-202e72ae0dfc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:31.949207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b03c3524-bf8f-4480-a82e-202e72ae0dfc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:31.949899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b03c3524-bf8f-4480-a82e-202e72ae0dfc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:32.030262 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b03c3524-bf8f-4480-a82e-202e72ae0dfc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:32.043403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b03c3524-bf8f-4480-a82e-202e72ae0dfc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:32.045726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b03c3524-bf8f-4480-a82e-202e72ae0dfc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:32.047068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b03c3524-bf8f-4480-a82e-202e72ae0dfc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.119836 Sep 05 17:21:32.047937 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 964/1772] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:31 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:33.076907 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c604a21b-e755-427b-9b45-557310361ab5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:33.077865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c604a21b-e755-427b-9b45-557310361ab5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:33.089670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c604a21b-e755-427b-9b45-557310361ab5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:33.090436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c604a21b-e755-427b-9b45-557310361ab5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:33.091152 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c604a21b-e755-427b-9b45-557310361ab5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:33.092404 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c604a21b-e755-427b-9b45-557310361ab5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:33.093163 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c604a21b-e755-427b-9b45-557310361ab5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:33.094394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c604a21b-e755-427b-9b45-557310361ab5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:33.159374 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c604a21b-e755-427b-9b45-557310361ab5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:33.168236 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c604a21b-e755-427b-9b45-557310361ab5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:33.169673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c604a21b-e755-427b-9b45-557310361ab5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:33.170814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c604a21b-e755-427b-9b45-557310361ab5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100747 Sep 05 17:21:33.171413 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 809/1773] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:33 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:34.200618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f37ab5b6-9838-42a2-9f68-c8c5b8c3034a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:34.201667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f37ab5b6-9838-42a2-9f68-c8c5b8c3034a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:34.209414 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f37ab5b6-9838-42a2-9f68-c8c5b8c3034a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:34.209887 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f37ab5b6-9838-42a2-9f68-c8c5b8c3034a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:34.210316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f37ab5b6-9838-42a2-9f68-c8c5b8c3034a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:34.210993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f37ab5b6-9838-42a2-9f68-c8c5b8c3034a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:34.211449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f37ab5b6-9838-42a2-9f68-c8c5b8c3034a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:34.211889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f37ab5b6-9838-42a2-9f68-c8c5b8c3034a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:34.275702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f37ab5b6-9838-42a2-9f68-c8c5b8c3034a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:34.284550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f37ab5b6-9838-42a2-9f68-c8c5b8c3034a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:34.285991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f37ab5b6-9838-42a2-9f68-c8c5b8c3034a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:34.287131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f37ab5b6-9838-42a2-9f68-c8c5b8c3034a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.093202 Sep 05 17:21:34.287689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 965/1774] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:34 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:35.314811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-df7626e4-75fb-4f79-ba36-fe5957de6d42 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:35.315649 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-df7626e4-75fb-4f79-ba36-fe5957de6d42 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:35.322583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df7626e4-75fb-4f79-ba36-fe5957de6d42 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:35.323137 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df7626e4-75fb-4f79-ba36-fe5957de6d42 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:35.323583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df7626e4-75fb-4f79-ba36-fe5957de6d42 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:35.324334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df7626e4-75fb-4f79-ba36-fe5957de6d42 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:35.324801 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df7626e4-75fb-4f79-ba36-fe5957de6d42 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:35.325243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df7626e4-75fb-4f79-ba36-fe5957de6d42 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:35.388857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-df7626e4-75fb-4f79-ba36-fe5957de6d42 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:35.397749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-df7626e4-75fb-4f79-ba36-fe5957de6d42 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:35.399163 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-df7626e4-75fb-4f79-ba36-fe5957de6d42 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:35.400370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-df7626e4-75fb-4f79-ba36-fe5957de6d42 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.091613 Sep 05 17:21:35.400922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 810/1775] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:35 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:36.425694 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-806d030b-bf41-4d44-9a07-a7bbc61d43a5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:36.426293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-806d030b-bf41-4d44-9a07-a7bbc61d43a5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:36.433338 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-806d030b-bf41-4d44-9a07-a7bbc61d43a5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:36.433815 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-806d030b-bf41-4d44-9a07-a7bbc61d43a5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:36.434235 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-806d030b-bf41-4d44-9a07-a7bbc61d43a5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:36.434945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-806d030b-bf41-4d44-9a07-a7bbc61d43a5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:36.435389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-806d030b-bf41-4d44-9a07-a7bbc61d43a5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:36.435805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-806d030b-bf41-4d44-9a07-a7bbc61d43a5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:36.502514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-806d030b-bf41-4d44-9a07-a7bbc61d43a5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:36.515025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-806d030b-bf41-4d44-9a07-a7bbc61d43a5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:36.517270 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-806d030b-bf41-4d44-9a07-a7bbc61d43a5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:36.518559 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-806d030b-bf41-4d44-9a07-a7bbc61d43a5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097229 Sep 05 17:21:36.519130 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 966/1776] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:36 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:37.548648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-792ee55a-1d6b-4dfa-b8b6-b8e6e9e60b5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:37.549847 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-792ee55a-1d6b-4dfa-b8b6-b8e6e9e60b5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:37.560803 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-792ee55a-1d6b-4dfa-b8b6-b8e6e9e60b5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:37.561593 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-792ee55a-1d6b-4dfa-b8b6-b8e6e9e60b5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:37.562294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-792ee55a-1d6b-4dfa-b8b6-b8e6e9e60b5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:37.563419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-792ee55a-1d6b-4dfa-b8b6-b8e6e9e60b5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:37.564202 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-792ee55a-1d6b-4dfa-b8b6-b8e6e9e60b5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:37.564797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-792ee55a-1d6b-4dfa-b8b6-b8e6e9e60b5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:37.629718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-792ee55a-1d6b-4dfa-b8b6-b8e6e9e60b5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:37.638509 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-792ee55a-1d6b-4dfa-b8b6-b8e6e9e60b5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:37.639923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-792ee55a-1d6b-4dfa-b8b6-b8e6e9e60b5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:37.641081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-792ee55a-1d6b-4dfa-b8b6-b8e6e9e60b5f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098986 Sep 05 17:21:37.641632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 811/1777] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:37 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:38.670474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-26552042-87fc-4826-bc50-0cc4efaecbb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:38.671371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-26552042-87fc-4826-bc50-0cc4efaecbb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:38.679500 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26552042-87fc-4826-bc50-0cc4efaecbb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:38.679984 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26552042-87fc-4826-bc50-0cc4efaecbb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:38.680455 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26552042-87fc-4826-bc50-0cc4efaecbb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:38.681148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26552042-87fc-4826-bc50-0cc4efaecbb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:38.681597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26552042-87fc-4826-bc50-0cc4efaecbb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:38.682018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26552042-87fc-4826-bc50-0cc4efaecbb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:38.753442 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-26552042-87fc-4826-bc50-0cc4efaecbb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:38.762647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-26552042-87fc-4826-bc50-0cc4efaecbb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:38.764095 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-26552042-87fc-4826-bc50-0cc4efaecbb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:38.765268 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-26552042-87fc-4826-bc50-0cc4efaecbb0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101586 Sep 05 17:21:38.765833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 967/1778] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:38 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:39.794576 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-66e4237d-9174-4125-880d-125277364a63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:39.795588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-66e4237d-9174-4125-880d-125277364a63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:39.806793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-66e4237d-9174-4125-880d-125277364a63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:39.807603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-66e4237d-9174-4125-880d-125277364a63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:39.808331 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-66e4237d-9174-4125-880d-125277364a63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:39.809441 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-66e4237d-9174-4125-880d-125277364a63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:39.810189 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-66e4237d-9174-4125-880d-125277364a63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:39.811073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-66e4237d-9174-4125-880d-125277364a63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:39.877611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-66e4237d-9174-4125-880d-125277364a63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:39.886598 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-66e4237d-9174-4125-880d-125277364a63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:39.888015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-66e4237d-9174-4125-880d-125277364a63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:39.889177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-66e4237d-9174-4125-880d-125277364a63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101162 Sep 05 17:21:39.889729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 812/1779] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:39 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:40.915794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0b4d96c2-f663-4b7e-a29c-41540bc9d149 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:40.916421 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0b4d96c2-f663-4b7e-a29c-41540bc9d149 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:40.924633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b4d96c2-f663-4b7e-a29c-41540bc9d149 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:40.925255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b4d96c2-f663-4b7e-a29c-41540bc9d149 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:40.925911 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b4d96c2-f663-4b7e-a29c-41540bc9d149 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:40.926650 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b4d96c2-f663-4b7e-a29c-41540bc9d149 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:40.927329 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b4d96c2-f663-4b7e-a29c-41540bc9d149 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:40.927906 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b4d96c2-f663-4b7e-a29c-41540bc9d149 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:40.998888 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0b4d96c2-f663-4b7e-a29c-41540bc9d149 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:41.008093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0b4d96c2-f663-4b7e-a29c-41540bc9d149 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:41.009573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0b4d96c2-f663-4b7e-a29c-41540bc9d149 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:41.010730 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0b4d96c2-f663-4b7e-a29c-41540bc9d149 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.099196 Sep 05 17:21:41.011321 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 968/1780] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:40 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:42.040580 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cfa7f687-3272-4aa8-9674-23a98a855cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:42.041645 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cfa7f687-3272-4aa8-9674-23a98a855cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:42.052660 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfa7f687-3272-4aa8-9674-23a98a855cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:42.053449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfa7f687-3272-4aa8-9674-23a98a855cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:42.054158 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfa7f687-3272-4aa8-9674-23a98a855cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:42.055290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfa7f687-3272-4aa8-9674-23a98a855cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:42.056034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfa7f687-3272-4aa8-9674-23a98a855cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:42.056779 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfa7f687-3272-4aa8-9674-23a98a855cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:42.124831 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cfa7f687-3272-4aa8-9674-23a98a855cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:42.134206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cfa7f687-3272-4aa8-9674-23a98a855cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:42.135633 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cfa7f687-3272-4aa8-9674-23a98a855cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:42.136793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cfa7f687-3272-4aa8-9674-23a98a855cb1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102904 Sep 05 17:21:42.137353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 813/1781] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:42 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:43.167312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-48708a5c-4f84-4568-91b0-e019b2902260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:43.168389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-48708a5c-4f84-4568-91b0-e019b2902260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:43.177376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48708a5c-4f84-4568-91b0-e019b2902260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:43.177854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48708a5c-4f84-4568-91b0-e019b2902260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:43.178289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48708a5c-4f84-4568-91b0-e019b2902260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:43.178988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48708a5c-4f84-4568-91b0-e019b2902260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:43.179424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48708a5c-4f84-4568-91b0-e019b2902260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:43.179877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48708a5c-4f84-4568-91b0-e019b2902260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:43.244256 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-48708a5c-4f84-4568-91b0-e019b2902260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:43.253312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-48708a5c-4f84-4568-91b0-e019b2902260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:43.254760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-48708a5c-4f84-4568-91b0-e019b2902260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:43.255909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-48708a5c-4f84-4568-91b0-e019b2902260 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.095332 Sep 05 17:21:43.256518 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 969/1782] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:43 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:44.281528 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1dd70992-da69-4b7c-b1e8-7bedb7fbf50c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:44.282134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1dd70992-da69-4b7c-b1e8-7bedb7fbf50c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:44.288894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1dd70992-da69-4b7c-b1e8-7bedb7fbf50c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:44.289375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1dd70992-da69-4b7c-b1e8-7bedb7fbf50c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:44.289801 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1dd70992-da69-4b7c-b1e8-7bedb7fbf50c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:44.290524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1dd70992-da69-4b7c-b1e8-7bedb7fbf50c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:44.290974 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1dd70992-da69-4b7c-b1e8-7bedb7fbf50c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:44.291394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1dd70992-da69-4b7c-b1e8-7bedb7fbf50c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:44.354891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1dd70992-da69-4b7c-b1e8-7bedb7fbf50c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:44.364249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1dd70992-da69-4b7c-b1e8-7bedb7fbf50c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:44.365694 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1dd70992-da69-4b7c-b1e8-7bedb7fbf50c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:44.366840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1dd70992-da69-4b7c-b1e8-7bedb7fbf50c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.089541 Sep 05 17:21:44.367402 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 814/1783] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:44 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:45.395545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0a286608-fe61-48f1-8953-050cba1baa24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:45.396183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0a286608-fe61-48f1-8953-050cba1baa24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:45.398542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=28 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:21:45.404077 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a286608-fe61-48f1-8953-050cba1baa24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:45.404594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a286608-fe61-48f1-8953-050cba1baa24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:45.405023 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a286608-fe61-48f1-8953-050cba1baa24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:45.405713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a286608-fe61-48f1-8953-050cba1baa24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:45.406163 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a286608-fe61-48f1-8953-050cba1baa24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:45.406582 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a286608-fe61-48f1-8953-050cba1baa24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:45.409945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=84 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:21:45.478778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0a286608-fe61-48f1-8953-050cba1baa24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:45.488038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0a286608-fe61-48f1-8953-050cba1baa24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:45.489519 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0a286608-fe61-48f1-8953-050cba1baa24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:45.490665 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0a286608-fe61-48f1-8953-050cba1baa24 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100914 Sep 05 17:21:45.491227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 970/1784] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:45 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:46.524612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a27c901d-5a01-43b4-aebb-46184e308734 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:46.525225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a27c901d-5a01-43b4-aebb-46184e308734 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:46.527525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=28 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:21:46.532957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a27c901d-5a01-43b4-aebb-46184e308734 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:46.533436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a27c901d-5a01-43b4-aebb-46184e308734 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:46.533891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a27c901d-5a01-43b4-aebb-46184e308734 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:46.534575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a27c901d-5a01-43b4-aebb-46184e308734 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:46.535023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a27c901d-5a01-43b4-aebb-46184e308734 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:46.535438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a27c901d-5a01-43b4-aebb-46184e308734 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:46.538184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=84 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:21:46.607616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a27c901d-5a01-43b4-aebb-46184e308734 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:46.616743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a27c901d-5a01-43b4-aebb-46184e308734 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:46.618183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a27c901d-5a01-43b4-aebb-46184e308734 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:46.619329 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a27c901d-5a01-43b4-aebb-46184e308734 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098790 Sep 05 17:21:46.619896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 815/1785] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:46 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:47.644689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c8ff46a7-4afa-4107-8aa5-6106fff28830 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:47.645305 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c8ff46a7-4afa-4107-8aa5-6106fff28830 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:47.652071 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8ff46a7-4afa-4107-8aa5-6106fff28830 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:47.652596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8ff46a7-4afa-4107-8aa5-6106fff28830 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:47.653027 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8ff46a7-4afa-4107-8aa5-6106fff28830 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:47.653714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8ff46a7-4afa-4107-8aa5-6106fff28830 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:47.654158 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8ff46a7-4afa-4107-8aa5-6106fff28830 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:47.654574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8ff46a7-4afa-4107-8aa5-6106fff28830 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:47.722147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c8ff46a7-4afa-4107-8aa5-6106fff28830 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:47.735820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c8ff46a7-4afa-4107-8aa5-6106fff28830 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:47.737547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c8ff46a7-4afa-4107-8aa5-6106fff28830 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:47.738709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c8ff46a7-4afa-4107-8aa5-6106fff28830 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098359 Sep 05 17:21:47.739275 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 971/1786] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:47 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:48.770417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f0a3deb4-2b1a-406d-b809-13a30f9c3225 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:48.771316 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f0a3deb4-2b1a-406d-b809-13a30f9c3225 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:48.782324 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0a3deb4-2b1a-406d-b809-13a30f9c3225 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:48.783241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0a3deb4-2b1a-406d-b809-13a30f9c3225 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:48.783678 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0a3deb4-2b1a-406d-b809-13a30f9c3225 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:48.784411 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0a3deb4-2b1a-406d-b809-13a30f9c3225 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:48.784861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0a3deb4-2b1a-406d-b809-13a30f9c3225 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:48.785301 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0a3deb4-2b1a-406d-b809-13a30f9c3225 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:48.854124 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f0a3deb4-2b1a-406d-b809-13a30f9c3225 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:48.863403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f0a3deb4-2b1a-406d-b809-13a30f9c3225 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:48.864915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f0a3deb4-2b1a-406d-b809-13a30f9c3225 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:48.866069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f0a3deb4-2b1a-406d-b809-13a30f9c3225 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.104937 Sep 05 17:21:48.866629 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 816/1787] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:48 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:49.891258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-460c9194-b844-40d6-916a-d7739161a687 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:49.891848 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-460c9194-b844-40d6-916a-d7739161a687 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:49.899006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-460c9194-b844-40d6-916a-d7739161a687 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:49.899491 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-460c9194-b844-40d6-916a-d7739161a687 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:49.899924 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-460c9194-b844-40d6-916a-d7739161a687 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:49.900655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-460c9194-b844-40d6-916a-d7739161a687 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:49.901110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-460c9194-b844-40d6-916a-d7739161a687 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:49.901535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-460c9194-b844-40d6-916a-d7739161a687 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:49.964109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-460c9194-b844-40d6-916a-d7739161a687 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:49.973838 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-460c9194-b844-40d6-916a-d7739161a687 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:49.975283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-460c9194-b844-40d6-916a-d7739161a687 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:49.976460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-460c9194-b844-40d6-916a-d7739161a687 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.089221 Sep 05 17:21:49.977041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 972/1788] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:49 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:51.004976 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a6ee8214-a3d4-4171-a3b1-0e926c73f2f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:51.005899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a6ee8214-a3d4-4171-a3b1-0e926c73f2f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:51.017060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a6ee8214-a3d4-4171-a3b1-0e926c73f2f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:51.017902 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a6ee8214-a3d4-4171-a3b1-0e926c73f2f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:51.018626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a6ee8214-a3d4-4171-a3b1-0e926c73f2f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:51.019778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a6ee8214-a3d4-4171-a3b1-0e926c73f2f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:51.020623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a6ee8214-a3d4-4171-a3b1-0e926c73f2f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:51.021345 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a6ee8214-a3d4-4171-a3b1-0e926c73f2f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:51.089166 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a6ee8214-a3d4-4171-a3b1-0e926c73f2f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:51.098933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a6ee8214-a3d4-4171-a3b1-0e926c73f2f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:51.100419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a6ee8214-a3d4-4171-a3b1-0e926c73f2f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:51.101579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a6ee8214-a3d4-4171-a3b1-0e926c73f2f7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.103354 Sep 05 17:21:51.102146 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 817/1789] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:50 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:52.131811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-df3478a0-c9c3-4ff2-bd11-fdddc120cc55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:52.132835 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-df3478a0-c9c3-4ff2-bd11-fdddc120cc55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:52.147116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df3478a0-c9c3-4ff2-bd11-fdddc120cc55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:52.147654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df3478a0-c9c3-4ff2-bd11-fdddc120cc55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:52.148134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df3478a0-c9c3-4ff2-bd11-fdddc120cc55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:52.148945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df3478a0-c9c3-4ff2-bd11-fdddc120cc55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:52.149451 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df3478a0-c9c3-4ff2-bd11-fdddc120cc55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:52.149913 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df3478a0-c9c3-4ff2-bd11-fdddc120cc55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:52.221086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-df3478a0-c9c3-4ff2-bd11-fdddc120cc55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:52.229845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-df3478a0-c9c3-4ff2-bd11-fdddc120cc55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:52.231290 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-df3478a0-c9c3-4ff2-bd11-fdddc120cc55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:52.232472 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-df3478a0-c9c3-4ff2-bd11-fdddc120cc55 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.107795 Sep 05 17:21:52.233065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 973/1790] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:52 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:53.259739 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8f0f4fc8-6ffc-4669-aefc-4b1d27c15d76 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:53.260499 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8f0f4fc8-6ffc-4669-aefc-4b1d27c15d76 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:53.263168 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:21:53.263335 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:21:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 (ip 10.222.0.23) !!! Sep 05 17:21:53.264839 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:21:53.265006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:21:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 (ip 10.222.0.23) !!! Sep 05 17:21:53.279100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8f0f4fc8-6ffc-4669-aefc-4b1d27c15d76 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:53.279605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8f0f4fc8-6ffc-4669-aefc-4b1d27c15d76 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:53.280027 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8f0f4fc8-6ffc-4669-aefc-4b1d27c15d76 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:53.280729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8f0f4fc8-6ffc-4669-aefc-4b1d27c15d76 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:53.281173 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8f0f4fc8-6ffc-4669-aefc-4b1d27c15d76 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:53.281591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8f0f4fc8-6ffc-4669-aefc-4b1d27c15d76 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:53.345513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8f0f4fc8-6ffc-4669-aefc-4b1d27c15d76 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:53.355265 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8f0f4fc8-6ffc-4669-aefc-4b1d27c15d76 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:53.356749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8f0f4fc8-6ffc-4669-aefc-4b1d27c15d76 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:53.357883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8f0f4fc8-6ffc-4669-aefc-4b1d27c15d76 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.104046 Sep 05 17:21:53.358445 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 818/1791] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:53 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:54.384055 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7b5e8409-230f-4be4-804c-44d9a4db13b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:54.384736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7b5e8409-230f-4be4-804c-44d9a4db13b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:54.391699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b5e8409-230f-4be4-804c-44d9a4db13b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:54.392186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b5e8409-230f-4be4-804c-44d9a4db13b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:54.392641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b5e8409-230f-4be4-804c-44d9a4db13b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:54.393340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b5e8409-230f-4be4-804c-44d9a4db13b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:54.394004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b5e8409-230f-4be4-804c-44d9a4db13b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:54.394647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b5e8409-230f-4be4-804c-44d9a4db13b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:54.455726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7b5e8409-230f-4be4-804c-44d9a4db13b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:54.464575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7b5e8409-230f-4be4-804c-44d9a4db13b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:54.466022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7b5e8409-230f-4be4-804c-44d9a4db13b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:54.467170 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7b5e8409-230f-4be4-804c-44d9a4db13b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.087151 Sep 05 17:21:54.467733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 974/1792] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:54 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:55.494207 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-65f33569-3653-4aff-9a24-e880d0deb28d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:55.495016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-65f33569-3653-4aff-9a24-e880d0deb28d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:55.504234 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-65f33569-3653-4aff-9a24-e880d0deb28d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:55.504947 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-65f33569-3653-4aff-9a24-e880d0deb28d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:55.505599 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-65f33569-3653-4aff-9a24-e880d0deb28d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:55.506576 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-65f33569-3653-4aff-9a24-e880d0deb28d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:55.507225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-65f33569-3653-4aff-9a24-e880d0deb28d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:55.507827 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-65f33569-3653-4aff-9a24-e880d0deb28d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:55.574165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-65f33569-3653-4aff-9a24-e880d0deb28d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:55.583154 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-65f33569-3653-4aff-9a24-e880d0deb28d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:55.584628 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-65f33569-3653-4aff-9a24-e880d0deb28d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:55.585789 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-65f33569-3653-4aff-9a24-e880d0deb28d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097530 Sep 05 17:21:55.586345 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 819/1793] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:55 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:56.613791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aac8f089-e6ee-441e-b4aa-2d62e0b2e201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:56.614990 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aac8f089-e6ee-441e-b4aa-2d62e0b2e201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:56.626834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aac8f089-e6ee-441e-b4aa-2d62e0b2e201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:56.627731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aac8f089-e6ee-441e-b4aa-2d62e0b2e201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:56.628545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aac8f089-e6ee-441e-b4aa-2d62e0b2e201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:56.629670 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aac8f089-e6ee-441e-b4aa-2d62e0b2e201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:56.630320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aac8f089-e6ee-441e-b4aa-2d62e0b2e201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:56.630962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aac8f089-e6ee-441e-b4aa-2d62e0b2e201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:56.707944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aac8f089-e6ee-441e-b4aa-2d62e0b2e201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:56.721358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aac8f089-e6ee-441e-b4aa-2d62e0b2e201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:56.723626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aac8f089-e6ee-441e-b4aa-2d62e0b2e201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:56.724801 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aac8f089-e6ee-441e-b4aa-2d62e0b2e201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.117038 Sep 05 17:21:56.725358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 975/1794] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:56 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:57.753524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7f912fd6-8e62-45d8-99c9-512262b68b5e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:57.755581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7f912fd6-8e62-45d8-99c9-512262b68b5e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:57.766532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f912fd6-8e62-45d8-99c9-512262b68b5e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:57.767321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f912fd6-8e62-45d8-99c9-512262b68b5e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:57.768023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f912fd6-8e62-45d8-99c9-512262b68b5e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:57.769213 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f912fd6-8e62-45d8-99c9-512262b68b5e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:57.770153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f912fd6-8e62-45d8-99c9-512262b68b5e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:57.770726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f912fd6-8e62-45d8-99c9-512262b68b5e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:57.844528 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7f912fd6-8e62-45d8-99c9-512262b68b5e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:57.857510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7f912fd6-8e62-45d8-99c9-512262b68b5e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:57.859769 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7f912fd6-8e62-45d8-99c9-512262b68b5e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:57.861608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7f912fd6-8e62-45d8-99c9-512262b68b5e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.114510 Sep 05 17:21:57.862406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 820/1795] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:57 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:21:58.892544 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9aaec2ab-da83-48ac-b462-ed434fd23b2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:21:58.893572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9aaec2ab-da83-48ac-b462-ed434fd23b2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:21:58.904216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9aaec2ab-da83-48ac-b462-ed434fd23b2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:58.905038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9aaec2ab-da83-48ac-b462-ed434fd23b2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:58.905745 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9aaec2ab-da83-48ac-b462-ed434fd23b2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:58.906819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9aaec2ab-da83-48ac-b462-ed434fd23b2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:21:58.907601 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9aaec2ab-da83-48ac-b462-ed434fd23b2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:21:58.908354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9aaec2ab-da83-48ac-b462-ed434fd23b2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:21:58.970718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9aaec2ab-da83-48ac-b462-ed434fd23b2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:58.979728 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9aaec2ab-da83-48ac-b462-ed434fd23b2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:58.981177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9aaec2ab-da83-48ac-b462-ed434fd23b2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:21:58.982314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9aaec2ab-da83-48ac-b462-ed434fd23b2e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097058 Sep 05 17:21:58.982874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 976/1796] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:21:58 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:00.012056 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-784551fe-1a51-483e-9145-27dcbeedf3db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:00.013042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-784551fe-1a51-483e-9145-27dcbeedf3db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:00.023174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-784551fe-1a51-483e-9145-27dcbeedf3db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:00.023653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-784551fe-1a51-483e-9145-27dcbeedf3db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:00.024081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-784551fe-1a51-483e-9145-27dcbeedf3db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:00.024809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-784551fe-1a51-483e-9145-27dcbeedf3db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:00.025257 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-784551fe-1a51-483e-9145-27dcbeedf3db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:00.025679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-784551fe-1a51-483e-9145-27dcbeedf3db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:00.095782 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-784551fe-1a51-483e-9145-27dcbeedf3db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:00.105347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-784551fe-1a51-483e-9145-27dcbeedf3db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:00.106773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-784551fe-1a51-483e-9145-27dcbeedf3db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:00.107915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-784551fe-1a51-483e-9145-27dcbeedf3db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102419 Sep 05 17:22:00.108506 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 821/1797] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:00 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:01.138511 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-569ccb09-06dd-4d5f-9809-ca1b6cb963f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:01.139355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-569ccb09-06dd-4d5f-9809-ca1b6cb963f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:01.150357 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-569ccb09-06dd-4d5f-9809-ca1b6cb963f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:01.151164 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-569ccb09-06dd-4d5f-9809-ca1b6cb963f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:01.151888 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-569ccb09-06dd-4d5f-9809-ca1b6cb963f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:01.153104 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-569ccb09-06dd-4d5f-9809-ca1b6cb963f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:01.153857 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-569ccb09-06dd-4d5f-9809-ca1b6cb963f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:01.154555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-569ccb09-06dd-4d5f-9809-ca1b6cb963f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:01.221538 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-569ccb09-06dd-4d5f-9809-ca1b6cb963f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:01.230685 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-569ccb09-06dd-4d5f-9809-ca1b6cb963f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:01.232134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-569ccb09-06dd-4d5f-9809-ca1b6cb963f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:01.233317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-569ccb09-06dd-4d5f-9809-ca1b6cb963f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102024 Sep 05 17:22:01.233875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 977/1798] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:01 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:02.269255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6a0399a2-8724-4e59-8c42-46ababbb9875 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:02.270017 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6a0399a2-8724-4e59-8c42-46ababbb9875 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:02.277308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a0399a2-8724-4e59-8c42-46ababbb9875 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:02.277796 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a0399a2-8724-4e59-8c42-46ababbb9875 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:02.278223 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a0399a2-8724-4e59-8c42-46ababbb9875 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:02.278925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a0399a2-8724-4e59-8c42-46ababbb9875 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:02.279368 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a0399a2-8724-4e59-8c42-46ababbb9875 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:02.279790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a0399a2-8724-4e59-8c42-46ababbb9875 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:02.348450 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6a0399a2-8724-4e59-8c42-46ababbb9875 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:02.357674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6a0399a2-8724-4e59-8c42-46ababbb9875 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:02.359122 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6a0399a2-8724-4e59-8c42-46ababbb9875 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:02.360300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6a0399a2-8724-4e59-8c42-46ababbb9875 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097202 Sep 05 17:22:02.360865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 822/1799] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:02 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:03.385858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f5319784-598c-44e3-a3f8-b2cf391fce11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:03.386476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f5319784-598c-44e3-a3f8-b2cf391fce11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:03.394003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5319784-598c-44e3-a3f8-b2cf391fce11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:03.394416 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5319784-598c-44e3-a3f8-b2cf391fce11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:03.394851 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5319784-598c-44e3-a3f8-b2cf391fce11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:03.395813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5319784-598c-44e3-a3f8-b2cf391fce11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:03.396309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5319784-598c-44e3-a3f8-b2cf391fce11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:03.396739 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5319784-598c-44e3-a3f8-b2cf391fce11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:03.459982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f5319784-598c-44e3-a3f8-b2cf391fce11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:03.469145 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f5319784-598c-44e3-a3f8-b2cf391fce11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:03.470590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f5319784-598c-44e3-a3f8-b2cf391fce11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:03.471736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f5319784-598c-44e3-a3f8-b2cf391fce11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.089982 Sep 05 17:22:03.472680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 978/1800] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:03 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:04.497331 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f46e503a-6726-41bf-b6d7-24043351793f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:04.497954 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f46e503a-6726-41bf-b6d7-24043351793f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:04.505379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f46e503a-6726-41bf-b6d7-24043351793f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:04.505863 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f46e503a-6726-41bf-b6d7-24043351793f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:04.506288 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f46e503a-6726-41bf-b6d7-24043351793f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:04.506978 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f46e503a-6726-41bf-b6d7-24043351793f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:04.507420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f46e503a-6726-41bf-b6d7-24043351793f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:04.507836 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f46e503a-6726-41bf-b6d7-24043351793f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:04.718960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f46e503a-6726-41bf-b6d7-24043351793f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:04.728868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f46e503a-6726-41bf-b6d7-24043351793f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:04.730308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f46e503a-6726-41bf-b6d7-24043351793f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:04.731460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f46e503a-6726-41bf-b6d7-24043351793f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.238116 Sep 05 17:22:04.732020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 823/1801] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:04 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:05.761764 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-130d9b12-0081-451b-8993-a4adce97452e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:05.762440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-130d9b12-0081-451b-8993-a4adce97452e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:05.771711 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130d9b12-0081-451b-8993-a4adce97452e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:05.772374 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130d9b12-0081-451b-8993-a4adce97452e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:05.772806 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130d9b12-0081-451b-8993-a4adce97452e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:05.773494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130d9b12-0081-451b-8993-a4adce97452e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:05.773940 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130d9b12-0081-451b-8993-a4adce97452e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:05.774357 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130d9b12-0081-451b-8993-a4adce97452e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:05.914821 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-130d9b12-0081-451b-8993-a4adce97452e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:05.927937 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-130d9b12-0081-451b-8993-a4adce97452e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:05.929402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-130d9b12-0081-451b-8993-a4adce97452e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:05.930565 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-130d9b12-0081-451b-8993-a4adce97452e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.175205 Sep 05 17:22:05.931099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 979/1802] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:05 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:06.960297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-46e236ad-22f4-48b3-9cc7-ba4396c51c47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:06.961344 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-46e236ad-22f4-48b3-9cc7-ba4396c51c47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:06.972597 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46e236ad-22f4-48b3-9cc7-ba4396c51c47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:06.973331 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46e236ad-22f4-48b3-9cc7-ba4396c51c47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:06.974036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46e236ad-22f4-48b3-9cc7-ba4396c51c47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:06.975184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46e236ad-22f4-48b3-9cc7-ba4396c51c47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:06.975891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46e236ad-22f4-48b3-9cc7-ba4396c51c47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:06.975982 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-46e236ad-22f4-48b3-9cc7-ba4396c51c47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:07.039351 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-46e236ad-22f4-48b3-9cc7-ba4396c51c47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:07.048607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-46e236ad-22f4-48b3-9cc7-ba4396c51c47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:07.050046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-46e236ad-22f4-48b3-9cc7-ba4396c51c47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:07.051194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-46e236ad-22f4-48b3-9cc7-ba4396c51c47 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097630 Sep 05 17:22:07.051759 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 824/1803] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:06 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:08.080935 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-68997615-5eef-4468-8cd6-c057bd74a786 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:08.081945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-68997615-5eef-4468-8cd6-c057bd74a786 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:08.089907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68997615-5eef-4468-8cd6-c057bd74a786 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:08.090396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68997615-5eef-4468-8cd6-c057bd74a786 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:08.090831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68997615-5eef-4468-8cd6-c057bd74a786 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:08.091531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68997615-5eef-4468-8cd6-c057bd74a786 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:08.091983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68997615-5eef-4468-8cd6-c057bd74a786 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:08.092450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68997615-5eef-4468-8cd6-c057bd74a786 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:08.155734 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-68997615-5eef-4468-8cd6-c057bd74a786 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:08.164993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-68997615-5eef-4468-8cd6-c057bd74a786 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:08.166430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-68997615-5eef-4468-8cd6-c057bd74a786 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:08.167572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-68997615-5eef-4468-8cd6-c057bd74a786 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.093390 Sep 05 17:22:08.168162 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 980/1804] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:08 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:09.196726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9c24caee-a6dc-4e51-89e2-8c777461272b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:09.197414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9c24caee-a6dc-4e51-89e2-8c777461272b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:09.205613 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c24caee-a6dc-4e51-89e2-8c777461272b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:09.206213 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c24caee-a6dc-4e51-89e2-8c777461272b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:09.206751 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c24caee-a6dc-4e51-89e2-8c777461272b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:09.207638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c24caee-a6dc-4e51-89e2-8c777461272b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:09.208201 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c24caee-a6dc-4e51-89e2-8c777461272b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:09.208784 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c24caee-a6dc-4e51-89e2-8c777461272b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:09.284797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9c24caee-a6dc-4e51-89e2-8c777461272b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:09.293992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9c24caee-a6dc-4e51-89e2-8c777461272b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:09.295422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9c24caee-a6dc-4e51-89e2-8c777461272b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:09.296603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9c24caee-a6dc-4e51-89e2-8c777461272b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.105743 Sep 05 17:22:09.297167 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 825/1805] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:09 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:10.322890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5315444f-78b5-4d9f-8c7d-8a4fac997feb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:10.323530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5315444f-78b5-4d9f-8c7d-8a4fac997feb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:10.330715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5315444f-78b5-4d9f-8c7d-8a4fac997feb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:10.331199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5315444f-78b5-4d9f-8c7d-8a4fac997feb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:10.331640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5315444f-78b5-4d9f-8c7d-8a4fac997feb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:10.332373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5315444f-78b5-4d9f-8c7d-8a4fac997feb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:10.334983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5315444f-78b5-4d9f-8c7d-8a4fac997feb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:10.335466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5315444f-78b5-4d9f-8c7d-8a4fac997feb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:10.412576 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5315444f-78b5-4d9f-8c7d-8a4fac997feb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:10.422287 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5315444f-78b5-4d9f-8c7d-8a4fac997feb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:10.423732 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5315444f-78b5-4d9f-8c7d-8a4fac997feb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:10.426094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5315444f-78b5-4d9f-8c7d-8a4fac997feb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.107961 Sep 05 17:22:10.426676 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 981/1806] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:10 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:11.457239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4a39adfd-85f8-437c-9d95-b185cb817aff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:11.458236 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4a39adfd-85f8-437c-9d95-b185cb817aff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:11.469888 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a39adfd-85f8-437c-9d95-b185cb817aff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:11.470640 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a39adfd-85f8-437c-9d95-b185cb817aff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:11.471368 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a39adfd-85f8-437c-9d95-b185cb817aff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:11.472534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a39adfd-85f8-437c-9d95-b185cb817aff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:11.473276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a39adfd-85f8-437c-9d95-b185cb817aff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:11.473966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4a39adfd-85f8-437c-9d95-b185cb817aff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:11.539791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4a39adfd-85f8-437c-9d95-b185cb817aff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:11.553651 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4a39adfd-85f8-437c-9d95-b185cb817aff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:11.556041 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4a39adfd-85f8-437c-9d95-b185cb817aff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:11.557913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4a39adfd-85f8-437c-9d95-b185cb817aff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.107110 Sep 05 17:22:11.558796 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 826/1807] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:11 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:12.587844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-898dee60-a6ba-4932-bb1d-fdbe66d15335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:12.588488 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-898dee60-a6ba-4932-bb1d-fdbe66d15335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:12.595712 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-898dee60-a6ba-4932-bb1d-fdbe66d15335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:12.596254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-898dee60-a6ba-4932-bb1d-fdbe66d15335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:12.596691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-898dee60-a6ba-4932-bb1d-fdbe66d15335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:12.597387 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-898dee60-a6ba-4932-bb1d-fdbe66d15335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:12.597818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-898dee60-a6ba-4932-bb1d-fdbe66d15335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:12.598239 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-898dee60-a6ba-4932-bb1d-fdbe66d15335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:12.661768 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-898dee60-a6ba-4932-bb1d-fdbe66d15335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:12.670806 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-898dee60-a6ba-4932-bb1d-fdbe66d15335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:12.672275 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-898dee60-a6ba-4932-bb1d-fdbe66d15335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:12.673430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-898dee60-a6ba-4932-bb1d-fdbe66d15335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.090011 Sep 05 17:22:12.674009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 982/1808] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:12 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:13.700643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6c9f285d-fbaa-4bdb-a770-328dfe11a335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:13.701341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6c9f285d-fbaa-4bdb-a770-328dfe11a335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:13.709739 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c9f285d-fbaa-4bdb-a770-328dfe11a335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:13.710379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c9f285d-fbaa-4bdb-a770-328dfe11a335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:13.710960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c9f285d-fbaa-4bdb-a770-328dfe11a335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:13.711906 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c9f285d-fbaa-4bdb-a770-328dfe11a335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:13.712556 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c9f285d-fbaa-4bdb-a770-328dfe11a335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:13.713111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6c9f285d-fbaa-4bdb-a770-328dfe11a335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:13.784560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6c9f285d-fbaa-4bdb-a770-328dfe11a335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:13.795194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6c9f285d-fbaa-4bdb-a770-328dfe11a335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:13.796646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6c9f285d-fbaa-4bdb-a770-328dfe11a335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:13.797780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6c9f285d-fbaa-4bdb-a770-328dfe11a335 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102747 Sep 05 17:22:13.798337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 827/1809] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:13 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:14.827268 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-eb1f15b1-6e15-4e5a-b588-c873453969cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:14.828255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-eb1f15b1-6e15-4e5a-b588-c873453969cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:14.838440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb1f15b1-6e15-4e5a-b588-c873453969cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:14.838915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb1f15b1-6e15-4e5a-b588-c873453969cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:14.839340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb1f15b1-6e15-4e5a-b588-c873453969cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:14.840020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb1f15b1-6e15-4e5a-b588-c873453969cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:14.840498 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb1f15b1-6e15-4e5a-b588-c873453969cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:14.840912 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb1f15b1-6e15-4e5a-b588-c873453969cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:14.906369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eb1f15b1-6e15-4e5a-b588-c873453969cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:14.916673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eb1f15b1-6e15-4e5a-b588-c873453969cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:14.918999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eb1f15b1-6e15-4e5a-b588-c873453969cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:14.920389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-eb1f15b1-6e15-4e5a-b588-c873453969cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.099887 Sep 05 17:22:14.920963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 983/1810] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:14 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:15.949679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9e84e903-f34e-468b-a7f0-acb9d0d92b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:15.950673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9e84e903-f34e-468b-a7f0-acb9d0d92b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:15.961628 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9e84e903-f34e-468b-a7f0-acb9d0d92b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:15.962426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9e84e903-f34e-468b-a7f0-acb9d0d92b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:15.963365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9e84e903-f34e-468b-a7f0-acb9d0d92b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:15.964314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9e84e903-f34e-468b-a7f0-acb9d0d92b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:15.965112 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9e84e903-f34e-468b-a7f0-acb9d0d92b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:15.965752 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9e84e903-f34e-468b-a7f0-acb9d0d92b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:16.033480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9e84e903-f34e-468b-a7f0-acb9d0d92b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:16.042664 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9e84e903-f34e-468b-a7f0-acb9d0d92b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:16.044100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9e84e903-f34e-468b-a7f0-acb9d0d92b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:16.045290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9e84e903-f34e-468b-a7f0-acb9d0d92b3f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102409 Sep 05 17:22:16.045847 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 828/1811] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:15 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:17.075096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-451a4fab-874b-4e2b-bfc1-b389dc4fd668 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:17.076024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-451a4fab-874b-4e2b-bfc1-b389dc4fd668 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:17.079773 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=28 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:22:17.088354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-451a4fab-874b-4e2b-bfc1-b389dc4fd668 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:17.088840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-451a4fab-874b-4e2b-bfc1-b389dc4fd668 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:17.089273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-451a4fab-874b-4e2b-bfc1-b389dc4fd668 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:17.089964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-451a4fab-874b-4e2b-bfc1-b389dc4fd668 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:17.090421 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-451a4fab-874b-4e2b-bfc1-b389dc4fd668 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:17.090839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-451a4fab-874b-4e2b-bfc1-b389dc4fd668 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:17.093793 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=84 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:22:17.154088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-451a4fab-874b-4e2b-bfc1-b389dc4fd668 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:17.162960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-451a4fab-874b-4e2b-bfc1-b389dc4fd668 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:17.164461 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-451a4fab-874b-4e2b-bfc1-b389dc4fd668 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:17.165663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-451a4fab-874b-4e2b-bfc1-b389dc4fd668 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097522 Sep 05 17:22:17.166259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 984/1812] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:17 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:18.191400 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a43573a5-3e76-4b36-8299-eadaea8bf5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:18.192127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a43573a5-3e76-4b36-8299-eadaea8bf5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:18.194792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=28 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:22:18.200510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a43573a5-3e76-4b36-8299-eadaea8bf5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:18.200989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a43573a5-3e76-4b36-8299-eadaea8bf5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:18.201417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a43573a5-3e76-4b36-8299-eadaea8bf5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:18.202105 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a43573a5-3e76-4b36-8299-eadaea8bf5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:18.202558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a43573a5-3e76-4b36-8299-eadaea8bf5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:18.202971 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a43573a5-3e76-4b36-8299-eadaea8bf5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:18.207173 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=84 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:22:18.270015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a43573a5-3e76-4b36-8299-eadaea8bf5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:18.278962 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a43573a5-3e76-4b36-8299-eadaea8bf5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:18.280438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a43573a5-3e76-4b36-8299-eadaea8bf5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:18.281583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a43573a5-3e76-4b36-8299-eadaea8bf5cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.094785 Sep 05 17:22:18.282119 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 829/1813] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:18 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:19.311659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-70888363-bf79-4c31-8130-be9fbf138f48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:19.312607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-70888363-bf79-4c31-8130-be9fbf138f48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:19.323820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70888363-bf79-4c31-8130-be9fbf138f48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:19.324695 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70888363-bf79-4c31-8130-be9fbf138f48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:19.325402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70888363-bf79-4c31-8130-be9fbf138f48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:19.326530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70888363-bf79-4c31-8130-be9fbf138f48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:19.327269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70888363-bf79-4c31-8130-be9fbf138f48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:19.327963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70888363-bf79-4c31-8130-be9fbf138f48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:19.396642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-70888363-bf79-4c31-8130-be9fbf138f48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:19.405684 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-70888363-bf79-4c31-8130-be9fbf138f48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:19.407109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-70888363-bf79-4c31-8130-be9fbf138f48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:19.408273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-70888363-bf79-4c31-8130-be9fbf138f48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.103844 Sep 05 17:22:19.408835 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 985/1814] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:19 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:20.436951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-48b71111-779f-45fd-9df9-43176f49d602 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:20.437835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-48b71111-779f-45fd-9df9-43176f49d602 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:20.448358 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-48b71111-779f-45fd-9df9-43176f49d602 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:20.448985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-48b71111-779f-45fd-9df9-43176f49d602 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:20.449586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-48b71111-779f-45fd-9df9-43176f49d602 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:20.450616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-48b71111-779f-45fd-9df9-43176f49d602 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:20.451250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-48b71111-779f-45fd-9df9-43176f49d602 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:20.451807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-48b71111-779f-45fd-9df9-43176f49d602 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:20.522217 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-48b71111-779f-45fd-9df9-43176f49d602 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:20.530973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-48b71111-779f-45fd-9df9-43176f49d602 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:20.532449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-48b71111-779f-45fd-9df9-43176f49d602 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:20.533598 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-48b71111-779f-45fd-9df9-43176f49d602 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102876 Sep 05 17:22:20.534162 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 830/1815] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:20 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:21.561076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-75ac8bce-6c48-44fb-b091-c51b9077562f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:21.561706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-75ac8bce-6c48-44fb-b091-c51b9077562f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:21.567749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75ac8bce-6c48-44fb-b091-c51b9077562f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:21.568269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75ac8bce-6c48-44fb-b091-c51b9077562f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:21.568703 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75ac8bce-6c48-44fb-b091-c51b9077562f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:21.569389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75ac8bce-6c48-44fb-b091-c51b9077562f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:21.569844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75ac8bce-6c48-44fb-b091-c51b9077562f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:21.570260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75ac8bce-6c48-44fb-b091-c51b9077562f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:21.639292 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-75ac8bce-6c48-44fb-b091-c51b9077562f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:21.648302 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-75ac8bce-6c48-44fb-b091-c51b9077562f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:21.649849 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-75ac8bce-6c48-44fb-b091-c51b9077562f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:21.651000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-75ac8bce-6c48-44fb-b091-c51b9077562f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.094735 Sep 05 17:22:21.651569 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 986/1816] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:21 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:22.680520 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-174d2aa3-3d1e-47e8-b8c7-666a96a745b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:22.681551 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-174d2aa3-3d1e-47e8-b8c7-666a96a745b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:22.692849 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174d2aa3-3d1e-47e8-b8c7-666a96a745b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:22.693729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174d2aa3-3d1e-47e8-b8c7-666a96a745b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:22.694434 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174d2aa3-3d1e-47e8-b8c7-666a96a745b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:22.695555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174d2aa3-3d1e-47e8-b8c7-666a96a745b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:22.696331 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174d2aa3-3d1e-47e8-b8c7-666a96a745b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:22.697210 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-174d2aa3-3d1e-47e8-b8c7-666a96a745b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:22.769033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-174d2aa3-3d1e-47e8-b8c7-666a96a745b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:22.778062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-174d2aa3-3d1e-47e8-b8c7-666a96a745b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:22.779483 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-174d2aa3-3d1e-47e8-b8c7-666a96a745b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:22.780643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-174d2aa3-3d1e-47e8-b8c7-666a96a745b3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.106854 Sep 05 17:22:22.781172 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 831/1817] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:22 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:23.809469 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bf81bfcd-c1bc-4f49-8f1f-daba7cb56ccf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:23.810394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bf81bfcd-c1bc-4f49-8f1f-daba7cb56ccf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:23.818868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf81bfcd-c1bc-4f49-8f1f-daba7cb56ccf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:23.819485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf81bfcd-c1bc-4f49-8f1f-daba7cb56ccf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:23.820037 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf81bfcd-c1bc-4f49-8f1f-daba7cb56ccf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:23.821131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf81bfcd-c1bc-4f49-8f1f-daba7cb56ccf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:23.821592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf81bfcd-c1bc-4f49-8f1f-daba7cb56ccf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:23.822182 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf81bfcd-c1bc-4f49-8f1f-daba7cb56ccf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:23.894902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bf81bfcd-c1bc-4f49-8f1f-daba7cb56ccf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:23.904405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bf81bfcd-c1bc-4f49-8f1f-daba7cb56ccf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:23.905875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bf81bfcd-c1bc-4f49-8f1f-daba7cb56ccf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:23.907031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bf81bfcd-c1bc-4f49-8f1f-daba7cb56ccf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.103767 Sep 05 17:22:23.907577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 987/1818] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:23 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:24.935471 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d035f0f3-a5f8-432c-860c-062fe9b0fc66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:24.936499 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d035f0f3-a5f8-432c-860c-062fe9b0fc66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:24.947342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d035f0f3-a5f8-432c-860c-062fe9b0fc66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:24.947825 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d035f0f3-a5f8-432c-860c-062fe9b0fc66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:24.948255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d035f0f3-a5f8-432c-860c-062fe9b0fc66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:24.948961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d035f0f3-a5f8-432c-860c-062fe9b0fc66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:24.949411 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d035f0f3-a5f8-432c-860c-062fe9b0fc66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:24.949818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d035f0f3-a5f8-432c-860c-062fe9b0fc66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:25.010723 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d035f0f3-a5f8-432c-860c-062fe9b0fc66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:25.022945 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d035f0f3-a5f8-432c-860c-062fe9b0fc66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:25.025291 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d035f0f3-a5f8-432c-860c-062fe9b0fc66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:25.027102 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d035f0f3-a5f8-432c-860c-062fe9b0fc66 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098197 Sep 05 17:22:25.028055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 832/1819] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:24 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:26.060328 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-13505583-e6e1-40c2-be34-3e94be0206d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:26.061138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-13505583-e6e1-40c2-be34-3e94be0206d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:26.069183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-13505583-e6e1-40c2-be34-3e94be0206d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:26.069736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-13505583-e6e1-40c2-be34-3e94be0206d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:26.070235 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-13505583-e6e1-40c2-be34-3e94be0206d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:26.071039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-13505583-e6e1-40c2-be34-3e94be0206d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:26.071543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-13505583-e6e1-40c2-be34-3e94be0206d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:26.072055 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-13505583-e6e1-40c2-be34-3e94be0206d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:26.136884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-13505583-e6e1-40c2-be34-3e94be0206d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:26.146696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-13505583-e6e1-40c2-be34-3e94be0206d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:26.148216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-13505583-e6e1-40c2-be34-3e94be0206d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:26.149428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-13505583-e6e1-40c2-be34-3e94be0206d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.094297 Sep 05 17:22:26.150540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 988/1820] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:26 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:27.175924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3239e696-c0cd-41a3-8391-bd6df063ed3d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:27.176556 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3239e696-c0cd-41a3-8391-bd6df063ed3d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:27.184460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3239e696-c0cd-41a3-8391-bd6df063ed3d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:27.184914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3239e696-c0cd-41a3-8391-bd6df063ed3d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:27.185339 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3239e696-c0cd-41a3-8391-bd6df063ed3d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:27.186040 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3239e696-c0cd-41a3-8391-bd6df063ed3d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:27.186486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3239e696-c0cd-41a3-8391-bd6df063ed3d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:27.186896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3239e696-c0cd-41a3-8391-bd6df063ed3d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:27.254216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3239e696-c0cd-41a3-8391-bd6df063ed3d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:27.264777 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3239e696-c0cd-41a3-8391-bd6df063ed3d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:27.266203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3239e696-c0cd-41a3-8391-bd6df063ed3d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:27.267343 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3239e696-c0cd-41a3-8391-bd6df063ed3d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.095987 Sep 05 17:22:27.267894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 833/1821] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:27 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:28.297255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3441a8ef-c178-4def-92fb-1628e9b12dea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:28.298308 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3441a8ef-c178-4def-92fb-1628e9b12dea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:28.307924 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3441a8ef-c178-4def-92fb-1628e9b12dea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:28.308439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3441a8ef-c178-4def-92fb-1628e9b12dea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:28.308871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3441a8ef-c178-4def-92fb-1628e9b12dea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:28.309560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3441a8ef-c178-4def-92fb-1628e9b12dea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:28.310009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3441a8ef-c178-4def-92fb-1628e9b12dea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:28.310424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3441a8ef-c178-4def-92fb-1628e9b12dea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:28.375972 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3441a8ef-c178-4def-92fb-1628e9b12dea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:28.385363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3441a8ef-c178-4def-92fb-1628e9b12dea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:28.386850 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3441a8ef-c178-4def-92fb-1628e9b12dea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:28.387997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3441a8ef-c178-4def-92fb-1628e9b12dea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097562 Sep 05 17:22:28.388635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 989/1822] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:28 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:29.418726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c517815f-1c1f-4d4d-b121-515b4cddac27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:29.419362 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c517815f-1c1f-4d4d-b121-515b4cddac27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:29.426370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c517815f-1c1f-4d4d-b121-515b4cddac27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:29.426856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c517815f-1c1f-4d4d-b121-515b4cddac27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:29.427317 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c517815f-1c1f-4d4d-b121-515b4cddac27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:29.428022 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c517815f-1c1f-4d4d-b121-515b4cddac27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:29.428515 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c517815f-1c1f-4d4d-b121-515b4cddac27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:29.428944 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c517815f-1c1f-4d4d-b121-515b4cddac27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:29.490180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c517815f-1c1f-4d4d-b121-515b4cddac27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:29.499590 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c517815f-1c1f-4d4d-b121-515b4cddac27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:29.501076 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c517815f-1c1f-4d4d-b121-515b4cddac27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:29.502305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c517815f-1c1f-4d4d-b121-515b4cddac27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.088188 Sep 05 17:22:29.502878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 834/1823] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:29 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:30.529845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9c858741-19e1-4e0b-aa68-641729bc39e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:30.530580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9c858741-19e1-4e0b-aa68-641729bc39e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:30.539032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c858741-19e1-4e0b-aa68-641729bc39e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:30.539636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c858741-19e1-4e0b-aa68-641729bc39e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:30.540186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c858741-19e1-4e0b-aa68-641729bc39e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:30.541125 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c858741-19e1-4e0b-aa68-641729bc39e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:30.541677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c858741-19e1-4e0b-aa68-641729bc39e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:30.542206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c858741-19e1-4e0b-aa68-641729bc39e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:30.607024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9c858741-19e1-4e0b-aa68-641729bc39e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:30.616014 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9c858741-19e1-4e0b-aa68-641729bc39e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:30.617500 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9c858741-19e1-4e0b-aa68-641729bc39e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:30.618729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9c858741-19e1-4e0b-aa68-641729bc39e5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.094024 Sep 05 17:22:30.619294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 990/1824] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:30 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:31.645747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d36446f9-2850-4e96-a006-5d3d84aa7240 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:31.646392 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d36446f9-2850-4e96-a006-5d3d84aa7240 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:31.655355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d36446f9-2850-4e96-a006-5d3d84aa7240 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:31.655965 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d36446f9-2850-4e96-a006-5d3d84aa7240 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:31.656563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d36446f9-2850-4e96-a006-5d3d84aa7240 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:31.657394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d36446f9-2850-4e96-a006-5d3d84aa7240 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:31.657977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d36446f9-2850-4e96-a006-5d3d84aa7240 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:31.658511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d36446f9-2850-4e96-a006-5d3d84aa7240 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:31.724952 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d36446f9-2850-4e96-a006-5d3d84aa7240 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:31.734835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d36446f9-2850-4e96-a006-5d3d84aa7240 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:31.736309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d36446f9-2850-4e96-a006-5d3d84aa7240 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:31.737450 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d36446f9-2850-4e96-a006-5d3d84aa7240 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097234 Sep 05 17:22:31.738006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 835/1825] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:31 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:32.775604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-201a91b0-ff43-4647-a7db-08fc045a6854 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:32.776289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-201a91b0-ff43-4647-a7db-08fc045a6854 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:32.783642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-201a91b0-ff43-4647-a7db-08fc045a6854 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:32.784183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-201a91b0-ff43-4647-a7db-08fc045a6854 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:32.784680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-201a91b0-ff43-4647-a7db-08fc045a6854 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:32.785440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-201a91b0-ff43-4647-a7db-08fc045a6854 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:32.785936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-201a91b0-ff43-4647-a7db-08fc045a6854 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:32.786402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-201a91b0-ff43-4647-a7db-08fc045a6854 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:32.853852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-201a91b0-ff43-4647-a7db-08fc045a6854 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:32.862563 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-201a91b0-ff43-4647-a7db-08fc045a6854 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:32.863991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-201a91b0-ff43-4647-a7db-08fc045a6854 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:32.865160 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-201a91b0-ff43-4647-a7db-08fc045a6854 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097245 Sep 05 17:22:32.865720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 991/1826] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:32 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:33.894794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c9dec916-e126-43d2-b9f3-c8bb177f2a65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:33.895807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c9dec916-e126-43d2-b9f3-c8bb177f2a65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:33.906648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9dec916-e126-43d2-b9f3-c8bb177f2a65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:33.907453 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9dec916-e126-43d2-b9f3-c8bb177f2a65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:33.908188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9dec916-e126-43d2-b9f3-c8bb177f2a65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:33.909342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9dec916-e126-43d2-b9f3-c8bb177f2a65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:33.910093 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9dec916-e126-43d2-b9f3-c8bb177f2a65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:33.910789 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9dec916-e126-43d2-b9f3-c8bb177f2a65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:33.977106 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c9dec916-e126-43d2-b9f3-c8bb177f2a65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:33.986191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c9dec916-e126-43d2-b9f3-c8bb177f2a65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:33.987624 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c9dec916-e126-43d2-b9f3-c8bb177f2a65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:33.988768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c9dec916-e126-43d2-b9f3-c8bb177f2a65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100861 Sep 05 17:22:33.989377 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 836/1827] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:33 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:35.025247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e7fa0ecf-9773-4bcd-8234-06e43bdf3b6f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:35.026059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e7fa0ecf-9773-4bcd-8234-06e43bdf3b6f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:35.034443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7fa0ecf-9773-4bcd-8234-06e43bdf3b6f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:35.035063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7fa0ecf-9773-4bcd-8234-06e43bdf3b6f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:35.035598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7fa0ecf-9773-4bcd-8234-06e43bdf3b6f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:35.036492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7fa0ecf-9773-4bcd-8234-06e43bdf3b6f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:35.037050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7fa0ecf-9773-4bcd-8234-06e43bdf3b6f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:35.037570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7fa0ecf-9773-4bcd-8234-06e43bdf3b6f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:35.108409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e7fa0ecf-9773-4bcd-8234-06e43bdf3b6f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:35.117321 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e7fa0ecf-9773-4bcd-8234-06e43bdf3b6f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:35.118963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e7fa0ecf-9773-4bcd-8234-06e43bdf3b6f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:35.120125 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e7fa0ecf-9773-4bcd-8234-06e43bdf3b6f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101497 Sep 05 17:22:35.120681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 992/1828] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:35 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:36.147007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c80244af-36f9-47af-aacc-9966026ca4d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:36.147699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c80244af-36f9-47af-aacc-9966026ca4d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:36.154512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c80244af-36f9-47af-aacc-9966026ca4d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:36.154992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c80244af-36f9-47af-aacc-9966026ca4d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:36.155416 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c80244af-36f9-47af-aacc-9966026ca4d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:36.156107 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c80244af-36f9-47af-aacc-9966026ca4d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:36.156855 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c80244af-36f9-47af-aacc-9966026ca4d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:36.157271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c80244af-36f9-47af-aacc-9966026ca4d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:36.220736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c80244af-36f9-47af-aacc-9966026ca4d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:36.230287 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c80244af-36f9-47af-aacc-9966026ca4d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:36.231790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c80244af-36f9-47af-aacc-9966026ca4d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:36.232977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c80244af-36f9-47af-aacc-9966026ca4d8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.090075 Sep 05 17:22:36.233535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 837/1829] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:36 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:37.262602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1b04c932-8ba3-4851-b018-e248eaa8d242 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:37.263576 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1b04c932-8ba3-4851-b018-e248eaa8d242 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:37.274750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b04c932-8ba3-4851-b018-e248eaa8d242 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:37.275639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b04c932-8ba3-4851-b018-e248eaa8d242 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:37.276074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b04c932-8ba3-4851-b018-e248eaa8d242 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:37.276789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b04c932-8ba3-4851-b018-e248eaa8d242 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:37.277241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b04c932-8ba3-4851-b018-e248eaa8d242 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:37.277661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b04c932-8ba3-4851-b018-e248eaa8d242 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:37.345382 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1b04c932-8ba3-4851-b018-e248eaa8d242 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:37.354259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1b04c932-8ba3-4851-b018-e248eaa8d242 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:37.355703 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1b04c932-8ba3-4851-b018-e248eaa8d242 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:37.356883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1b04c932-8ba3-4851-b018-e248eaa8d242 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101304 Sep 05 17:22:37.357449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 993/1830] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:37 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:38.385417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1c640c0b-d780-4ed2-b27b-5e35b07361df tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:38.386023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1c640c0b-d780-4ed2-b27b-5e35b07361df tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:38.393090 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c640c0b-d780-4ed2-b27b-5e35b07361df tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:38.393559 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c640c0b-d780-4ed2-b27b-5e35b07361df tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:38.394005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c640c0b-d780-4ed2-b27b-5e35b07361df tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:38.394685 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c640c0b-d780-4ed2-b27b-5e35b07361df tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:38.395128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c640c0b-d780-4ed2-b27b-5e35b07361df tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:38.395540 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c640c0b-d780-4ed2-b27b-5e35b07361df tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:38.462234 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1c640c0b-d780-4ed2-b27b-5e35b07361df tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:38.471670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1c640c0b-d780-4ed2-b27b-5e35b07361df tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:38.473146 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1c640c0b-d780-4ed2-b27b-5e35b07361df tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:38.474294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1c640c0b-d780-4ed2-b27b-5e35b07361df tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.095468 Sep 05 17:22:38.474854 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 838/1831] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:38 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:39.501389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a2c4cbab-d1a2-44ae-ae75-b5a444129ca8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:39.502076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a2c4cbab-d1a2-44ae-ae75-b5a444129ca8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:39.511324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2c4cbab-d1a2-44ae-ae75-b5a444129ca8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:39.511940 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2c4cbab-d1a2-44ae-ae75-b5a444129ca8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:39.512653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2c4cbab-d1a2-44ae-ae75-b5a444129ca8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:39.513698 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2c4cbab-d1a2-44ae-ae75-b5a444129ca8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:39.514310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2c4cbab-d1a2-44ae-ae75-b5a444129ca8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:39.514870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2c4cbab-d1a2-44ae-ae75-b5a444129ca8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:39.581172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a2c4cbab-d1a2-44ae-ae75-b5a444129ca8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:39.592966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a2c4cbab-d1a2-44ae-ae75-b5a444129ca8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:39.594749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a2c4cbab-d1a2-44ae-ae75-b5a444129ca8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:39.595901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a2c4cbab-d1a2-44ae-ae75-b5a444129ca8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.099010 Sep 05 17:22:39.596500 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 994/1832] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:39 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:40.625365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-904240dc-e68f-417c-ae63-42869127a646 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:40.626308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-904240dc-e68f-417c-ae63-42869127a646 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:40.636483 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-904240dc-e68f-417c-ae63-42869127a646 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:40.636893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-904240dc-e68f-417c-ae63-42869127a646 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:40.637321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-904240dc-e68f-417c-ae63-42869127a646 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:40.638016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-904240dc-e68f-417c-ae63-42869127a646 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:40.638466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-904240dc-e68f-417c-ae63-42869127a646 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:40.638894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-904240dc-e68f-417c-ae63-42869127a646 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:40.703886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-904240dc-e68f-417c-ae63-42869127a646 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:40.712913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-904240dc-e68f-417c-ae63-42869127a646 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:40.714356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-904240dc-e68f-417c-ae63-42869127a646 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:40.715495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-904240dc-e68f-417c-ae63-42869127a646 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.096925 Sep 05 17:22:40.716069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 839/1833] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:40 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:41.746780 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c9126fac-af7c-4817-92d4-8e951ee8d86b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:41.747477 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c9126fac-af7c-4817-92d4-8e951ee8d86b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:41.755808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9126fac-af7c-4817-92d4-8e951ee8d86b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:41.756455 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9126fac-af7c-4817-92d4-8e951ee8d86b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:41.757000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9126fac-af7c-4817-92d4-8e951ee8d86b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:41.757873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9126fac-af7c-4817-92d4-8e951ee8d86b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:41.758430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9126fac-af7c-4817-92d4-8e951ee8d86b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:41.758958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9126fac-af7c-4817-92d4-8e951ee8d86b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:41.834620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c9126fac-af7c-4817-92d4-8e951ee8d86b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:41.845535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c9126fac-af7c-4817-92d4-8e951ee8d86b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:41.847006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c9126fac-af7c-4817-92d4-8e951ee8d86b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:41.848136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c9126fac-af7c-4817-92d4-8e951ee8d86b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.108760 Sep 05 17:22:41.848691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 995/1834] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:41 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:42.876994 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1dcd2e8f-d0d5-4016-915f-a6cc4decd9e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:42.877963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1dcd2e8f-d0d5-4016-915f-a6cc4decd9e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:42.887298 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1dcd2e8f-d0d5-4016-915f-a6cc4decd9e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:42.887770 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1dcd2e8f-d0d5-4016-915f-a6cc4decd9e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:42.888206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1dcd2e8f-d0d5-4016-915f-a6cc4decd9e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:42.889277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1dcd2e8f-d0d5-4016-915f-a6cc4decd9e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:42.889404 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1dcd2e8f-d0d5-4016-915f-a6cc4decd9e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:42.889808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1dcd2e8f-d0d5-4016-915f-a6cc4decd9e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:42.956113 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1dcd2e8f-d0d5-4016-915f-a6cc4decd9e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:42.969828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1dcd2e8f-d0d5-4016-915f-a6cc4decd9e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:42.972055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1dcd2e8f-d0d5-4016-915f-a6cc4decd9e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:42.973845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1dcd2e8f-d0d5-4016-915f-a6cc4decd9e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.103482 Sep 05 17:22:42.974592 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 840/1835] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:42 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:44.004929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0c29ab7f-a253-4362-ab90-847f8372628c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:44.005976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0c29ab7f-a253-4362-ab90-847f8372628c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:44.017505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c29ab7f-a253-4362-ab90-847f8372628c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:44.018300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c29ab7f-a253-4362-ab90-847f8372628c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:44.019018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c29ab7f-a253-4362-ab90-847f8372628c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:44.020205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c29ab7f-a253-4362-ab90-847f8372628c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:44.020946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c29ab7f-a253-4362-ab90-847f8372628c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:44.021648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c29ab7f-a253-4362-ab90-847f8372628c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:44.084541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0c29ab7f-a253-4362-ab90-847f8372628c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:44.094227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0c29ab7f-a253-4362-ab90-847f8372628c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:44.095678 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0c29ab7f-a253-4362-ab90-847f8372628c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:44.096868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0c29ab7f-a253-4362-ab90-847f8372628c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098634 Sep 05 17:22:44.097411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 996/1836] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:43 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:45.125765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2b6eb4b7-5e66-49a3-9699-5702bbfd41a7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:45.126616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2b6eb4b7-5e66-49a3-9699-5702bbfd41a7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:45.136183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b6eb4b7-5e66-49a3-9699-5702bbfd41a7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:45.136682 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b6eb4b7-5e66-49a3-9699-5702bbfd41a7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:45.137111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b6eb4b7-5e66-49a3-9699-5702bbfd41a7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:45.137796 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b6eb4b7-5e66-49a3-9699-5702bbfd41a7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:45.138244 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b6eb4b7-5e66-49a3-9699-5702bbfd41a7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:45.138664 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b6eb4b7-5e66-49a3-9699-5702bbfd41a7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:45.210555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2b6eb4b7-5e66-49a3-9699-5702bbfd41a7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:45.219653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2b6eb4b7-5e66-49a3-9699-5702bbfd41a7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:45.221116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2b6eb4b7-5e66-49a3-9699-5702bbfd41a7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:45.222258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2b6eb4b7-5e66-49a3-9699-5702bbfd41a7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102640 Sep 05 17:22:45.222827 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 841/1837] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:45 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:46.251826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6a521267-41c0-44bf-8f18-679f8d1d0551 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:46.252843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6a521267-41c0-44bf-8f18-679f8d1d0551 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:46.264021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a521267-41c0-44bf-8f18-679f8d1d0551 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:46.264862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a521267-41c0-44bf-8f18-679f8d1d0551 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:46.265584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a521267-41c0-44bf-8f18-679f8d1d0551 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:46.266765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a521267-41c0-44bf-8f18-679f8d1d0551 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:46.267518 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a521267-41c0-44bf-8f18-679f8d1d0551 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:46.268222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a521267-41c0-44bf-8f18-679f8d1d0551 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:46.338422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6a521267-41c0-44bf-8f18-679f8d1d0551 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:46.348000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6a521267-41c0-44bf-8f18-679f8d1d0551 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:46.349482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6a521267-41c0-44bf-8f18-679f8d1d0551 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:46.350668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6a521267-41c0-44bf-8f18-679f8d1d0551 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.105548 Sep 05 17:22:46.351245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 997/1838] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:46 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:47.379775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8e73030a-0994-43ad-85e4-4719d7c75702 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:47.380781 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8e73030a-0994-43ad-85e4-4719d7c75702 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:47.389933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e73030a-0994-43ad-85e4-4719d7c75702 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:47.390422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e73030a-0994-43ad-85e4-4719d7c75702 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:47.390825 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e73030a-0994-43ad-85e4-4719d7c75702 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:47.391552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e73030a-0994-43ad-85e4-4719d7c75702 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:47.392009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e73030a-0994-43ad-85e4-4719d7c75702 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:47.392464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e73030a-0994-43ad-85e4-4719d7c75702 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:47.462765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8e73030a-0994-43ad-85e4-4719d7c75702 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:47.472531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8e73030a-0994-43ad-85e4-4719d7c75702 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:47.473980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8e73030a-0994-43ad-85e4-4719d7c75702 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:47.475134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8e73030a-0994-43ad-85e4-4719d7c75702 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102239 Sep 05 17:22:47.475705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 842/1839] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:47 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:48.504836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-384b6162-a591-4ca8-9af2-cab9b97758c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:48.505788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-384b6162-a591-4ca8-9af2-cab9b97758c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:48.509690 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=28 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:22:48.519332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-384b6162-a591-4ca8-9af2-cab9b97758c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:48.520130 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-384b6162-a591-4ca8-9af2-cab9b97758c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:48.520889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-384b6162-a591-4ca8-9af2-cab9b97758c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:48.522034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-384b6162-a591-4ca8-9af2-cab9b97758c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:48.522788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-384b6162-a591-4ca8-9af2-cab9b97758c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:48.523486 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-384b6162-a591-4ca8-9af2-cab9b97758c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:48.528388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=84 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:22:48.588750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-384b6162-a591-4ca8-9af2-cab9b97758c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:48.598812 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-384b6162-a591-4ca8-9af2-cab9b97758c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:48.600278 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-384b6162-a591-4ca8-9af2-cab9b97758c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:48.601457 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-384b6162-a591-4ca8-9af2-cab9b97758c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.103354 Sep 05 17:22:48.602020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 998/1840] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:48 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:49.631278 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7f7bf75c-3846-4778-8f06-b2321a52f0dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:49.632269 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7f7bf75c-3846-4778-8f06-b2321a52f0dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:49.636321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=28 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:22:49.645315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f7bf75c-3846-4778-8f06-b2321a52f0dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:49.646111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f7bf75c-3846-4778-8f06-b2321a52f0dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:49.646827 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f7bf75c-3846-4778-8f06-b2321a52f0dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:49.647966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f7bf75c-3846-4778-8f06-b2321a52f0dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:49.648774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f7bf75c-3846-4778-8f06-b2321a52f0dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:49.649479 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7f7bf75c-3846-4778-8f06-b2321a52f0dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:49.653600 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=84 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:22:49.731367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7f7bf75c-3846-4778-8f06-b2321a52f0dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:49.740880 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7f7bf75c-3846-4778-8f06-b2321a52f0dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:49.742374 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7f7bf75c-3846-4778-8f06-b2321a52f0dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:49.743519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7f7bf75c-3846-4778-8f06-b2321a52f0dc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.119035 Sep 05 17:22:49.744101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 843/1841] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:49 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:50.774185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a74a2457-ad77-4e6a-8be9-7ca6a65a63d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:50.775083 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a74a2457-ad77-4e6a-8be9-7ca6a65a63d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:50.786193 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a74a2457-ad77-4e6a-8be9-7ca6a65a63d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:50.786981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a74a2457-ad77-4e6a-8be9-7ca6a65a63d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:50.787699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a74a2457-ad77-4e6a-8be9-7ca6a65a63d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:50.788878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a74a2457-ad77-4e6a-8be9-7ca6a65a63d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:50.789607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a74a2457-ad77-4e6a-8be9-7ca6a65a63d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:50.790305 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a74a2457-ad77-4e6a-8be9-7ca6a65a63d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:50.861008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a74a2457-ad77-4e6a-8be9-7ca6a65a63d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:50.870142 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a74a2457-ad77-4e6a-8be9-7ca6a65a63d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:50.871612 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a74a2457-ad77-4e6a-8be9-7ca6a65a63d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:50.873020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a74a2457-ad77-4e6a-8be9-7ca6a65a63d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.105374 Sep 05 17:22:50.873582 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 999/1842] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:50 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:51.902292 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-91f73222-a872-4351-baa3-5dfbfb43a0ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:51.903189 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-91f73222-a872-4351-baa3-5dfbfb43a0ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:51.910381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91f73222-a872-4351-baa3-5dfbfb43a0ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:51.910860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91f73222-a872-4351-baa3-5dfbfb43a0ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:51.911287 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91f73222-a872-4351-baa3-5dfbfb43a0ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:51.911976 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91f73222-a872-4351-baa3-5dfbfb43a0ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:51.912460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91f73222-a872-4351-baa3-5dfbfb43a0ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:51.912878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91f73222-a872-4351-baa3-5dfbfb43a0ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:51.987981 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-91f73222-a872-4351-baa3-5dfbfb43a0ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:51.996917 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-91f73222-a872-4351-baa3-5dfbfb43a0ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:51.998454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-91f73222-a872-4351-baa3-5dfbfb43a0ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:51.999602 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-91f73222-a872-4351-baa3-5dfbfb43a0ec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.104065 Sep 05 17:22:52.000176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 844/1843] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:51 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:53.028662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a9258a03-b99a-442a-ac23-75306f2c385d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:53.029654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a9258a03-b99a-442a-ac23-75306f2c385d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:53.040609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9258a03-b99a-442a-ac23-75306f2c385d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:53.041406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9258a03-b99a-442a-ac23-75306f2c385d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:53.042116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9258a03-b99a-442a-ac23-75306f2c385d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:53.043250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9258a03-b99a-442a-ac23-75306f2c385d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:53.043965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9258a03-b99a-442a-ac23-75306f2c385d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:53.044569 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9258a03-b99a-442a-ac23-75306f2c385d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:53.262190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a9258a03-b99a-442a-ac23-75306f2c385d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:53.271288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a9258a03-b99a-442a-ac23-75306f2c385d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:53.272820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a9258a03-b99a-442a-ac23-75306f2c385d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:53.273977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a9258a03-b99a-442a-ac23-75306f2c385d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.252003 Sep 05 17:22:53.274511 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1000/1844] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:53 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:54.304302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-725edfe6-f84e-42bd-ab8f-54e314ba0bdf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:54.305267 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-725edfe6-f84e-42bd-ab8f-54e314ba0bdf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:54.314336 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-725edfe6-f84e-42bd-ab8f-54e314ba0bdf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:54.314813 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-725edfe6-f84e-42bd-ab8f-54e314ba0bdf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:54.315240 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-725edfe6-f84e-42bd-ab8f-54e314ba0bdf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:54.315926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-725edfe6-f84e-42bd-ab8f-54e314ba0bdf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:54.316410 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-725edfe6-f84e-42bd-ab8f-54e314ba0bdf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:54.316828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-725edfe6-f84e-42bd-ab8f-54e314ba0bdf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:54.382837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-725edfe6-f84e-42bd-ab8f-54e314ba0bdf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:54.392670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-725edfe6-f84e-42bd-ab8f-54e314ba0bdf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:54.394137 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-725edfe6-f84e-42bd-ab8f-54e314ba0bdf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:54.395285 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-725edfe6-f84e-42bd-ab8f-54e314ba0bdf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097575 Sep 05 17:22:54.395991 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 845/1845] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:54 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:55.421276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b381e0f9-fc01-4b4b-af65-023bafe2b6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:55.421901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b381e0f9-fc01-4b4b-af65-023bafe2b6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:55.429068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b381e0f9-fc01-4b4b-af65-023bafe2b6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:55.429537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b381e0f9-fc01-4b4b-af65-023bafe2b6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:55.429962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b381e0f9-fc01-4b4b-af65-023bafe2b6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:55.430648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b381e0f9-fc01-4b4b-af65-023bafe2b6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:55.431092 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b381e0f9-fc01-4b4b-af65-023bafe2b6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:55.431502 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b381e0f9-fc01-4b4b-af65-023bafe2b6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:55.495396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b381e0f9-fc01-4b4b-af65-023bafe2b6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:55.504767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b381e0f9-fc01-4b4b-af65-023bafe2b6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:55.506225 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b381e0f9-fc01-4b4b-af65-023bafe2b6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:55.507371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b381e0f9-fc01-4b4b-af65-023bafe2b6f2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.090211 Sep 05 17:22:55.507958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1001/1846] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:55 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:56.533199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-049fe16b-d5d6-47eb-82ae-622f4a7c3930 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:56.533810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-049fe16b-d5d6-47eb-82ae-622f4a7c3930 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:56.540559 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-049fe16b-d5d6-47eb-82ae-622f4a7c3930 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:56.541085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-049fe16b-d5d6-47eb-82ae-622f4a7c3930 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:56.541474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-049fe16b-d5d6-47eb-82ae-622f4a7c3930 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:56.542184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-049fe16b-d5d6-47eb-82ae-622f4a7c3930 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:56.542658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-049fe16b-d5d6-47eb-82ae-622f4a7c3930 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:56.543101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-049fe16b-d5d6-47eb-82ae-622f4a7c3930 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:56.615912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-049fe16b-d5d6-47eb-82ae-622f4a7c3930 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:56.628621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-049fe16b-d5d6-47eb-82ae-622f4a7c3930 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:56.630859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-049fe16b-d5d6-47eb-82ae-622f4a7c3930 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:56.632639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-049fe16b-d5d6-47eb-82ae-622f4a7c3930 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.103168 Sep 05 17:22:56.633442 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 846/1847] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:56 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:57.662728 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8ea9d0ce-4bcd-468a-83e1-594bfab996a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:57.663319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8ea9d0ce-4bcd-468a-83e1-594bfab996a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:57.671909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ea9d0ce-4bcd-468a-83e1-594bfab996a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:57.672441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ea9d0ce-4bcd-468a-83e1-594bfab996a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:57.672932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ea9d0ce-4bcd-468a-83e1-594bfab996a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:57.673636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ea9d0ce-4bcd-468a-83e1-594bfab996a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:57.674126 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ea9d0ce-4bcd-468a-83e1-594bfab996a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:57.674553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ea9d0ce-4bcd-468a-83e1-594bfab996a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:57.736460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8ea9d0ce-4bcd-468a-83e1-594bfab996a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:57.745341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8ea9d0ce-4bcd-468a-83e1-594bfab996a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:57.747370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8ea9d0ce-4bcd-468a-83e1-594bfab996a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:57.748723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8ea9d0ce-4bcd-468a-83e1-594bfab996a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.092371 Sep 05 17:22:57.749280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1002/1848] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:57 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:58.787552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6f0eccd0-b04a-45e9-9e77-be1ea61410a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:58.788502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6f0eccd0-b04a-45e9-9e77-be1ea61410a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:58.799593 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f0eccd0-b04a-45e9-9e77-be1ea61410a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:58.800441 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f0eccd0-b04a-45e9-9e77-be1ea61410a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:58.801158 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f0eccd0-b04a-45e9-9e77-be1ea61410a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:58.802287 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f0eccd0-b04a-45e9-9e77-be1ea61410a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:58.803043 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f0eccd0-b04a-45e9-9e77-be1ea61410a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:58.803738 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f0eccd0-b04a-45e9-9e77-be1ea61410a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:58.866913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6f0eccd0-b04a-45e9-9e77-be1ea61410a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:58.875653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6f0eccd0-b04a-45e9-9e77-be1ea61410a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:58.877123 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6f0eccd0-b04a-45e9-9e77-be1ea61410a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:58.878257 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6f0eccd0-b04a-45e9-9e77-be1ea61410a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097593 Sep 05 17:22:58.878817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 847/1849] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:58 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:22:59.907897 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e3524fc7-8bfa-4465-9e29-0470d2eaef08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:22:59.909942 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e3524fc7-8bfa-4465-9e29-0470d2eaef08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:22:59.921017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3524fc7-8bfa-4465-9e29-0470d2eaef08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:59.921518 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3524fc7-8bfa-4465-9e29-0470d2eaef08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:59.921941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3524fc7-8bfa-4465-9e29-0470d2eaef08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:59.922633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3524fc7-8bfa-4465-9e29-0470d2eaef08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:22:59.923095 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3524fc7-8bfa-4465-9e29-0470d2eaef08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:22:59.923513 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3524fc7-8bfa-4465-9e29-0470d2eaef08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:22:59.988570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e3524fc7-8bfa-4465-9e29-0470d2eaef08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:59.998000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e3524fc7-8bfa-4465-9e29-0470d2eaef08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:22:59.999441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e3524fc7-8bfa-4465-9e29-0470d2eaef08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:00.000612 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e3524fc7-8bfa-4465-9e29-0470d2eaef08 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100042 Sep 05 17:23:00.001164 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1003/1850] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:22:59 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:01.030329 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ff908b45-ac50-463b-9e2d-4bdab26ba669 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:01.031040 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ff908b45-ac50-463b-9e2d-4bdab26ba669 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:01.039611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff908b45-ac50-463b-9e2d-4bdab26ba669 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:01.040212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff908b45-ac50-463b-9e2d-4bdab26ba669 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:01.040779 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff908b45-ac50-463b-9e2d-4bdab26ba669 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:01.041642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff908b45-ac50-463b-9e2d-4bdab26ba669 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:01.042199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff908b45-ac50-463b-9e2d-4bdab26ba669 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:01.042721 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff908b45-ac50-463b-9e2d-4bdab26ba669 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:01.119832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ff908b45-ac50-463b-9e2d-4bdab26ba669 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:01.130164 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ff908b45-ac50-463b-9e2d-4bdab26ba669 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:01.131647 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ff908b45-ac50-463b-9e2d-4bdab26ba669 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:01.132841 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ff908b45-ac50-463b-9e2d-4bdab26ba669 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.108922 Sep 05 17:23:01.133398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 848/1851] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:01 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:02.163811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5fa55891-4660-401b-aeb7-007bbee45c17 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:02.164847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5fa55891-4660-401b-aeb7-007bbee45c17 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:02.173178 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fa55891-4660-401b-aeb7-007bbee45c17 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:02.173659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fa55891-4660-401b-aeb7-007bbee45c17 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:02.174091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fa55891-4660-401b-aeb7-007bbee45c17 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:02.174787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fa55891-4660-401b-aeb7-007bbee45c17 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:02.175241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fa55891-4660-401b-aeb7-007bbee45c17 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:02.175662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fa55891-4660-401b-aeb7-007bbee45c17 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:02.239447 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5fa55891-4660-401b-aeb7-007bbee45c17 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:02.251013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5fa55891-4660-401b-aeb7-007bbee45c17 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:02.252504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5fa55891-4660-401b-aeb7-007bbee45c17 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:02.253682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5fa55891-4660-401b-aeb7-007bbee45c17 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.096551 Sep 05 17:23:02.254235 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1004/1852] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:02 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:03.281369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-64756bec-25e9-40da-ae2c-9acbcea228dd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:03.281922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-64756bec-25e9-40da-ae2c-9acbcea228dd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:03.288756 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64756bec-25e9-40da-ae2c-9acbcea228dd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:03.289231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64756bec-25e9-40da-ae2c-9acbcea228dd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:03.289655 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64756bec-25e9-40da-ae2c-9acbcea228dd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:03.290337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64756bec-25e9-40da-ae2c-9acbcea228dd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:03.290777 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64756bec-25e9-40da-ae2c-9acbcea228dd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:03.291191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64756bec-25e9-40da-ae2c-9acbcea228dd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:03.354634 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-64756bec-25e9-40da-ae2c-9acbcea228dd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:03.364688 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-64756bec-25e9-40da-ae2c-9acbcea228dd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:03.366121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-64756bec-25e9-40da-ae2c-9acbcea228dd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:03.367260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-64756bec-25e9-40da-ae2c-9acbcea228dd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.090995 Sep 05 17:23:03.367822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 849/1853] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:03 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:04.398590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7a65c06b-51c1-4b63-a055-b516d3b41bb8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:04.399176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7a65c06b-51c1-4b63-a055-b516d3b41bb8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:04.406709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a65c06b-51c1-4b63-a055-b516d3b41bb8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:04.407198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a65c06b-51c1-4b63-a055-b516d3b41bb8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:04.407623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a65c06b-51c1-4b63-a055-b516d3b41bb8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:04.408418 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a65c06b-51c1-4b63-a055-b516d3b41bb8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:04.408861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a65c06b-51c1-4b63-a055-b516d3b41bb8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:04.409281 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a65c06b-51c1-4b63-a055-b516d3b41bb8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:04.486479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7a65c06b-51c1-4b63-a055-b516d3b41bb8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:04.498578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7a65c06b-51c1-4b63-a055-b516d3b41bb8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:04.500030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7a65c06b-51c1-4b63-a055-b516d3b41bb8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:04.501343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7a65c06b-51c1-4b63-a055-b516d3b41bb8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.106885 Sep 05 17:23:04.501883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1005/1854] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:04 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:05.529145 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0418e378-ba1f-4976-9c60-331ba05176cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:05.529749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0418e378-ba1f-4976-9c60-331ba05176cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:05.537047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0418e378-ba1f-4976-9c60-331ba05176cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:05.537523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0418e378-ba1f-4976-9c60-331ba05176cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:05.537956 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0418e378-ba1f-4976-9c60-331ba05176cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:05.538637 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0418e378-ba1f-4976-9c60-331ba05176cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:05.539090 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0418e378-ba1f-4976-9c60-331ba05176cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:05.539515 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0418e378-ba1f-4976-9c60-331ba05176cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:05.602851 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0418e378-ba1f-4976-9c60-331ba05176cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:05.612955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0418e378-ba1f-4976-9c60-331ba05176cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:05.614380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0418e378-ba1f-4976-9c60-331ba05176cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:05.615514 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0418e378-ba1f-4976-9c60-331ba05176cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.092229 Sep 05 17:23:05.616075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 850/1855] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:05 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:06.641943 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-174ffc93-af96-43ec-aefa-4cf110e36f7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:06.642513 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-174ffc93-af96-43ec-aefa-4cf110e36f7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:06.652561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-174ffc93-af96-43ec-aefa-4cf110e36f7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:06.653215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-174ffc93-af96-43ec-aefa-4cf110e36f7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:06.653981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-174ffc93-af96-43ec-aefa-4cf110e36f7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:06.654966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-174ffc93-af96-43ec-aefa-4cf110e36f7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:06.655609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-174ffc93-af96-43ec-aefa-4cf110e36f7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:06.656140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-174ffc93-af96-43ec-aefa-4cf110e36f7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:06.723411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-174ffc93-af96-43ec-aefa-4cf110e36f7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:06.736959 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-174ffc93-af96-43ec-aefa-4cf110e36f7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:06.739199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-174ffc93-af96-43ec-aefa-4cf110e36f7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:06.741016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-174ffc93-af96-43ec-aefa-4cf110e36f7a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.103440 Sep 05 17:23:06.741830 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1006/1856] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:06 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:07.771084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-04c4c2ab-ba60-4741-8911-3fc1b5b5fb09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:07.772042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-04c4c2ab-ba60-4741-8911-3fc1b5b5fb09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:07.781216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04c4c2ab-ba60-4741-8911-3fc1b5b5fb09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:07.781694 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04c4c2ab-ba60-4741-8911-3fc1b5b5fb09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:07.782116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04c4c2ab-ba60-4741-8911-3fc1b5b5fb09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:07.782800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04c4c2ab-ba60-4741-8911-3fc1b5b5fb09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:07.783244 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04c4c2ab-ba60-4741-8911-3fc1b5b5fb09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:07.783653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-04c4c2ab-ba60-4741-8911-3fc1b5b5fb09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:07.847107 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-04c4c2ab-ba60-4741-8911-3fc1b5b5fb09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:07.856307 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-04c4c2ab-ba60-4741-8911-3fc1b5b5fb09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:07.857759 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-04c4c2ab-ba60-4741-8911-3fc1b5b5fb09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:07.858894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-04c4c2ab-ba60-4741-8911-3fc1b5b5fb09 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.094712 Sep 05 17:23:07.859455 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 851/1857] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:07 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 17:23:08.892938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4d6f10e6-3300-4083-9173-384ffb441c1f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:08.893910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4d6f10e6-3300-4083-9173-384ffb441c1f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:08.905287 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d6f10e6-3300-4083-9173-384ffb441c1f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:08.906069 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d6f10e6-3300-4083-9173-384ffb441c1f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:08.906773 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d6f10e6-3300-4083-9173-384ffb441c1f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:08.907894 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d6f10e6-3300-4083-9173-384ffb441c1f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:08.908672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d6f10e6-3300-4083-9173-384ffb441c1f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:08.909360 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d6f10e6-3300-4083-9173-384ffb441c1f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:08.980050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4d6f10e6-3300-4083-9173-384ffb441c1f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:08.989116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4d6f10e6-3300-4083-9173-384ffb441c1f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:08.990537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4d6f10e6-3300-4083-9173-384ffb441c1f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:08.991681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4d6f10e6-3300-4083-9173-384ffb441c1f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.106021 Sep 05 17:23:08.992256 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1007/1858] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:08 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:10.020464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-58ffe302-6f64-45a4-9d93-e9885e4a1b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:10.021543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-58ffe302-6f64-45a4-9d93-e9885e4a1b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:10.030918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58ffe302-6f64-45a4-9d93-e9885e4a1b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:10.031392 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58ffe302-6f64-45a4-9d93-e9885e4a1b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:10.031811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58ffe302-6f64-45a4-9d93-e9885e4a1b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:10.032523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58ffe302-6f64-45a4-9d93-e9885e4a1b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:10.032972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58ffe302-6f64-45a4-9d93-e9885e4a1b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:10.033383 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58ffe302-6f64-45a4-9d93-e9885e4a1b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:10.102153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-58ffe302-6f64-45a4-9d93-e9885e4a1b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:10.112436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-58ffe302-6f64-45a4-9d93-e9885e4a1b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:10.113987 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-58ffe302-6f64-45a4-9d93-e9885e4a1b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:10.115132 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-58ffe302-6f64-45a4-9d93-e9885e4a1b69 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101417 Sep 05 17:23:10.115729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 852/1859] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:10 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:11.144550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e14f17b7-3dd8-45f4-b024-d03dadd256d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:11.145656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e14f17b7-3dd8-45f4-b024-d03dadd256d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:11.156701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e14f17b7-3dd8-45f4-b024-d03dadd256d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:11.157514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e14f17b7-3dd8-45f4-b024-d03dadd256d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:11.158224 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e14f17b7-3dd8-45f4-b024-d03dadd256d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:11.159343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e14f17b7-3dd8-45f4-b024-d03dadd256d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:11.160078 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e14f17b7-3dd8-45f4-b024-d03dadd256d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:11.160814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e14f17b7-3dd8-45f4-b024-d03dadd256d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:11.226507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e14f17b7-3dd8-45f4-b024-d03dadd256d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:11.239735 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e14f17b7-3dd8-45f4-b024-d03dadd256d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:11.242016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e14f17b7-3dd8-45f4-b024-d03dadd256d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:11.243688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e14f17b7-3dd8-45f4-b024-d03dadd256d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.105471 Sep 05 17:23:11.244356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1008/1860] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:11 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:12.366330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b0d1655e-91e5-474a-95ef-aedc74493678 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:12.366978 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b0d1655e-91e5-474a-95ef-aedc74493678 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:12.377482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b0d1655e-91e5-474a-95ef-aedc74493678 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:12.377482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b0d1655e-91e5-474a-95ef-aedc74493678 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:12.377482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b0d1655e-91e5-474a-95ef-aedc74493678 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:12.377482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b0d1655e-91e5-474a-95ef-aedc74493678 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:12.378781 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b0d1655e-91e5-474a-95ef-aedc74493678 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:12.378781 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b0d1655e-91e5-474a-95ef-aedc74493678 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:12.445819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b0d1655e-91e5-474a-95ef-aedc74493678 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:12.454866 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b0d1655e-91e5-474a-95ef-aedc74493678 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:12.456415 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b0d1655e-91e5-474a-95ef-aedc74493678 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:12.457584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b0d1655e-91e5-474a-95ef-aedc74493678 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.190031 Sep 05 17:23:12.458144 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 853/1861] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:12 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:13.489505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0d4e64e3-4638-49a6-b329-96b0e8604c63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:13.490668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0d4e64e3-4638-49a6-b329-96b0e8604c63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:13.500503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d4e64e3-4638-49a6-b329-96b0e8604c63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:13.500987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d4e64e3-4638-49a6-b329-96b0e8604c63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:13.501416 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d4e64e3-4638-49a6-b329-96b0e8604c63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:13.502114 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d4e64e3-4638-49a6-b329-96b0e8604c63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:13.502565 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d4e64e3-4638-49a6-b329-96b0e8604c63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:13.502987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d4e64e3-4638-49a6-b329-96b0e8604c63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:13.573505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0d4e64e3-4638-49a6-b329-96b0e8604c63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:13.586830 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0d4e64e3-4638-49a6-b329-96b0e8604c63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:13.589093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0d4e64e3-4638-49a6-b329-96b0e8604c63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:13.590772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0d4e64e3-4638-49a6-b329-96b0e8604c63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.107834 Sep 05 17:23:13.591405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1009/1862] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:13 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:14.620586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-12405277-390e-43bb-bcfb-f08d09b55264 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:14.621515 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-12405277-390e-43bb-bcfb-f08d09b55264 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:14.632276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-12405277-390e-43bb-bcfb-f08d09b55264 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:14.632987 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-12405277-390e-43bb-bcfb-f08d09b55264 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:14.633702 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-12405277-390e-43bb-bcfb-f08d09b55264 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:14.634837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-12405277-390e-43bb-bcfb-f08d09b55264 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:14.635579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-12405277-390e-43bb-bcfb-f08d09b55264 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:14.636272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-12405277-390e-43bb-bcfb-f08d09b55264 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:14.698272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-12405277-390e-43bb-bcfb-f08d09b55264 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:14.707415 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-12405277-390e-43bb-bcfb-f08d09b55264 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:14.708890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-12405277-390e-43bb-bcfb-f08d09b55264 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:14.710027 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-12405277-390e-43bb-bcfb-f08d09b55264 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.096443 Sep 05 17:23:14.710594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 854/1863] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:14 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:15.739653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b7d96274-41fb-4bd1-8001-2023499d8544 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:15.740623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b7d96274-41fb-4bd1-8001-2023499d8544 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:15.749825 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7d96274-41fb-4bd1-8001-2023499d8544 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:15.750301 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7d96274-41fb-4bd1-8001-2023499d8544 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:15.750728 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7d96274-41fb-4bd1-8001-2023499d8544 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:15.751412 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7d96274-41fb-4bd1-8001-2023499d8544 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:15.751855 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7d96274-41fb-4bd1-8001-2023499d8544 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:15.752297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7d96274-41fb-4bd1-8001-2023499d8544 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:15.821610 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b7d96274-41fb-4bd1-8001-2023499d8544 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:15.831004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b7d96274-41fb-4bd1-8001-2023499d8544 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:15.832592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b7d96274-41fb-4bd1-8001-2023499d8544 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:15.833831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b7d96274-41fb-4bd1-8001-2023499d8544 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101223 Sep 05 17:23:15.834403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1010/1864] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:15 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:16.864313 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c3501ef1-10b5-410b-9ae5-e498e66926c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:16.865075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c3501ef1-10b5-410b-9ae5-e498e66926c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:16.874340 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3501ef1-10b5-410b-9ae5-e498e66926c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:16.874974 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3501ef1-10b5-410b-9ae5-e498e66926c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:16.875541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3501ef1-10b5-410b-9ae5-e498e66926c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:16.876490 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3501ef1-10b5-410b-9ae5-e498e66926c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:16.877083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3501ef1-10b5-410b-9ae5-e498e66926c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:16.877670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3501ef1-10b5-410b-9ae5-e498e66926c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:16.946779 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c3501ef1-10b5-410b-9ae5-e498e66926c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:16.955937 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c3501ef1-10b5-410b-9ae5-e498e66926c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:16.957420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c3501ef1-10b5-410b-9ae5-e498e66926c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:16.958575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c3501ef1-10b5-410b-9ae5-e498e66926c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100777 Sep 05 17:23:16.959182 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 855/1865] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:16 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:17.987842 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b257a0a7-2bf7-4059-bcfd-e83ddc26758a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:17.988857 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b257a0a7-2bf7-4059-bcfd-e83ddc26758a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:18.000091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b257a0a7-2bf7-4059-bcfd-e83ddc26758a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:18.000603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b257a0a7-2bf7-4059-bcfd-e83ddc26758a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:18.001030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b257a0a7-2bf7-4059-bcfd-e83ddc26758a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:18.001712 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b257a0a7-2bf7-4059-bcfd-e83ddc26758a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:18.002157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b257a0a7-2bf7-4059-bcfd-e83ddc26758a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:18.002570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b257a0a7-2bf7-4059-bcfd-e83ddc26758a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:18.068668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b257a0a7-2bf7-4059-bcfd-e83ddc26758a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:18.081661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b257a0a7-2bf7-4059-bcfd-e83ddc26758a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:18.083956 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b257a0a7-2bf7-4059-bcfd-e83ddc26758a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:18.085745 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b257a0a7-2bf7-4059-bcfd-e83ddc26758a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.104935 Sep 05 17:23:18.086485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1011/1866] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:17 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:19.118443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2131c17a-ed75-4c95-a040-a1e47b8cb8e7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:19.119400 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2131c17a-ed75-4c95-a040-a1e47b8cb8e7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:19.130540 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2131c17a-ed75-4c95-a040-a1e47b8cb8e7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:19.131335 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2131c17a-ed75-4c95-a040-a1e47b8cb8e7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:19.132051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2131c17a-ed75-4c95-a040-a1e47b8cb8e7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:19.133245 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2131c17a-ed75-4c95-a040-a1e47b8cb8e7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:19.134064 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2131c17a-ed75-4c95-a040-a1e47b8cb8e7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:19.134756 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2131c17a-ed75-4c95-a040-a1e47b8cb8e7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:19.199861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2131c17a-ed75-4c95-a040-a1e47b8cb8e7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:19.208682 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2131c17a-ed75-4c95-a040-a1e47b8cb8e7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:19.210125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2131c17a-ed75-4c95-a040-a1e47b8cb8e7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:19.211271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2131c17a-ed75-4c95-a040-a1e47b8cb8e7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.099504 Sep 05 17:23:19.211832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 856/1867] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:19 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:20.241717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d55195ea-85b9-4cc2-8236-6e308aaab84a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:20.242612 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d55195ea-85b9-4cc2-8236-6e308aaab84a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:20.246254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=28 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:23:20.253604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d55195ea-85b9-4cc2-8236-6e308aaab84a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:20.254080 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d55195ea-85b9-4cc2-8236-6e308aaab84a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:20.254502 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d55195ea-85b9-4cc2-8236-6e308aaab84a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:20.255186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d55195ea-85b9-4cc2-8236-6e308aaab84a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:20.255629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d55195ea-85b9-4cc2-8236-6e308aaab84a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:20.256041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d55195ea-85b9-4cc2-8236-6e308aaab84a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:20.258760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=84 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:23:20.321494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d55195ea-85b9-4cc2-8236-6e308aaab84a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:20.330720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d55195ea-85b9-4cc2-8236-6e308aaab84a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:20.332173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d55195ea-85b9-4cc2-8236-6e308aaab84a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:20.333311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d55195ea-85b9-4cc2-8236-6e308aaab84a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098758 Sep 05 17:23:20.333878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1012/1868] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:20 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:21.360304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-dbdf4b36-c986-4f7b-9fd9-dcf8853b4bde tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:21.360997 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-dbdf4b36-c986-4f7b-9fd9-dcf8853b4bde tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:21.363746 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=28 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:23:21.370291 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbdf4b36-c986-4f7b-9fd9-dcf8853b4bde tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:21.370861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbdf4b36-c986-4f7b-9fd9-dcf8853b4bde tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:21.371371 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbdf4b36-c986-4f7b-9fd9-dcf8853b4bde tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:21.372199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbdf4b36-c986-4f7b-9fd9-dcf8853b4bde tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:21.372788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbdf4b36-c986-4f7b-9fd9-dcf8853b4bde tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:21.373263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dbdf4b36-c986-4f7b-9fd9-dcf8853b4bde tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:21.376775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=84 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:23:21.439083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-dbdf4b36-c986-4f7b-9fd9-dcf8853b4bde tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:21.448169 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-dbdf4b36-c986-4f7b-9fd9-dcf8853b4bde tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:21.449623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-dbdf4b36-c986-4f7b-9fd9-dcf8853b4bde tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:21.450778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-dbdf4b36-c986-4f7b-9fd9-dcf8853b4bde tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.095474 Sep 05 17:23:21.451351 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 857/1869] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:21 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:22.480646 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-960ed471-1ed7-4756-b215-f034cfb308c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:22.481654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-960ed471-1ed7-4756-b215-f034cfb308c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:22.493225 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-960ed471-1ed7-4756-b215-f034cfb308c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:22.494030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-960ed471-1ed7-4756-b215-f034cfb308c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:22.494751 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-960ed471-1ed7-4756-b215-f034cfb308c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:22.495902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-960ed471-1ed7-4756-b215-f034cfb308c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:22.496704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-960ed471-1ed7-4756-b215-f034cfb308c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:22.497416 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-960ed471-1ed7-4756-b215-f034cfb308c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:22.563139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-960ed471-1ed7-4756-b215-f034cfb308c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:22.572213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-960ed471-1ed7-4756-b215-f034cfb308c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:22.573692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-960ed471-1ed7-4756-b215-f034cfb308c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:22.574841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-960ed471-1ed7-4756-b215-f034cfb308c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100948 Sep 05 17:23:22.575402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1013/1870] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:22 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:23.604191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-68e5eac1-d952-4495-a169-77b81ec0ebd4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:23.605142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-68e5eac1-d952-4495-a169-77b81ec0ebd4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:23.614890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68e5eac1-d952-4495-a169-77b81ec0ebd4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:23.615365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68e5eac1-d952-4495-a169-77b81ec0ebd4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:23.615788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68e5eac1-d952-4495-a169-77b81ec0ebd4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:23.616531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68e5eac1-d952-4495-a169-77b81ec0ebd4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:23.616978 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68e5eac1-d952-4495-a169-77b81ec0ebd4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:23.617393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68e5eac1-d952-4495-a169-77b81ec0ebd4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:23.690016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-68e5eac1-d952-4495-a169-77b81ec0ebd4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:23.699159 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-68e5eac1-d952-4495-a169-77b81ec0ebd4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:23.700967 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-68e5eac1-d952-4495-a169-77b81ec0ebd4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:23.702138 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-68e5eac1-d952-4495-a169-77b81ec0ebd4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.104647 Sep 05 17:23:23.702694 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 858/1871] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:23 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:24.732599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f32230f3-30ee-4d51-9160-20e7e5553f8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:24.733463 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f32230f3-30ee-4d51-9160-20e7e5553f8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:24.744594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f32230f3-30ee-4d51-9160-20e7e5553f8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:24.745394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f32230f3-30ee-4d51-9160-20e7e5553f8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:24.746123 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f32230f3-30ee-4d51-9160-20e7e5553f8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:24.747251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f32230f3-30ee-4d51-9160-20e7e5553f8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:24.747996 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f32230f3-30ee-4d51-9160-20e7e5553f8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:24.748745 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f32230f3-30ee-4d51-9160-20e7e5553f8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:24.814081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f32230f3-30ee-4d51-9160-20e7e5553f8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:24.823833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f32230f3-30ee-4d51-9160-20e7e5553f8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:24.825316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f32230f3-30ee-4d51-9160-20e7e5553f8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:24.826456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f32230f3-30ee-4d51-9160-20e7e5553f8b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100699 Sep 05 17:23:24.827012 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1014/1872] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:24 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:25.856454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e4273d4c-5999-4a19-a822-39f8442c2ae1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:25.857507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e4273d4c-5999-4a19-a822-39f8442c2ae1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:25.866588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4273d4c-5999-4a19-a822-39f8442c2ae1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:25.867069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4273d4c-5999-4a19-a822-39f8442c2ae1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:25.867497 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4273d4c-5999-4a19-a822-39f8442c2ae1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:25.868246 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4273d4c-5999-4a19-a822-39f8442c2ae1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:25.868652 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4273d4c-5999-4a19-a822-39f8442c2ae1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:25.869063 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4273d4c-5999-4a19-a822-39f8442c2ae1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:25.930467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e4273d4c-5999-4a19-a822-39f8442c2ae1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:25.939509 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e4273d4c-5999-4a19-a822-39f8442c2ae1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:25.940941 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e4273d4c-5999-4a19-a822-39f8442c2ae1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:25.942118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e4273d4c-5999-4a19-a822-39f8442c2ae1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.092878 Sep 05 17:23:25.942675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 859/1873] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:25 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:26.973537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8962a70c-c517-4511-82c0-44d743599838 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:26.974290 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8962a70c-c517-4511-82c0-44d743599838 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:26.985313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8962a70c-c517-4511-82c0-44d743599838 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:26.986113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8962a70c-c517-4511-82c0-44d743599838 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:26.986805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8962a70c-c517-4511-82c0-44d743599838 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:26.988190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8962a70c-c517-4511-82c0-44d743599838 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:26.989098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8962a70c-c517-4511-82c0-44d743599838 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:26.989773 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8962a70c-c517-4511-82c0-44d743599838 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:27.063851 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8962a70c-c517-4511-82c0-44d743599838 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:27.073942 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8962a70c-c517-4511-82c0-44d743599838 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:27.075373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8962a70c-c517-4511-82c0-44d743599838 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:27.076551 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8962a70c-c517-4511-82c0-44d743599838 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.111529 Sep 05 17:23:27.077117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1015/1874] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:26 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:28.106190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b13859fa-8ae5-4b1e-b0fc-806d63cd3f3a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:28.106969 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b13859fa-8ae5-4b1e-b0fc-806d63cd3f3a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:28.115841 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b13859fa-8ae5-4b1e-b0fc-806d63cd3f3a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:28.116361 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b13859fa-8ae5-4b1e-b0fc-806d63cd3f3a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:28.116794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b13859fa-8ae5-4b1e-b0fc-806d63cd3f3a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:28.117486 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b13859fa-8ae5-4b1e-b0fc-806d63cd3f3a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:28.117940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b13859fa-8ae5-4b1e-b0fc-806d63cd3f3a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:28.118360 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b13859fa-8ae5-4b1e-b0fc-806d63cd3f3a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:28.189195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b13859fa-8ae5-4b1e-b0fc-806d63cd3f3a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:28.197987 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b13859fa-8ae5-4b1e-b0fc-806d63cd3f3a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:28.199407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b13859fa-8ae5-4b1e-b0fc-806d63cd3f3a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:28.200565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b13859fa-8ae5-4b1e-b0fc-806d63cd3f3a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101029 Sep 05 17:23:28.201125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 860/1875] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:28 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:29.231092 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-980ebe09-3604-4d49-85d7-08b7fd3ef953 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:29.232099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-980ebe09-3604-4d49-85d7-08b7fd3ef953 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:29.242934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-980ebe09-3604-4d49-85d7-08b7fd3ef953 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:29.243720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-980ebe09-3604-4d49-85d7-08b7fd3ef953 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:29.244501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-980ebe09-3604-4d49-85d7-08b7fd3ef953 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:29.245626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-980ebe09-3604-4d49-85d7-08b7fd3ef953 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:29.246368 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-980ebe09-3604-4d49-85d7-08b7fd3ef953 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:29.247062 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-980ebe09-3604-4d49-85d7-08b7fd3ef953 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:29.315055 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-980ebe09-3604-4d49-85d7-08b7fd3ef953 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:29.324844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-980ebe09-3604-4d49-85d7-08b7fd3ef953 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:29.326296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-980ebe09-3604-4d49-85d7-08b7fd3ef953 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:29.327453 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-980ebe09-3604-4d49-85d7-08b7fd3ef953 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.103530 Sep 05 17:23:29.328042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1016/1876] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:29 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:30.356993 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-23d0b08d-3ea5-4e4a-a68f-bc9b320d66eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:30.357972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-23d0b08d-3ea5-4e4a-a68f-bc9b320d66eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:30.367055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23d0b08d-3ea5-4e4a-a68f-bc9b320d66eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:30.371648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23d0b08d-3ea5-4e4a-a68f-bc9b320d66eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:30.371648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23d0b08d-3ea5-4e4a-a68f-bc9b320d66eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:30.371648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23d0b08d-3ea5-4e4a-a68f-bc9b320d66eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:30.371648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23d0b08d-3ea5-4e4a-a68f-bc9b320d66eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:30.372053 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23d0b08d-3ea5-4e4a-a68f-bc9b320d66eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:30.432031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-23d0b08d-3ea5-4e4a-a68f-bc9b320d66eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:30.440700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-23d0b08d-3ea5-4e4a-a68f-bc9b320d66eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:30.442513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-23d0b08d-3ea5-4e4a-a68f-bc9b320d66eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:30.443645 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-23d0b08d-3ea5-4e4a-a68f-bc9b320d66eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.093459 Sep 05 17:23:30.444187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 861/1877] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:30 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:31.472916 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c679a64a-1e19-45b9-9679-57174d5f5433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:31.473599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c679a64a-1e19-45b9-9679-57174d5f5433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:31.480499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c679a64a-1e19-45b9-9679-57174d5f5433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:31.480990 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c679a64a-1e19-45b9-9679-57174d5f5433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:31.481427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c679a64a-1e19-45b9-9679-57174d5f5433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:31.482124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c679a64a-1e19-45b9-9679-57174d5f5433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:31.482579 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c679a64a-1e19-45b9-9679-57174d5f5433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:31.483002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c679a64a-1e19-45b9-9679-57174d5f5433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:31.553928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c679a64a-1e19-45b9-9679-57174d5f5433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:31.562991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c679a64a-1e19-45b9-9679-57174d5f5433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:31.564479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c679a64a-1e19-45b9-9679-57174d5f5433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:31.565736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c679a64a-1e19-45b9-9679-57174d5f5433 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.099632 Sep 05 17:23:31.566299 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1017/1878] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:31 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:32.590671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0299c2c1-02a6-42d4-8580-6631362d9ee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:32.591281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0299c2c1-02a6-42d4-8580-6631362d9ee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:32.598944 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0299c2c1-02a6-42d4-8580-6631362d9ee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:32.599457 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0299c2c1-02a6-42d4-8580-6631362d9ee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:32.599915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0299c2c1-02a6-42d4-8580-6631362d9ee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:32.600672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0299c2c1-02a6-42d4-8580-6631362d9ee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:32.601153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0299c2c1-02a6-42d4-8580-6631362d9ee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:32.601577 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0299c2c1-02a6-42d4-8580-6631362d9ee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:32.668738 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0299c2c1-02a6-42d4-8580-6631362d9ee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:32.678056 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0299c2c1-02a6-42d4-8580-6631362d9ee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:32.679501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0299c2c1-02a6-42d4-8580-6631362d9ee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:32.680695 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0299c2c1-02a6-42d4-8580-6631362d9ee3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.094249 Sep 05 17:23:32.681261 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 862/1879] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:32 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:33.710288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9ea90974-b180-47c3-8f33-fd55576f61f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:33.711220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9ea90974-b180-47c3-8f33-fd55576f61f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:33.716087 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:23:33.716418 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:23:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 (ip 10.222.0.23) !!! Sep 05 17:23:33.718388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:23:33.718621 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:23:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 (ip 10.222.0.23) !!! Sep 05 17:23:33.726335 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea90974-b180-47c3-8f33-fd55576f61f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:33.726814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea90974-b180-47c3-8f33-fd55576f61f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:33.727242 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea90974-b180-47c3-8f33-fd55576f61f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:33.727927 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea90974-b180-47c3-8f33-fd55576f61f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:33.728405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea90974-b180-47c3-8f33-fd55576f61f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:33.728823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea90974-b180-47c3-8f33-fd55576f61f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:33.792730 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9ea90974-b180-47c3-8f33-fd55576f61f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:33.806566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9ea90974-b180-47c3-8f33-fd55576f61f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:33.808969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9ea90974-b180-47c3-8f33-fd55576f61f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:33.810810 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9ea90974-b180-47c3-8f33-fd55576f61f4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.107138 Sep 05 17:23:33.811743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1018/1880] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:33 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:34.839889 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-466da803-fa1e-482b-8f91-889ab3a73e61 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:34.840524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-466da803-fa1e-482b-8f91-889ab3a73e61 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:34.851263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-466da803-fa1e-482b-8f91-889ab3a73e61 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:34.851745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-466da803-fa1e-482b-8f91-889ab3a73e61 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:34.852183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-466da803-fa1e-482b-8f91-889ab3a73e61 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:34.852896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-466da803-fa1e-482b-8f91-889ab3a73e61 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:34.853346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-466da803-fa1e-482b-8f91-889ab3a73e61 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:34.853766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-466da803-fa1e-482b-8f91-889ab3a73e61 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:34.921623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-466da803-fa1e-482b-8f91-889ab3a73e61 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:34.930885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-466da803-fa1e-482b-8f91-889ab3a73e61 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:34.932341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-466da803-fa1e-482b-8f91-889ab3a73e61 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:34.933481 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-466da803-fa1e-482b-8f91-889ab3a73e61 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.099683 Sep 05 17:23:34.934042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 863/1881] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:34 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:35.964138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7c25c54f-94c6-4410-b049-aeeaf0d54e7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:35.965246 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7c25c54f-94c6-4410-b049-aeeaf0d54e7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:35.975354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c25c54f-94c6-4410-b049-aeeaf0d54e7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:35.975839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c25c54f-94c6-4410-b049-aeeaf0d54e7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:35.976314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c25c54f-94c6-4410-b049-aeeaf0d54e7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:35.977130 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c25c54f-94c6-4410-b049-aeeaf0d54e7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:35.977764 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c25c54f-94c6-4410-b049-aeeaf0d54e7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:35.978313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c25c54f-94c6-4410-b049-aeeaf0d54e7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:36.046494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7c25c54f-94c6-4410-b049-aeeaf0d54e7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:36.056029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7c25c54f-94c6-4410-b049-aeeaf0d54e7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:36.057494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7c25c54f-94c6-4410-b049-aeeaf0d54e7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:36.058673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7c25c54f-94c6-4410-b049-aeeaf0d54e7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101501 Sep 05 17:23:36.059216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1019/1882] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:35 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:37.085699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-abe0eb49-a1cf-433f-aaf4-a3c0a668351d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:37.086315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-abe0eb49-a1cf-433f-aaf4-a3c0a668351d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:37.093722 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-abe0eb49-a1cf-433f-aaf4-a3c0a668351d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:37.094199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-abe0eb49-a1cf-433f-aaf4-a3c0a668351d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:37.094630 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-abe0eb49-a1cf-433f-aaf4-a3c0a668351d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:37.095307 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-abe0eb49-a1cf-433f-aaf4-a3c0a668351d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:37.095754 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-abe0eb49-a1cf-433f-aaf4-a3c0a668351d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:37.096181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-abe0eb49-a1cf-433f-aaf4-a3c0a668351d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:37.167297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-abe0eb49-a1cf-433f-aaf4-a3c0a668351d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:37.176592 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-abe0eb49-a1cf-433f-aaf4-a3c0a668351d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:37.178035 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-abe0eb49-a1cf-433f-aaf4-a3c0a668351d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:37.179201 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-abe0eb49-a1cf-433f-aaf4-a3c0a668351d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098713 Sep 05 17:23:37.179760 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 864/1883] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:37 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:38.207863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-062f5305-fcd5-4a6c-bf53-64f36983286b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:38.210688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-062f5305-fcd5-4a6c-bf53-64f36983286b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:38.220578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-062f5305-fcd5-4a6c-bf53-64f36983286b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:38.221386 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-062f5305-fcd5-4a6c-bf53-64f36983286b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:38.222109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-062f5305-fcd5-4a6c-bf53-64f36983286b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:38.223249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-062f5305-fcd5-4a6c-bf53-64f36983286b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:38.223999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-062f5305-fcd5-4a6c-bf53-64f36983286b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:38.224869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-062f5305-fcd5-4a6c-bf53-64f36983286b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:38.286748 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-062f5305-fcd5-4a6c-bf53-64f36983286b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:38.296229 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-062f5305-fcd5-4a6c-bf53-64f36983286b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:38.297688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-062f5305-fcd5-4a6c-bf53-64f36983286b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:38.298837 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-062f5305-fcd5-4a6c-bf53-64f36983286b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097554 Sep 05 17:23:38.299400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1020/1884] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:38 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:39.328465 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0612509d-bfb3-4977-864e-8f52fe625eaf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:39.329426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0612509d-bfb3-4977-864e-8f52fe625eaf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:39.337878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0612509d-bfb3-4977-864e-8f52fe625eaf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:39.338356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0612509d-bfb3-4977-864e-8f52fe625eaf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:39.338786 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0612509d-bfb3-4977-864e-8f52fe625eaf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:39.339462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0612509d-bfb3-4977-864e-8f52fe625eaf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:39.339908 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0612509d-bfb3-4977-864e-8f52fe625eaf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:39.340356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0612509d-bfb3-4977-864e-8f52fe625eaf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:39.404990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0612509d-bfb3-4977-864e-8f52fe625eaf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:39.418657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0612509d-bfb3-4977-864e-8f52fe625eaf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:39.420966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0612509d-bfb3-4977-864e-8f52fe625eaf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:39.422748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0612509d-bfb3-4977-864e-8f52fe625eaf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100951 Sep 05 17:23:39.423646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 865/1885] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:39 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:40.450365 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-15eaf499-5489-48d2-8a26-140b1a34848d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:40.451169 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-15eaf499-5489-48d2-8a26-140b1a34848d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:40.460416 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15eaf499-5489-48d2-8a26-140b1a34848d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:40.461045 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15eaf499-5489-48d2-8a26-140b1a34848d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:40.461609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15eaf499-5489-48d2-8a26-140b1a34848d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:40.462542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15eaf499-5489-48d2-8a26-140b1a34848d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:40.463106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15eaf499-5489-48d2-8a26-140b1a34848d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:40.463659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15eaf499-5489-48d2-8a26-140b1a34848d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:40.530028 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-15eaf499-5489-48d2-8a26-140b1a34848d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:40.539125 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-15eaf499-5489-48d2-8a26-140b1a34848d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:40.540585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-15eaf499-5489-48d2-8a26-140b1a34848d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:40.541729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-15eaf499-5489-48d2-8a26-140b1a34848d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.096713 Sep 05 17:23:40.542282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1021/1886] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:40 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:41.571716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a046146b-1b43-41ec-be27-bcb8be3b3c85 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:41.572741 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a046146b-1b43-41ec-be27-bcb8be3b3c85 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:41.583558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a046146b-1b43-41ec-be27-bcb8be3b3c85 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:41.584361 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a046146b-1b43-41ec-be27-bcb8be3b3c85 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:41.584814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a046146b-1b43-41ec-be27-bcb8be3b3c85 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:41.585503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a046146b-1b43-41ec-be27-bcb8be3b3c85 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:41.585950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a046146b-1b43-41ec-be27-bcb8be3b3c85 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:41.586370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a046146b-1b43-41ec-be27-bcb8be3b3c85 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:41.650290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a046146b-1b43-41ec-be27-bcb8be3b3c85 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:41.661091 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a046146b-1b43-41ec-be27-bcb8be3b3c85 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:41.663477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a046146b-1b43-41ec-be27-bcb8be3b3c85 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:41.665304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a046146b-1b43-41ec-be27-bcb8be3b3c85 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100547 Sep 05 17:23:41.666059 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 866/1887] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:41 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:42.695088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d4ce3b95-a28e-457f-b689-4e8aa1676c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:42.695951 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d4ce3b95-a28e-457f-b689-4e8aa1676c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:42.704807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4ce3b95-a28e-457f-b689-4e8aa1676c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:42.705282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4ce3b95-a28e-457f-b689-4e8aa1676c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:42.705709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4ce3b95-a28e-457f-b689-4e8aa1676c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:42.706393 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4ce3b95-a28e-457f-b689-4e8aa1676c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:42.706835 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4ce3b95-a28e-457f-b689-4e8aa1676c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:42.707252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4ce3b95-a28e-457f-b689-4e8aa1676c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:42.773928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d4ce3b95-a28e-457f-b689-4e8aa1676c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:42.783035 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d4ce3b95-a28e-457f-b689-4e8aa1676c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:42.784499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d4ce3b95-a28e-457f-b689-4e8aa1676c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:42.785637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d4ce3b95-a28e-457f-b689-4e8aa1676c90 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097409 Sep 05 17:23:42.786198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1022/1888] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:42 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:43.815174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4c325384-a1b4-44e0-b8e4-a2329dcd6107 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:43.816071 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4c325384-a1b4-44e0-b8e4-a2329dcd6107 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:43.826805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c325384-a1b4-44e0-b8e4-a2329dcd6107 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:43.827661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c325384-a1b4-44e0-b8e4-a2329dcd6107 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:43.828477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c325384-a1b4-44e0-b8e4-a2329dcd6107 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:43.829607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c325384-a1b4-44e0-b8e4-a2329dcd6107 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:43.830350 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c325384-a1b4-44e0-b8e4-a2329dcd6107 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:43.831096 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c325384-a1b4-44e0-b8e4-a2329dcd6107 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:43.898929 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4c325384-a1b4-44e0-b8e4-a2329dcd6107 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:43.908403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4c325384-a1b4-44e0-b8e4-a2329dcd6107 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:43.909872 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4c325384-a1b4-44e0-b8e4-a2329dcd6107 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:43.911014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4c325384-a1b4-44e0-b8e4-a2329dcd6107 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102991 Sep 05 17:23:43.911586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 867/1889] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:43 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:44.940732 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8de4d12c-e38a-4139-996a-79ad3f31249e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:44.941744 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8de4d12c-e38a-4139-996a-79ad3f31249e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:44.944881 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:23:44.945168 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:23:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 (ip 10.222.0.23) !!! Sep 05 17:23:44.953161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8de4d12c-e38a-4139-996a-79ad3f31249e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:44.953646 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8de4d12c-e38a-4139-996a-79ad3f31249e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:44.954086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8de4d12c-e38a-4139-996a-79ad3f31249e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:44.954803 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8de4d12c-e38a-4139-996a-79ad3f31249e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:44.955251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8de4d12c-e38a-4139-996a-79ad3f31249e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:44.955793 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8de4d12c-e38a-4139-996a-79ad3f31249e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:45.020765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8de4d12c-e38a-4139-996a-79ad3f31249e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:45.029674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8de4d12c-e38a-4139-996a-79ad3f31249e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:45.031106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8de4d12c-e38a-4139-996a-79ad3f31249e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:45.032287 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8de4d12c-e38a-4139-996a-79ad3f31249e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098202 Sep 05 17:23:45.032842 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1023/1890] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:44 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:46.069354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f40d87b3-2cc8-4e13-a4ef-9d5831b89a2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:46.070302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f40d87b3-2cc8-4e13-a4ef-9d5831b89a2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:46.081366 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f40d87b3-2cc8-4e13-a4ef-9d5831b89a2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:46.082151 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f40d87b3-2cc8-4e13-a4ef-9d5831b89a2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:46.082853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f40d87b3-2cc8-4e13-a4ef-9d5831b89a2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:46.083970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f40d87b3-2cc8-4e13-a4ef-9d5831b89a2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:46.084757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f40d87b3-2cc8-4e13-a4ef-9d5831b89a2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:46.085449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f40d87b3-2cc8-4e13-a4ef-9d5831b89a2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:46.159800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f40d87b3-2cc8-4e13-a4ef-9d5831b89a2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:46.169537 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f40d87b3-2cc8-4e13-a4ef-9d5831b89a2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:46.170975 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f40d87b3-2cc8-4e13-a4ef-9d5831b89a2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:46.172121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f40d87b3-2cc8-4e13-a4ef-9d5831b89a2a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.109389 Sep 05 17:23:46.172716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 868/1891] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:46 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:47.199842 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3a704975-2555-41be-8375-1226973ca1e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:47.200477 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3a704975-2555-41be-8375-1226973ca1e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:47.207460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a704975-2555-41be-8375-1226973ca1e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:47.207944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a704975-2555-41be-8375-1226973ca1e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:47.208419 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a704975-2555-41be-8375-1226973ca1e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:47.209120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a704975-2555-41be-8375-1226973ca1e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:47.209573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a704975-2555-41be-8375-1226973ca1e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:47.209984 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a704975-2555-41be-8375-1226973ca1e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:47.275693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3a704975-2555-41be-8375-1226973ca1e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:47.284603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3a704975-2555-41be-8375-1226973ca1e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:47.286061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3a704975-2555-41be-8375-1226973ca1e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:47.287223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3a704975-2555-41be-8375-1226973ca1e9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.092274 Sep 05 17:23:47.287830 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1024/1892] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:47 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:48.317379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-065f8b1f-29ca-4f9b-ae16-f825274b0873 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:48.318337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-065f8b1f-29ca-4f9b-ae16-f825274b0873 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:48.330030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-065f8b1f-29ca-4f9b-ae16-f825274b0873 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:48.330819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-065f8b1f-29ca-4f9b-ae16-f825274b0873 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:48.331528 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-065f8b1f-29ca-4f9b-ae16-f825274b0873 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:48.332712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-065f8b1f-29ca-4f9b-ae16-f825274b0873 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:48.333461 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-065f8b1f-29ca-4f9b-ae16-f825274b0873 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:48.334153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-065f8b1f-29ca-4f9b-ae16-f825274b0873 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:48.402779 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-065f8b1f-29ca-4f9b-ae16-f825274b0873 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:48.411473 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-065f8b1f-29ca-4f9b-ae16-f825274b0873 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:48.412939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-065f8b1f-29ca-4f9b-ae16-f825274b0873 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:48.414079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-065f8b1f-29ca-4f9b-ae16-f825274b0873 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.103413 Sep 05 17:23:48.414654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 869/1893] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:48 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:49.442827 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b743b469-fee6-4e54-aecc-27a94bc94533 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:49.443751 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b743b469-fee6-4e54-aecc-27a94bc94533 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:49.451847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b743b469-fee6-4e54-aecc-27a94bc94533 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:49.452405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b743b469-fee6-4e54-aecc-27a94bc94533 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:49.452837 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b743b469-fee6-4e54-aecc-27a94bc94533 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:49.453566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b743b469-fee6-4e54-aecc-27a94bc94533 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:49.454016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b743b469-fee6-4e54-aecc-27a94bc94533 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:49.454445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b743b469-fee6-4e54-aecc-27a94bc94533 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:49.520849 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b743b469-fee6-4e54-aecc-27a94bc94533 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:49.529933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b743b469-fee6-4e54-aecc-27a94bc94533 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:49.531386 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b743b469-fee6-4e54-aecc-27a94bc94533 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:49.532566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b743b469-fee6-4e54-aecc-27a94bc94533 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.096040 Sep 05 17:23:49.533133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1025/1894] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:49 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:50.560504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-bbf869be-d57d-4e98-a4f7-549b8c25f0b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:50.561240 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-bbf869be-d57d-4e98-a4f7-549b8c25f0b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:50.569121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bbf869be-d57d-4e98-a4f7-549b8c25f0b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:50.569674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bbf869be-d57d-4e98-a4f7-549b8c25f0b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:50.570171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bbf869be-d57d-4e98-a4f7-549b8c25f0b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:50.570967 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bbf869be-d57d-4e98-a4f7-549b8c25f0b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:50.571478 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bbf869be-d57d-4e98-a4f7-549b8c25f0b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:50.571958 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bbf869be-d57d-4e98-a4f7-549b8c25f0b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:50.638682 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bbf869be-d57d-4e98-a4f7-549b8c25f0b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:50.651724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bbf869be-d57d-4e98-a4f7-549b8c25f0b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:50.653502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bbf869be-d57d-4e98-a4f7-549b8c25f0b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:50.655144 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-bbf869be-d57d-4e98-a4f7-549b8c25f0b5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100130 Sep 05 17:23:50.655836 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 870/1895] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:50 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:51.688289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f51cbcaf-b149-445f-a2b5-a8639a31c3b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:51.689352 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f51cbcaf-b149-445f-a2b5-a8639a31c3b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:51.693298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=28 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:23:51.701041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f51cbcaf-b149-445f-a2b5-a8639a31c3b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:51.701528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f51cbcaf-b149-445f-a2b5-a8639a31c3b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:51.701956 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f51cbcaf-b149-445f-a2b5-a8639a31c3b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:51.702688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f51cbcaf-b149-445f-a2b5-a8639a31c3b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:51.703170 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f51cbcaf-b149-445f-a2b5-a8639a31c3b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:51.703592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f51cbcaf-b149-445f-a2b5-a8639a31c3b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:51.706221 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=84 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:23:51.767424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f51cbcaf-b149-445f-a2b5-a8639a31c3b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:51.776674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f51cbcaf-b149-445f-a2b5-a8639a31c3b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:51.777747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f51cbcaf-b149-445f-a2b5-a8639a31c3b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:51.778909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f51cbcaf-b149-445f-a2b5-a8639a31c3b4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097563 Sep 05 17:23:51.779473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1026/1896] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:51 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:52.809072 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cd7a0f03-e6ea-4b16-ab41-29c7ee45a26f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:52.809662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cd7a0f03-e6ea-4b16-ab41-29c7ee45a26f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:52.811943 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=28 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:23:52.818883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd7a0f03-e6ea-4b16-ab41-29c7ee45a26f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:52.819363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd7a0f03-e6ea-4b16-ab41-29c7ee45a26f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:52.819788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd7a0f03-e6ea-4b16-ab41-29c7ee45a26f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:52.820513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd7a0f03-e6ea-4b16-ab41-29c7ee45a26f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:52.820951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd7a0f03-e6ea-4b16-ab41-29c7ee45a26f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:52.821359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd7a0f03-e6ea-4b16-ab41-29c7ee45a26f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:52.824356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=84 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:23:52.901175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cd7a0f03-e6ea-4b16-ab41-29c7ee45a26f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:52.910359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cd7a0f03-e6ea-4b16-ab41-29c7ee45a26f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:52.911788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cd7a0f03-e6ea-4b16-ab41-29c7ee45a26f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:52.912967 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cd7a0f03-e6ea-4b16-ab41-29c7ee45a26f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.111859 Sep 05 17:23:52.913523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 871/1897] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:52 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:53.942506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bec068c5-f688-4ed6-9144-a5e707a35619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:53.943481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bec068c5-f688-4ed6-9144-a5e707a35619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:53.952730 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bec068c5-f688-4ed6-9144-a5e707a35619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:53.953215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bec068c5-f688-4ed6-9144-a5e707a35619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:53.953644 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bec068c5-f688-4ed6-9144-a5e707a35619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:53.954333 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bec068c5-f688-4ed6-9144-a5e707a35619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:53.954781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bec068c5-f688-4ed6-9144-a5e707a35619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:53.955203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bec068c5-f688-4ed6-9144-a5e707a35619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:54.021768 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bec068c5-f688-4ed6-9144-a5e707a35619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:54.031040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bec068c5-f688-4ed6-9144-a5e707a35619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:54.032510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bec068c5-f688-4ed6-9144-a5e707a35619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:54.033774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bec068c5-f688-4ed6-9144-a5e707a35619 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097968 Sep 05 17:23:54.034340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1027/1898] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:53 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:55.064121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-47bbbdeb-2202-442b-889e-9257841c1ec6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:55.065149 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-47bbbdeb-2202-442b-889e-9257841c1ec6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:55.076442 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47bbbdeb-2202-442b-889e-9257841c1ec6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:55.077234 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47bbbdeb-2202-442b-889e-9257841c1ec6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:55.077943 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47bbbdeb-2202-442b-889e-9257841c1ec6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:55.079053 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47bbbdeb-2202-442b-889e-9257841c1ec6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:55.079790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47bbbdeb-2202-442b-889e-9257841c1ec6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:55.080549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47bbbdeb-2202-442b-889e-9257841c1ec6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:55.153060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-47bbbdeb-2202-442b-889e-9257841c1ec6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:55.162558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-47bbbdeb-2202-442b-889e-9257841c1ec6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:55.163985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-47bbbdeb-2202-442b-889e-9257841c1ec6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:55.165151 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-47bbbdeb-2202-442b-889e-9257841c1ec6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.108150 Sep 05 17:23:55.165711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 872/1899] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:55 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:56.193971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f27863ba-9026-4cd9-9c96-746180b39a94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:56.194930 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f27863ba-9026-4cd9-9c96-746180b39a94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:56.203483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f27863ba-9026-4cd9-9c96-746180b39a94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:56.203960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f27863ba-9026-4cd9-9c96-746180b39a94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:56.204415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f27863ba-9026-4cd9-9c96-746180b39a94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:56.205101 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f27863ba-9026-4cd9-9c96-746180b39a94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:56.205546 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f27863ba-9026-4cd9-9c96-746180b39a94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:56.205965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f27863ba-9026-4cd9-9c96-746180b39a94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:56.273093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f27863ba-9026-4cd9-9c96-746180b39a94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:56.282606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f27863ba-9026-4cd9-9c96-746180b39a94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:56.284034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f27863ba-9026-4cd9-9c96-746180b39a94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:56.285199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f27863ba-9026-4cd9-9c96-746180b39a94 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097967 Sep 05 17:23:56.285761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1028/1900] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:56 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:57.318247 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-113c5f43-8703-4abb-b5e3-1a4966c42e18 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:57.318932 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-113c5f43-8703-4abb-b5e3-1a4966c42e18 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:57.326649 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-113c5f43-8703-4abb-b5e3-1a4966c42e18 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:57.327378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-113c5f43-8703-4abb-b5e3-1a4966c42e18 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:57.327899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-113c5f43-8703-4abb-b5e3-1a4966c42e18 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:57.328634 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-113c5f43-8703-4abb-b5e3-1a4966c42e18 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:57.329060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-113c5f43-8703-4abb-b5e3-1a4966c42e18 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:57.329786 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-113c5f43-8703-4abb-b5e3-1a4966c42e18 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:57.397127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-113c5f43-8703-4abb-b5e3-1a4966c42e18 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:57.406260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-113c5f43-8703-4abb-b5e3-1a4966c42e18 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:57.407783 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-113c5f43-8703-4abb-b5e3-1a4966c42e18 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:57.409045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-113c5f43-8703-4abb-b5e3-1a4966c42e18 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.094852 Sep 05 17:23:57.409677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 873/1901] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:57 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:58.439918 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cf7fbb1e-8f74-4b23-822a-3c1a830b9795 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:58.440922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cf7fbb1e-8f74-4b23-822a-3c1a830b9795 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:58.450057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf7fbb1e-8f74-4b23-822a-3c1a830b9795 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:58.450539 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf7fbb1e-8f74-4b23-822a-3c1a830b9795 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:58.450964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf7fbb1e-8f74-4b23-822a-3c1a830b9795 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:58.451655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf7fbb1e-8f74-4b23-822a-3c1a830b9795 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:58.452098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf7fbb1e-8f74-4b23-822a-3c1a830b9795 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:58.452551 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf7fbb1e-8f74-4b23-822a-3c1a830b9795 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:58.525273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cf7fbb1e-8f74-4b23-822a-3c1a830b9795 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:58.534359 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cf7fbb1e-8f74-4b23-822a-3c1a830b9795 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:58.535785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cf7fbb1e-8f74-4b23-822a-3c1a830b9795 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:58.536955 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cf7fbb1e-8f74-4b23-822a-3c1a830b9795 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.103876 Sep 05 17:23:58.537515 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1029/1902] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:58 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:23:59.565111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-14e78866-9d79-4022-beab-21ee172f7371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:23:59.565913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-14e78866-9d79-4022-beab-21ee172f7371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:23:59.575017 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-14e78866-9d79-4022-beab-21ee172f7371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:59.575492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-14e78866-9d79-4022-beab-21ee172f7371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:59.575919 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-14e78866-9d79-4022-beab-21ee172f7371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:59.576638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-14e78866-9d79-4022-beab-21ee172f7371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:23:59.577081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-14e78866-9d79-4022-beab-21ee172f7371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:23:59.577479 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-14e78866-9d79-4022-beab-21ee172f7371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:23:59.661883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-14e78866-9d79-4022-beab-21ee172f7371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:59.672828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-14e78866-9d79-4022-beab-21ee172f7371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:59.674277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-14e78866-9d79-4022-beab-21ee172f7371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:23:59.675420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-14e78866-9d79-4022-beab-21ee172f7371 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.116139 Sep 05 17:23:59.675983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 874/1903] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:23:59 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:00.705166 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-06664a58-b655-45b2-8bcc-422846579995 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:00.705889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-06664a58-b655-45b2-8bcc-422846579995 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:00.715485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06664a58-b655-45b2-8bcc-422846579995 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:00.715964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06664a58-b655-45b2-8bcc-422846579995 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:00.716431 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06664a58-b655-45b2-8bcc-422846579995 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:00.717116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06664a58-b655-45b2-8bcc-422846579995 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:00.717872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06664a58-b655-45b2-8bcc-422846579995 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:00.718317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06664a58-b655-45b2-8bcc-422846579995 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:00.788979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-06664a58-b655-45b2-8bcc-422846579995 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:00.801103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-06664a58-b655-45b2-8bcc-422846579995 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:00.803177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-06664a58-b655-45b2-8bcc-422846579995 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:00.804932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-06664a58-b655-45b2-8bcc-422846579995 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.106460 Sep 05 17:24:00.805631 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1030/1904] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:00 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:01.835951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fde14fb7-5028-4012-a677-a3bb629365a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:01.836964 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fde14fb7-5028-4012-a677-a3bb629365a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:01.848807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fde14fb7-5028-4012-a677-a3bb629365a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:01.849597 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fde14fb7-5028-4012-a677-a3bb629365a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:01.850363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fde14fb7-5028-4012-a677-a3bb629365a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:01.851494 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fde14fb7-5028-4012-a677-a3bb629365a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:01.852282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fde14fb7-5028-4012-a677-a3bb629365a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:01.852987 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fde14fb7-5028-4012-a677-a3bb629365a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:01.915047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fde14fb7-5028-4012-a677-a3bb629365a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:01.924007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fde14fb7-5028-4012-a677-a3bb629365a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:01.925475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fde14fb7-5028-4012-a677-a3bb629365a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:01.926605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fde14fb7-5028-4012-a677-a3bb629365a9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097515 Sep 05 17:24:01.927165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 875/1905] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:01 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:02.957814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-67a3d88c-1bf4-467f-b10d-d0cb1595ea43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:02.958782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-67a3d88c-1bf4-467f-b10d-d0cb1595ea43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:02.968363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67a3d88c-1bf4-467f-b10d-d0cb1595ea43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:02.968838 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67a3d88c-1bf4-467f-b10d-d0cb1595ea43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:02.969276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67a3d88c-1bf4-467f-b10d-d0cb1595ea43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:02.969963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67a3d88c-1bf4-467f-b10d-d0cb1595ea43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:02.970412 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67a3d88c-1bf4-467f-b10d-d0cb1595ea43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:02.970832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67a3d88c-1bf4-467f-b10d-d0cb1595ea43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:03.044482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-67a3d88c-1bf4-467f-b10d-d0cb1595ea43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:03.058377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-67a3d88c-1bf4-467f-b10d-d0cb1595ea43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:03.059741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-67a3d88c-1bf4-467f-b10d-d0cb1595ea43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:03.060929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-67a3d88c-1bf4-467f-b10d-d0cb1595ea43 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.111575 Sep 05 17:24:03.061494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1031/1906] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:02 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:04.091005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2f79dc8f-353d-472e-88db-2bfcedc9e303 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:04.091939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2f79dc8f-353d-472e-88db-2bfcedc9e303 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:04.103230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f79dc8f-353d-472e-88db-2bfcedc9e303 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:04.104019 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f79dc8f-353d-472e-88db-2bfcedc9e303 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:04.104850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f79dc8f-353d-472e-88db-2bfcedc9e303 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:04.105534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f79dc8f-353d-472e-88db-2bfcedc9e303 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:04.105976 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f79dc8f-353d-472e-88db-2bfcedc9e303 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:04.106394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f79dc8f-353d-472e-88db-2bfcedc9e303 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:04.169800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2f79dc8f-353d-472e-88db-2bfcedc9e303 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:04.182973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2f79dc8f-353d-472e-88db-2bfcedc9e303 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:04.185737 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2f79dc8f-353d-472e-88db-2bfcedc9e303 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:04.187428 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2f79dc8f-353d-472e-88db-2bfcedc9e303 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.103319 Sep 05 17:24:04.188264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 876/1907] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:04 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:05.219759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8b155b92-95ed-400b-894c-7efe96503201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:05.220491 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8b155b92-95ed-400b-894c-7efe96503201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:05.228997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b155b92-95ed-400b-894c-7efe96503201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:05.229996 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b155b92-95ed-400b-894c-7efe96503201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:05.230532 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b155b92-95ed-400b-894c-7efe96503201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:05.231400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b155b92-95ed-400b-894c-7efe96503201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:05.231965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b155b92-95ed-400b-894c-7efe96503201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:05.232526 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b155b92-95ed-400b-894c-7efe96503201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:05.301433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8b155b92-95ed-400b-894c-7efe96503201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:05.310481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8b155b92-95ed-400b-894c-7efe96503201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:05.311918 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8b155b92-95ed-400b-894c-7efe96503201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:05.313086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8b155b92-95ed-400b-894c-7efe96503201 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.099025 Sep 05 17:24:05.313647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1032/1908] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:05 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:06.344434 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-55e698e4-0e31-4eae-b19b-b3be378ef4d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:06.345399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-55e698e4-0e31-4eae-b19b-b3be378ef4d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:06.356260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55e698e4-0e31-4eae-b19b-b3be378ef4d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:06.356741 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55e698e4-0e31-4eae-b19b-b3be378ef4d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:06.357165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55e698e4-0e31-4eae-b19b-b3be378ef4d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:06.357847 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55e698e4-0e31-4eae-b19b-b3be378ef4d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:06.358292 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55e698e4-0e31-4eae-b19b-b3be378ef4d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:06.358703 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55e698e4-0e31-4eae-b19b-b3be378ef4d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:06.423553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-55e698e4-0e31-4eae-b19b-b3be378ef4d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:06.432259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-55e698e4-0e31-4eae-b19b-b3be378ef4d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:06.433714 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-55e698e4-0e31-4eae-b19b-b3be378ef4d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:06.434851 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-55e698e4-0e31-4eae-b19b-b3be378ef4d5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097617 Sep 05 17:24:06.435407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 877/1909] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:06 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:07.464759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1e053e0b-e31a-4408-a57b-7e084c1a2f1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:07.465261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1e053e0b-e31a-4408-a57b-7e084c1a2f1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:07.472737 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e053e0b-e31a-4408-a57b-7e084c1a2f1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:07.473215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e053e0b-e31a-4408-a57b-7e084c1a2f1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:07.473639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e053e0b-e31a-4408-a57b-7e084c1a2f1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:07.474328 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e053e0b-e31a-4408-a57b-7e084c1a2f1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:07.474774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e053e0b-e31a-4408-a57b-7e084c1a2f1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:07.475192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e053e0b-e31a-4408-a57b-7e084c1a2f1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:07.541521 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1e053e0b-e31a-4408-a57b-7e084c1a2f1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:07.551084 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1e053e0b-e31a-4408-a57b-7e084c1a2f1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:07.553014 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1e053e0b-e31a-4408-a57b-7e084c1a2f1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:07.554713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1e053e0b-e31a-4408-a57b-7e084c1a2f1c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097135 Sep 05 17:24:07.555640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1033/1910] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:07 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:08.581169 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d53fe42e-ca22-4177-bc64-956d312adaef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:08.581875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d53fe42e-ca22-4177-bc64-956d312adaef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:08.588793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d53fe42e-ca22-4177-bc64-956d312adaef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:08.589348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d53fe42e-ca22-4177-bc64-956d312adaef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:08.589854 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d53fe42e-ca22-4177-bc64-956d312adaef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:08.590606 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d53fe42e-ca22-4177-bc64-956d312adaef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:08.590990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d53fe42e-ca22-4177-bc64-956d312adaef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:08.591407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d53fe42e-ca22-4177-bc64-956d312adaef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:08.655725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d53fe42e-ca22-4177-bc64-956d312adaef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:08.664503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d53fe42e-ca22-4177-bc64-956d312adaef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:08.665933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d53fe42e-ca22-4177-bc64-956d312adaef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:08.667193 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d53fe42e-ca22-4177-bc64-956d312adaef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.090161 Sep 05 17:24:08.667904 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 878/1911] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:08 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:09.696382 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-da13ea37-dc22-4e8c-9b92-b253ffa29db6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:09.697288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-da13ea37-dc22-4e8c-9b92-b253ffa29db6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:09.704543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da13ea37-dc22-4e8c-9b92-b253ffa29db6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:09.705023 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da13ea37-dc22-4e8c-9b92-b253ffa29db6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:09.705513 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da13ea37-dc22-4e8c-9b92-b253ffa29db6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:09.706229 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da13ea37-dc22-4e8c-9b92-b253ffa29db6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:09.706677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da13ea37-dc22-4e8c-9b92-b253ffa29db6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:09.707092 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da13ea37-dc22-4e8c-9b92-b253ffa29db6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:09.782491 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-da13ea37-dc22-4e8c-9b92-b253ffa29db6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:09.795596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-da13ea37-dc22-4e8c-9b92-b253ffa29db6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:09.797714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-da13ea37-dc22-4e8c-9b92-b253ffa29db6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:09.799035 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-da13ea37-dc22-4e8c-9b92-b253ffa29db6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.109298 Sep 05 17:24:09.799755 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1034/1912] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:09 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:10.828174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-71e817a0-439e-44ca-af61-d290bea2fe7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:10.828777 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-71e817a0-439e-44ca-af61-d290bea2fe7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:10.835788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71e817a0-439e-44ca-af61-d290bea2fe7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:10.836300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71e817a0-439e-44ca-af61-d290bea2fe7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:10.836729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71e817a0-439e-44ca-af61-d290bea2fe7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:10.837419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71e817a0-439e-44ca-af61-d290bea2fe7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:10.837872 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71e817a0-439e-44ca-af61-d290bea2fe7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:10.838290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71e817a0-439e-44ca-af61-d290bea2fe7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:10.906328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-71e817a0-439e-44ca-af61-d290bea2fe7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:10.915118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-71e817a0-439e-44ca-af61-d290bea2fe7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:10.916585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-71e817a0-439e-44ca-af61-d290bea2fe7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:10.917763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-71e817a0-439e-44ca-af61-d290bea2fe7c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.093721 Sep 05 17:24:10.918328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 879/1913] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:10 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:11.946028 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-794675d9-7e0b-439e-811c-783256f5d5db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:11.947042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-794675d9-7e0b-439e-811c-783256f5d5db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:11.956974 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-794675d9-7e0b-439e-811c-783256f5d5db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:11.957454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-794675d9-7e0b-439e-811c-783256f5d5db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:11.957881 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-794675d9-7e0b-439e-811c-783256f5d5db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:11.958571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-794675d9-7e0b-439e-811c-783256f5d5db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:11.959124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-794675d9-7e0b-439e-811c-783256f5d5db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:11.959428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-794675d9-7e0b-439e-811c-783256f5d5db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:12.042138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-794675d9-7e0b-439e-811c-783256f5d5db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:12.051497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-794675d9-7e0b-439e-811c-783256f5d5db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:12.052982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-794675d9-7e0b-439e-811c-783256f5d5db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:12.054150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-794675d9-7e0b-439e-811c-783256f5d5db tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.114069 Sep 05 17:24:12.054727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1035/1914] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:11 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:13.093802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-08c308d5-ace7-4260-9d1d-76f12f87642e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:13.094809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-08c308d5-ace7-4260-9d1d-76f12f87642e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:13.105097 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-08c308d5-ace7-4260-9d1d-76f12f87642e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:13.105593 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-08c308d5-ace7-4260-9d1d-76f12f87642e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:13.106014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-08c308d5-ace7-4260-9d1d-76f12f87642e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:13.106696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-08c308d5-ace7-4260-9d1d-76f12f87642e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:13.107140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-08c308d5-ace7-4260-9d1d-76f12f87642e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:13.107599 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-08c308d5-ace7-4260-9d1d-76f12f87642e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:13.175906 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-08c308d5-ace7-4260-9d1d-76f12f87642e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:13.184839 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-08c308d5-ace7-4260-9d1d-76f12f87642e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:13.186260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-08c308d5-ace7-4260-9d1d-76f12f87642e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:13.187399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-08c308d5-ace7-4260-9d1d-76f12f87642e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101392 Sep 05 17:24:13.187955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 880/1915] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:13 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:14.212502 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c89fd2e5-b908-4979-b5a5-df2c427de040 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:14.213172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c89fd2e5-b908-4979-b5a5-df2c427de040 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:14.221074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c89fd2e5-b908-4979-b5a5-df2c427de040 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:14.221633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c89fd2e5-b908-4979-b5a5-df2c427de040 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:14.222067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c89fd2e5-b908-4979-b5a5-df2c427de040 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:14.222760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c89fd2e5-b908-4979-b5a5-df2c427de040 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:14.223209 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c89fd2e5-b908-4979-b5a5-df2c427de040 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:14.223634 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c89fd2e5-b908-4979-b5a5-df2c427de040 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:14.288303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0c0566d1-845b-42cd-8b0a-6cdf5b99962c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:14.288738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c89fd2e5-b908-4979-b5a5-df2c427de040 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:14.288862 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0c0566d1-845b-42cd-8b0a-6cdf5b99962c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:14.295321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c0566d1-845b-42cd-8b0a-6cdf5b99962c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:14.295802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c0566d1-845b-42cd-8b0a-6cdf5b99962c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:14.296253 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c0566d1-845b-42cd-8b0a-6cdf5b99962c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:14.297198 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c0566d1-845b-42cd-8b0a-6cdf5b99962c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:14.297830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c0566d1-845b-42cd-8b0a-6cdf5b99962c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:14.297978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c89fd2e5-b908-4979-b5a5-df2c427de040 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:14.298596 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c0566d1-845b-42cd-8b0a-6cdf5b99962c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:14.299396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c89fd2e5-b908-4979-b5a5-df2c427de040 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:14.300575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c89fd2e5-b908-4979-b5a5-df2c427de040 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.092156 Sep 05 17:24:14.301127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1036/1916] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:14 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:14.324661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0c0566d1-845b-42cd-8b0a-6cdf5b99962c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Going to try to terminate instance {{(pid=120733) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:24:14.414675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0c0566d1-845b-42cd-8b0a-6cdf5b99962c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 204 len: 0 microversion: 2.1 time: 0.130340 Sep 05 17:24:14.415535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 881/1917] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:24:14 2022] DELETE /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:24:14.424007 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bca8b2ea-dd8b-4a40-b0cf-55b7e1f9797f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:14.424832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bca8b2ea-dd8b-4a40-b0cf-55b7e1f9797f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:14.431533 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bca8b2ea-dd8b-4a40-b0cf-55b7e1f9797f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:14.432371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bca8b2ea-dd8b-4a40-b0cf-55b7e1f9797f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:14.432805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bca8b2ea-dd8b-4a40-b0cf-55b7e1f9797f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:14.433580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bca8b2ea-dd8b-4a40-b0cf-55b7e1f9797f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:14.434012 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bca8b2ea-dd8b-4a40-b0cf-55b7e1f9797f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:14.434442 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bca8b2ea-dd8b-4a40-b0cf-55b7e1f9797f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:14.575220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bca8b2ea-dd8b-4a40-b0cf-55b7e1f9797f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:14.583122 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bca8b2ea-dd8b-4a40-b0cf-55b7e1f9797f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 200 len: 1681 microversion: 2.1 time: 0.163028 Sep 05 17:24:14.583700 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1037/1918] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:24:14 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:24:15.327927 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4d723e6a-ad47-444b-920b-88b9b3835048 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:15.328656 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4d723e6a-ad47-444b-920b-88b9b3835048 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:15.335377 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d723e6a-ad47-444b-920b-88b9b3835048 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:15.335854 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d723e6a-ad47-444b-920b-88b9b3835048 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:15.336305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d723e6a-ad47-444b-920b-88b9b3835048 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:15.337432 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d723e6a-ad47-444b-920b-88b9b3835048 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:15.338321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d723e6a-ad47-444b-920b-88b9b3835048 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:15.338946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d723e6a-ad47-444b-920b-88b9b3835048 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:15.423532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4d723e6a-ad47-444b-920b-88b9b3835048 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:15.432429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4d723e6a-ad47-444b-920b-88b9b3835048 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:15.434082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4d723e6a-ad47-444b-920b-88b9b3835048 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:15.435256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4d723e6a-ad47-444b-920b-88b9b3835048 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.111947 Sep 05 17:24:15.435816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 882/1919] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:15 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:15.615231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-352744ee-de53-4735-a552-6d80b07436a7 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:15.615888 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-352744ee-de53-4735-a552-6d80b07436a7 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:15.622960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352744ee-de53-4735-a552-6d80b07436a7 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:15.623444 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352744ee-de53-4735-a552-6d80b07436a7 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:15.623873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352744ee-de53-4735-a552-6d80b07436a7 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:15.624605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352744ee-de53-4735-a552-6d80b07436a7 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:15.625054 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352744ee-de53-4735-a552-6d80b07436a7 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:15.625468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352744ee-de53-4735-a552-6d80b07436a7 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:15.757416 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-352744ee-de53-4735-a552-6d80b07436a7 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:15.765481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-352744ee-de53-4735-a552-6d80b07436a7 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 200 len: 1681 microversion: 2.1 time: 0.154204 Sep 05 17:24:15.766068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1038/1920] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:24:15 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:24:16.150689 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-321ccc53-f1f1-4175-86f2-5e9271ef0e59 req-1fca668d-bcb0-4286-8c9a-2df8148ccf41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c69901d5-72a5-4e1d-af30-b7c680f90b73", "name": "network-vif-deleted", "tag": "01c8109f-3864-4fe7-aab8-f7e9f1ac508b"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:24:16.161237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-321ccc53-f1f1-4175-86f2-5e9271ef0e59 req-1fca668d-bcb0-4286-8c9a-2df8148ccf41 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:16.162002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-321ccc53-f1f1-4175-86f2-5e9271ef0e59 req-1fca668d-bcb0-4286-8c9a-2df8148ccf41 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:16.162419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-321ccc53-f1f1-4175-86f2-5e9271ef0e59 req-1fca668d-bcb0-4286-8c9a-2df8148ccf41 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:16.180002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-321ccc53-f1f1-4175-86f2-5e9271ef0e59 req-1fca668d-bcb0-4286-8c9a-2df8148ccf41 service nova] Creating event network-vif-deleted:01c8109f-3864-4fe7-aab8-f7e9f1ac508b for instance c69901d5-72a5-4e1d-af30-b7c680f90b73 on hv-cinder-85596 Sep 05 17:24:16.187715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-321ccc53-f1f1-4175-86f2-5e9271ef0e59 req-1fca668d-bcb0-4286-8c9a-2df8148ccf41 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042114 Sep 05 17:24:16.188323 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 883/1921] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:24:16.461344 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5d99b1c4-dd38-4754-8284-d13efb762be2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:16.464392 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5d99b1c4-dd38-4754-8284-d13efb762be2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:16.472621 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d99b1c4-dd38-4754-8284-d13efb762be2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:16.473107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d99b1c4-dd38-4754-8284-d13efb762be2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:16.474039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d99b1c4-dd38-4754-8284-d13efb762be2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:16.474773 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d99b1c4-dd38-4754-8284-d13efb762be2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:16.475227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d99b1c4-dd38-4754-8284-d13efb762be2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:16.475652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d99b1c4-dd38-4754-8284-d13efb762be2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:16.541363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5d99b1c4-dd38-4754-8284-d13efb762be2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:16.550503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5d99b1c4-dd38-4754-8284-d13efb762be2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:16.551950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5d99b1c4-dd38-4754-8284-d13efb762be2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:16.553154 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5d99b1c4-dd38-4754-8284-d13efb762be2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.095980 Sep 05 17:24:16.553723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1039/1922] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:16 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:16.791971 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fd35817b-57de-4a20-b4f8-426bd35bc981 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:16.792800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fd35817b-57de-4a20-b4f8-426bd35bc981 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:16.799668 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd35817b-57de-4a20-b4f8-426bd35bc981 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:16.800322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd35817b-57de-4a20-b4f8-426bd35bc981 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:16.800861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd35817b-57de-4a20-b4f8-426bd35bc981 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:16.801657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd35817b-57de-4a20-b4f8-426bd35bc981 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:16.802250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd35817b-57de-4a20-b4f8-426bd35bc981 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:16.802771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd35817b-57de-4a20-b4f8-426bd35bc981 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:16.847820 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd35817b-57de-4a20-b4f8-426bd35bc981 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:16.848470 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd35817b-57de-4a20-b4f8-426bd35bc981 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:16.849034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd35817b-57de-4a20-b4f8-426bd35bc981 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:16.849607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.objects.instance [None req-fd35817b-57de-4a20-b4f8-426bd35bc981 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lazy-loading 'fault' on Instance uuid c69901d5-72a5-4e1d-af30-b7c680f90b73 {{(pid=120733) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:24:16.894737 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fd35817b-57de-4a20-b4f8-426bd35bc981 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:16.902380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fd35817b-57de-4a20-b4f8-426bd35bc981 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 200 len: 1331 microversion: 2.1 time: 0.115332 Sep 05 17:24:16.902985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 884/1923] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:24:16 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:24:17.581480 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-943f0c50-18f7-414c-846f-9c0adadc8d51 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:17.582064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-943f0c50-18f7-414c-846f-9c0adadc8d51 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:17.592141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-943f0c50-18f7-414c-846f-9c0adadc8d51 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:17.593060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-943f0c50-18f7-414c-846f-9c0adadc8d51 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:17.593616 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-943f0c50-18f7-414c-846f-9c0adadc8d51 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:17.594480 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-943f0c50-18f7-414c-846f-9c0adadc8d51 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:17.595043 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-943f0c50-18f7-414c-846f-9c0adadc8d51 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:17.595574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-943f0c50-18f7-414c-846f-9c0adadc8d51 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:17.659757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-943f0c50-18f7-414c-846f-9c0adadc8d51 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:17.669064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-943f0c50-18f7-414c-846f-9c0adadc8d51 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:17.670511 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-943f0c50-18f7-414c-846f-9c0adadc8d51 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:17.671664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-943f0c50-18f7-414c-846f-9c0adadc8d51 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.096240 Sep 05 17:24:17.672221 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1040/1924] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:17 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:17.931700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-33ed29a7-235e-4afd-a2ba-a33f5399adcb tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:17.932625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-33ed29a7-235e-4afd-a2ba-a33f5399adcb tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:17.939979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33ed29a7-235e-4afd-a2ba-a33f5399adcb tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:17.940487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33ed29a7-235e-4afd-a2ba-a33f5399adcb tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:17.940909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33ed29a7-235e-4afd-a2ba-a33f5399adcb tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:17.941591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33ed29a7-235e-4afd-a2ba-a33f5399adcb tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:17.942036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33ed29a7-235e-4afd-a2ba-a33f5399adcb tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:17.942446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33ed29a7-235e-4afd-a2ba-a33f5399adcb tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:17.956102 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-33ed29a7-235e-4afd-a2ba-a33f5399adcb tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] HTTP exception thrown: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-33ed29a7-235e-4afd-a2ba-a33f5399adcb tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Request method failure captured: Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 HTTP/1.1 Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFiv_u9Fbkzz4N4EnwLFTHdVgGIHyTWZLVadgHsx5DjzJc71ULzFynHZ-XPxUeQAMj5CK9TClkqesRSKhjnpIv2d__HUGj1wgdznOqyEZDFoYmO3imZ0m9_h8uFe0RLmxeR8bY4quUM556Rumoa232jhk_i2qgcsiqF_5KIfw8vmSWkU Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:24:17.957758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:24:17.959456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6ed4f1f1246408099252ebea491832c"}]}] Sep 05 17:24:17.959456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:24:17.959456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:24:17.959456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:24:17.959456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:24:17.959456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:24:17.959456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:24:17.959456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: 2b81fb00b1b545308d01f74a55b7e77b Sep 05 17:24:17.959456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:24:17.959456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:24:17.959456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. Sep 05 17:24:17.959456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': 'c69901d5-72a5-4e1d-af30-b7c680f90b73'} Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:24:17.960503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. Sep 05 17:24:17.962103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:24:17.963538 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-33ed29a7-235e-4afd-a2ba-a33f5399adcb tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Returning 404 to user: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:24:17.963538 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-33ed29a7-235e-4afd-a2ba-a33f5399adcb tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 404 len: 111 microversion: 2.1 time: 0.034094 Sep 05 17:24:17.963538 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 885/1925] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:24:17 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:24:17.969528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-43e3acc7-0b7e-4469-af5a-992802a148f7 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '.version_select at 0x7f1d3a61e820>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:17.995247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-43e3acc7-0b7e-4469-af5a-992802a148f7 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-146801640" status: 202 len: 0 microversion: 2.1 time: 0.030053 Sep 05 17:24:17.995811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1041/1926] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Sep 5 17:24:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-146801640 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:24:18.656037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c5f34285-2e0f-42c1-a878-2d63ffe28063 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Action: 'create', calling method: .version_select at 0x7f1d3aa81af0>, body: {"keypair": {"name": "tempest-keypair-1012831540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqtEwxH81S/4LMxYosOXsFIbIQr6wE5ZAiuRYmAKuvG70V9OOV5LzOaBPq144op7jrt3qaKVWiFswuJPDms2I1TQBSk44s88KWpqMmc+a7wk0tA426jPgccWqz5JGc4Bw=="}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:24:18.672267 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-c5f34285-2e0f-42c1-a878-2d63ffe28063 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Getting quotas for project c6ed4f1f1246408099252ebea491832c. Resources: {'key_pairs'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:24:18.676357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-c5f34285-2e0f-42c1-a878-2d63ffe28063 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Getting quotas for user 2b81fb00b1b545308d01f74a55b7e77b and project c6ed4f1f1246408099252ebea491832c. Resources: {'key_pairs'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:24:18.697624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2f6f3323-5b6d-4c45-869f-7db4ca42ee11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:18.698393 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2f6f3323-5b6d-4c45-869f-7db4ca42ee11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:18.706959 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f6f3323-5b6d-4c45-869f-7db4ca42ee11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:18.707469 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f6f3323-5b6d-4c45-869f-7db4ca42ee11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:18.707889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f6f3323-5b6d-4c45-869f-7db4ca42ee11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:18.708621 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f6f3323-5b6d-4c45-869f-7db4ca42ee11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:18.709073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c5f34285-2e0f-42c1-a878-2d63ffe28063 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057129 Sep 05 17:24:18.709203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f6f3323-5b6d-4c45-869f-7db4ca42ee11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:18.709495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f6f3323-5b6d-4c45-869f-7db4ca42ee11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:18.716909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 886/1927] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Sep 5 17:24:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:24:18.778464 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2f6f3323-5b6d-4c45-869f-7db4ca42ee11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:18.787323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2f6f3323-5b6d-4c45-869f-7db4ca42ee11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:18.788802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2f6f3323-5b6d-4c45-869f-7db4ca42ee11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:18.789974 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2f6f3323-5b6d-4c45-869f-7db4ca42ee11 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097324 Sep 05 17:24:18.790533 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1042/1928] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:18 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:19.815549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cd95a188-2658-4570-838b-b4f9c617d236 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:19.816262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cd95a188-2658-4570-838b-b4f9c617d236 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:19.824018 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd95a188-2658-4570-838b-b4f9c617d236 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:19.824723 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd95a188-2658-4570-838b-b4f9c617d236 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:19.825147 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd95a188-2658-4570-838b-b4f9c617d236 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:19.825839 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd95a188-2658-4570-838b-b4f9c617d236 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:19.826347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd95a188-2658-4570-838b-b4f9c617d236 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:19.826744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cd95a188-2658-4570-838b-b4f9c617d236 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:19.898656 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cd95a188-2658-4570-838b-b4f9c617d236 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:19.908266 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cd95a188-2658-4570-838b-b4f9c617d236 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:19.909712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cd95a188-2658-4570-838b-b4f9c617d236 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:19.910863 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cd95a188-2658-4570-838b-b4f9c617d236 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100194 Sep 05 17:24:19.911447 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 887/1929] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:19 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:20.275426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-236192169", "imageRef": "c1a4f3d3-4d68-489a-a57b-bae7854beb29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d0f5cb4-668d-4cba-a489-7255c177e6e4"}], "security_groups": [{"name": "tempest-securitygroup--552889545"}], "key_name": "tempest-keypair-1012831540", "user_data": "}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:24:20.384051 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] validate_networks() for [('8d0f5cb4-668d-4cba-a489-7255c177e6e4', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:24:20.848007 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:24:20.848464 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:24:20.848937 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:24:20.849342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:24:20.849749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:24:20.859661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:20.860182 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:20.860619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:20.861343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:20.861795 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:20.862215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:20.879629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Getting quotas for project c6ed4f1f1246408099252ebea491832c. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:24:20.884192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Getting quotas for user 2b81fb00b1b545308d01f74a55b7e77b and project c6ed4f1f1246408099252ebea491832c. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:24:20.898243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:24:20.900626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a4f3d3-4d68-489a-a57b-bae7854beb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:24:20.936807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7e749783-72a1-49e1-8c65-9426a8b0a9b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:20.937532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7e749783-72a1-49e1-8c65-9426a8b0a9b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:20.944436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e749783-72a1-49e1-8c65-9426a8b0a9b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:20.944922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e749783-72a1-49e1-8c65-9426a8b0a9b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:20.945354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e749783-72a1-49e1-8c65-9426a8b0a9b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:20.946048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e749783-72a1-49e1-8c65-9426a8b0a9b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:20.946503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e749783-72a1-49e1-8c65-9426a8b0a9b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:20.946925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7e749783-72a1-49e1-8c65-9426a8b0a9b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:20.950804 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d904294e-1a21-4034-b217-6e69a023a78b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.679719 Sep 05 17:24:20.951478 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1043/1930] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:24:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 17:24:20.952577 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:24:20.962871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0cf4794f-546c-48b4-a8f6-2dbafb55ec03 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:20.963490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0cf4794f-546c-48b4-a8f6-2dbafb55ec03 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:21.041105 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7e749783-72a1-49e1-8c65-9426a8b0a9b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:21.043359 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0cf4794f-546c-48b4-a8f6-2dbafb55ec03 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:21.051079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7e749783-72a1-49e1-8c65-9426a8b0a9b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:21.051313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0cf4794f-546c-48b4-a8f6-2dbafb55ec03 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 200 len: 1241 microversion: 2.1 time: 0.092318 Sep 05 17:24:21.051980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1044/1931] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:24:20 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:24:21.052714 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7e749783-72a1-49e1-8c65-9426a8b0a9b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:21.053866 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7e749783-72a1-49e1-8c65-9426a8b0a9b6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.121524 Sep 05 17:24:21.054388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 888/1932] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:20 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:22.078101 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5137bcda-dfdb-4f68-ba21-6deb4c3629b4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:22.078762 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5137bcda-dfdb-4f68-ba21-6deb4c3629b4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:22.081178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cfb7a658-1e6c-4881-a0b1-68687d2b1c92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:22.081681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:24:22.081892 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cfb7a658-1e6c-4881-a0b1-68687d2b1c92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:22.088256 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5137bcda-dfdb-4f68-ba21-6deb4c3629b4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:22.088742 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5137bcda-dfdb-4f68-ba21-6deb4c3629b4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:22.089232 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5137bcda-dfdb-4f68-ba21-6deb4c3629b4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:22.089404 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfb7a658-1e6c-4881-a0b1-68687d2b1c92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:22.089945 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfb7a658-1e6c-4881-a0b1-68687d2b1c92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:22.090062 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5137bcda-dfdb-4f68-ba21-6deb4c3629b4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:22.090427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfb7a658-1e6c-4881-a0b1-68687d2b1c92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:22.090564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5137bcda-dfdb-4f68-ba21-6deb4c3629b4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:22.090918 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5137bcda-dfdb-4f68-ba21-6deb4c3629b4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:22.091193 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfb7a658-1e6c-4881-a0b1-68687d2b1c92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:22.091751 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfb7a658-1e6c-4881-a0b1-68687d2b1c92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:22.092762 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cfb7a658-1e6c-4881-a0b1-68687d2b1c92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:22.095972 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=98 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:24:22.180178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cfb7a658-1e6c-4881-a0b1-68687d2b1c92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:22.181128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5137bcda-dfdb-4f68-ba21-6deb4c3629b4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:22.190263 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5137bcda-dfdb-4f68-ba21-6deb4c3629b4 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 200 len: 1293 microversion: 2.1 time: 0.118383 Sep 05 17:24:22.190503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cfb7a658-1e6c-4881-a0b1-68687d2b1c92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:22.191334 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1045/1933] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:24:22 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 1293 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:24:22.191942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cfb7a658-1e6c-4881-a0b1-68687d2b1c92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:22.193235 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cfb7a658-1e6c-4881-a0b1-68687d2b1c92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.117097 Sep 05 17:24:22.193795 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 889/1934] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:22 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:23.214558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-26fef4c6-8112-4391-9327-4de8b2b56088 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:23.215339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-26fef4c6-8112-4391-9327-4de8b2b56088 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:23.222097 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-22fdfa51-e1b9-4cd1-88c4-671a81aa32f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:23.222891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26fef4c6-8112-4391-9327-4de8b2b56088 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:23.223386 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26fef4c6-8112-4391-9327-4de8b2b56088 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:23.223531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-22fdfa51-e1b9-4cd1-88c4-671a81aa32f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:23.223822 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26fef4c6-8112-4391-9327-4de8b2b56088 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:23.224686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26fef4c6-8112-4391-9327-4de8b2b56088 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:23.225336 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26fef4c6-8112-4391-9327-4de8b2b56088 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:23.225765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26fef4c6-8112-4391-9327-4de8b2b56088 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:23.232101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:24:23.235350 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22fdfa51-e1b9-4cd1-88c4-671a81aa32f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:23.236270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22fdfa51-e1b9-4cd1-88c4-671a81aa32f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:23.236977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22fdfa51-e1b9-4cd1-88c4-671a81aa32f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:23.238156 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22fdfa51-e1b9-4cd1-88c4-671a81aa32f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:23.238716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22fdfa51-e1b9-4cd1-88c4-671a81aa32f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:23.239269 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22fdfa51-e1b9-4cd1-88c4-671a81aa32f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:23.334033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-22fdfa51-e1b9-4cd1-88c4-671a81aa32f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:23.348366 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-22fdfa51-e1b9-4cd1-88c4-671a81aa32f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:23.350151 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-22fdfa51-e1b9-4cd1-88c4-671a81aa32f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:23.351430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-22fdfa51-e1b9-4cd1-88c4-671a81aa32f5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.136545 Sep 05 17:24:23.352131 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 890/1935] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:23 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:23.406949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-26fef4c6-8112-4391-9327-4de8b2b56088 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:23.414778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-26fef4c6-8112-4391-9327-4de8b2b56088 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 200 len: 1366 microversion: 2.1 time: 0.204177 Sep 05 17:24:23.415354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1046/1936] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:24:23 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:24:23.976368 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-8c73350b-0c1a-43ed-b360-643df5eb7815 req-b3a2c12f-563b-4ecb-8e49-606978a650c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b84a236f-3d97-4011-b0d9-0c42454895c1", "tag": "df90783c-9a54-4fd7-a02c-14a305c048f7"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:24:23.987185 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-8c73350b-0c1a-43ed-b360-643df5eb7815 req-b3a2c12f-563b-4ecb-8e49-606978a650c9 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:23.988314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-8c73350b-0c1a-43ed-b360-643df5eb7815 req-b3a2c12f-563b-4ecb-8e49-606978a650c9 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:23.988814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-8c73350b-0c1a-43ed-b360-643df5eb7815 req-b3a2c12f-563b-4ecb-8e49-606978a650c9 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:24.000326 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-8c73350b-0c1a-43ed-b360-643df5eb7815 req-b3a2c12f-563b-4ecb-8e49-606978a650c9 service nova] Creating event network-changed:df90783c-9a54-4fd7-a02c-14a305c048f7 for instance b84a236f-3d97-4011-b0d9-0c42454895c1 on hv-cinder-85596 Sep 05 17:24:24.005470 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-8c73350b-0c1a-43ed-b360-643df5eb7815 req-b3a2c12f-563b-4ecb-8e49-606978a650c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034028 Sep 05 17:24:24.006332 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 891/1937] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:24:24.377152 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-09893b07-9e8f-4db1-96eb-7176da867c03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:24.377799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-09893b07-9e8f-4db1-96eb-7176da867c03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:24.384527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09893b07-9e8f-4db1-96eb-7176da867c03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:24.384999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09893b07-9e8f-4db1-96eb-7176da867c03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:24.385505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09893b07-9e8f-4db1-96eb-7176da867c03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:24.386184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09893b07-9e8f-4db1-96eb-7176da867c03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:24.386762 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09893b07-9e8f-4db1-96eb-7176da867c03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:24.387177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09893b07-9e8f-4db1-96eb-7176da867c03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:24.439636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d7b4fd95-a98b-4fef-a326-102462cf7f22 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:24.440373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d7b4fd95-a98b-4fef-a326-102462cf7f22 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:24.447614 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d7b4fd95-a98b-4fef-a326-102462cf7f22 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:24.448466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d7b4fd95-a98b-4fef-a326-102462cf7f22 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:24.448744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d7b4fd95-a98b-4fef-a326-102462cf7f22 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:24.449605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d7b4fd95-a98b-4fef-a326-102462cf7f22 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:24.450127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d7b4fd95-a98b-4fef-a326-102462cf7f22 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:24.450572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-09893b07-9e8f-4db1-96eb-7176da867c03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:24.450752 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d7b4fd95-a98b-4fef-a326-102462cf7f22 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:24.460761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-09893b07-9e8f-4db1-96eb-7176da867c03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:24.462799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-09893b07-9e8f-4db1-96eb-7176da867c03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:24.464078 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-09893b07-9e8f-4db1-96eb-7176da867c03 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.091232 Sep 05 17:24:24.465019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1047/1938] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:24 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:24.583269 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d7b4fd95-a98b-4fef-a326-102462cf7f22 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:24.591657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d7b4fd95-a98b-4fef-a326-102462cf7f22 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 200 len: 1366 microversion: 2.1 time: 0.157466 Sep 05 17:24:24.592171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 892/1939] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:24:24 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:24:25.495277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9a078fe9-92f1-4688-98b5-f8eb1e0314bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:25.496264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9a078fe9-92f1-4688-98b5-f8eb1e0314bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:25.505575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a078fe9-92f1-4688-98b5-f8eb1e0314bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:25.506564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a078fe9-92f1-4688-98b5-f8eb1e0314bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:25.506564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a078fe9-92f1-4688-98b5-f8eb1e0314bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:25.507406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a078fe9-92f1-4688-98b5-f8eb1e0314bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:25.507943 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a078fe9-92f1-4688-98b5-f8eb1e0314bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:25.508507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a078fe9-92f1-4688-98b5-f8eb1e0314bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:25.577370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9a078fe9-92f1-4688-98b5-f8eb1e0314bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:25.586545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9a078fe9-92f1-4688-98b5-f8eb1e0314bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:25.587988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9a078fe9-92f1-4688-98b5-f8eb1e0314bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:25.589183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9a078fe9-92f1-4688-98b5-f8eb1e0314bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100926 Sep 05 17:24:25.589723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1048/1940] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:25 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:25.623428 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7dc38456-adb0-4f60-bd20-00ed6cd59b44 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:25.624051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7dc38456-adb0-4f60-bd20-00ed6cd59b44 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:25.630737 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dc38456-adb0-4f60-bd20-00ed6cd59b44 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:25.631188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dc38456-adb0-4f60-bd20-00ed6cd59b44 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:25.631615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dc38456-adb0-4f60-bd20-00ed6cd59b44 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:25.632332 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dc38456-adb0-4f60-bd20-00ed6cd59b44 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:25.632777 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dc38456-adb0-4f60-bd20-00ed6cd59b44 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:25.633192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7dc38456-adb0-4f60-bd20-00ed6cd59b44 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:25.769049 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7dc38456-adb0-4f60-bd20-00ed6cd59b44 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:25.776797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7dc38456-adb0-4f60-bd20-00ed6cd59b44 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 200 len: 1366 microversion: 2.1 time: 0.157448 Sep 05 17:24:25.777371 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 893/1941] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:24:25 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:24:26.615392 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6cd01e77-c23f-447c-a92d-49bb7acf3b3e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:26.616006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6cd01e77-c23f-447c-a92d-49bb7acf3b3e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:26.622532 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6cd01e77-c23f-447c-a92d-49bb7acf3b3e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:26.623000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6cd01e77-c23f-447c-a92d-49bb7acf3b3e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:26.623418 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6cd01e77-c23f-447c-a92d-49bb7acf3b3e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:26.624108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6cd01e77-c23f-447c-a92d-49bb7acf3b3e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:26.624617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6cd01e77-c23f-447c-a92d-49bb7acf3b3e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:26.625042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6cd01e77-c23f-447c-a92d-49bb7acf3b3e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:26.689093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6cd01e77-c23f-447c-a92d-49bb7acf3b3e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:26.698007 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6cd01e77-c23f-447c-a92d-49bb7acf3b3e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:26.699453 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6cd01e77-c23f-447c-a92d-49bb7acf3b3e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:26.700628 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6cd01e77-c23f-447c-a92d-49bb7acf3b3e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.089398 Sep 05 17:24:26.701276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1049/1942] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:26 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:26.799865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7c60e4db-a0f0-4379-a1fa-3e444862ee25 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:26.800501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7c60e4db-a0f0-4379-a1fa-3e444862ee25 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:26.807566 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7c60e4db-a0f0-4379-a1fa-3e444862ee25 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:26.808044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7c60e4db-a0f0-4379-a1fa-3e444862ee25 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:26.808521 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7c60e4db-a0f0-4379-a1fa-3e444862ee25 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:26.809212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7c60e4db-a0f0-4379-a1fa-3e444862ee25 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:26.809665 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7c60e4db-a0f0-4379-a1fa-3e444862ee25 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:26.810084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7c60e4db-a0f0-4379-a1fa-3e444862ee25 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:26.944259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7c60e4db-a0f0-4379-a1fa-3e444862ee25 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:26.952297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7c60e4db-a0f0-4379-a1fa-3e444862ee25 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 200 len: 1366 microversion: 2.1 time: 0.156426 Sep 05 17:24:26.952854 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 894/1943] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:24:26 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:24:27.730479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2b6c3425-94fa-4063-bfac-4afe3a9574c5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:27.731383 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2b6c3425-94fa-4063-bfac-4afe3a9574c5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:27.745249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b6c3425-94fa-4063-bfac-4afe3a9574c5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:27.746046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b6c3425-94fa-4063-bfac-4afe3a9574c5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:27.746767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b6c3425-94fa-4063-bfac-4afe3a9574c5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:27.747906 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b6c3425-94fa-4063-bfac-4afe3a9574c5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:27.748699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b6c3425-94fa-4063-bfac-4afe3a9574c5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:27.749407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b6c3425-94fa-4063-bfac-4afe3a9574c5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:27.823831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2b6c3425-94fa-4063-bfac-4afe3a9574c5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:27.838047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2b6c3425-94fa-4063-bfac-4afe3a9574c5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:27.840339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2b6c3425-94fa-4063-bfac-4afe3a9574c5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:27.842030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2b6c3425-94fa-4063-bfac-4afe3a9574c5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.118094 Sep 05 17:24:27.843231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1050/1944] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:27 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:27.978150 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c0e97b25-b8cf-4005-bd4f-64bc9b93a3c5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:27.978761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c0e97b25-b8cf-4005-bd4f-64bc9b93a3c5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:27.986413 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0e97b25-b8cf-4005-bd4f-64bc9b93a3c5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:27.986832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0e97b25-b8cf-4005-bd4f-64bc9b93a3c5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:27.987264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0e97b25-b8cf-4005-bd4f-64bc9b93a3c5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:27.987956 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0e97b25-b8cf-4005-bd4f-64bc9b93a3c5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:27.988449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0e97b25-b8cf-4005-bd4f-64bc9b93a3c5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:27.988875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0e97b25-b8cf-4005-bd4f-64bc9b93a3c5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:28.137511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c0e97b25-b8cf-4005-bd4f-64bc9b93a3c5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:28.145497 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c0e97b25-b8cf-4005-bd4f-64bc9b93a3c5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 200 len: 1366 microversion: 2.1 time: 0.173316 Sep 05 17:24:28.146079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 895/1945] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:24:27 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:24:28.867209 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5ba8cee2-8737-48ce-b3b6-cd264372a1cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:28.867810 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5ba8cee2-8737-48ce-b3b6-cd264372a1cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:28.874568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ba8cee2-8737-48ce-b3b6-cd264372a1cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:28.875087 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ba8cee2-8737-48ce-b3b6-cd264372a1cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:28.875825 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ba8cee2-8737-48ce-b3b6-cd264372a1cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:28.876185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ba8cee2-8737-48ce-b3b6-cd264372a1cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:28.876673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ba8cee2-8737-48ce-b3b6-cd264372a1cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:28.877088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ba8cee2-8737-48ce-b3b6-cd264372a1cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:28.943120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5ba8cee2-8737-48ce-b3b6-cd264372a1cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:28.952100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5ba8cee2-8737-48ce-b3b6-cd264372a1cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:28.953647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5ba8cee2-8737-48ce-b3b6-cd264372a1cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:28.954783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5ba8cee2-8737-48ce-b3b6-cd264372a1cf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.091610 Sep 05 17:24:28.968211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1051/1946] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:28 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:29.179521 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f2d60dbc-2de4-48b5-a7f2-9885b2c6c6ef tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:29.180493 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f2d60dbc-2de4-48b5-a7f2-9885b2c6c6ef tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:29.183650 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=4 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:24:29.191525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f2d60dbc-2de4-48b5-a7f2-9885b2c6c6ef tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:29.192005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f2d60dbc-2de4-48b5-a7f2-9885b2c6c6ef tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:29.192464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f2d60dbc-2de4-48b5-a7f2-9885b2c6c6ef tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:29.193161 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f2d60dbc-2de4-48b5-a7f2-9885b2c6c6ef tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:29.193708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f2d60dbc-2de4-48b5-a7f2-9885b2c6c6ef tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:29.194162 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f2d60dbc-2de4-48b5-a7f2-9885b2c6c6ef tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:29.331493 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f2d60dbc-2de4-48b5-a7f2-9885b2c6c6ef tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:29.339348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f2d60dbc-2de4-48b5-a7f2-9885b2c6c6ef tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 200 len: 1366 microversion: 2.1 time: 0.167151 Sep 05 17:24:29.340082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 896/1947] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:24:29 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:24:29.984750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1f292f0f-b81a-4520-a365-4cec4f5cf2eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:29.985607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1f292f0f-b81a-4520-a365-4cec4f5cf2eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:29.992406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f292f0f-b81a-4520-a365-4cec4f5cf2eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:29.992890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f292f0f-b81a-4520-a365-4cec4f5cf2eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:29.993324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f292f0f-b81a-4520-a365-4cec4f5cf2eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:29.994022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f292f0f-b81a-4520-a365-4cec4f5cf2eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:29.994473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f292f0f-b81a-4520-a365-4cec4f5cf2eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:29.994891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f292f0f-b81a-4520-a365-4cec4f5cf2eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:30.056728 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1f292f0f-b81a-4520-a365-4cec4f5cf2eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:30.065529 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1f292f0f-b81a-4520-a365-4cec4f5cf2eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:30.066963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1f292f0f-b81a-4520-a365-4cec4f5cf2eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:30.068107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1f292f0f-b81a-4520-a365-4cec4f5cf2eb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.089070 Sep 05 17:24:30.068716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1052/1948] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:29 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:30.364804 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-34f794b5-69e2-4540-aeb7-0b18c5756dad tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:30.365471 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-34f794b5-69e2-4540-aeb7-0b18c5756dad tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:30.373230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34f794b5-69e2-4540-aeb7-0b18c5756dad tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:30.373763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34f794b5-69e2-4540-aeb7-0b18c5756dad tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:30.374232 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34f794b5-69e2-4540-aeb7-0b18c5756dad tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:30.375111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34f794b5-69e2-4540-aeb7-0b18c5756dad tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:30.375833 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34f794b5-69e2-4540-aeb7-0b18c5756dad tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:30.376190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-34f794b5-69e2-4540-aeb7-0b18c5756dad tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:30.511837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-34f794b5-69e2-4540-aeb7-0b18c5756dad tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:30.519970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-34f794b5-69e2-4540-aeb7-0b18c5756dad tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 200 len: 1366 microversion: 2.1 time: 0.159539 Sep 05 17:24:30.520573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 897/1949] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:24:30 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:24:30.942828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:24:31.017027 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-98af8703-0a7c-486f-affb-915cce1db39b req-d9974091-080b-4fd9-a376-bfd619d75a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84a236f-3d97-4011-b0d9-0c42454895c1", "name": "network-vif-plugged", "status": "completed", "tag": "df90783c-9a54-4fd7-a02c-14a305c048f7"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:24:31.026729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-98af8703-0a7c-486f-affb-915cce1db39b req-d9974091-080b-4fd9-a376-bfd619d75a9a service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:31.027201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-98af8703-0a7c-486f-affb-915cce1db39b req-d9974091-080b-4fd9-a376-bfd619d75a9a service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:31.027624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-98af8703-0a7c-486f-affb-915cce1db39b req-d9974091-080b-4fd9-a376-bfd619d75a9a service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:31.038693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-98af8703-0a7c-486f-affb-915cce1db39b req-d9974091-080b-4fd9-a376-bfd619d75a9a service nova] Creating event network-vif-plugged:df90783c-9a54-4fd7-a02c-14a305c048f7 for instance b84a236f-3d97-4011-b0d9-0c42454895c1 on hv-cinder-85596 Sep 05 17:24:31.045114 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-98af8703-0a7c-486f-affb-915cce1db39b req-d9974091-080b-4fd9-a376-bfd619d75a9a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106874 Sep 05 17:24:31.045773 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1053/1950] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:24:31.093496 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-bf923ea3-8c10-4627-8017-8c31fd573ad4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:31.094399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-bf923ea3-8c10-4627-8017-8c31fd573ad4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:31.100731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bf923ea3-8c10-4627-8017-8c31fd573ad4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:31.101208 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bf923ea3-8c10-4627-8017-8c31fd573ad4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:31.101657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bf923ea3-8c10-4627-8017-8c31fd573ad4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:31.102344 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bf923ea3-8c10-4627-8017-8c31fd573ad4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:31.102797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bf923ea3-8c10-4627-8017-8c31fd573ad4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:31.103211 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bf923ea3-8c10-4627-8017-8c31fd573ad4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:31.174621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bf923ea3-8c10-4627-8017-8c31fd573ad4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:31.183542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bf923ea3-8c10-4627-8017-8c31fd573ad4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:31.185006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bf923ea3-8c10-4627-8017-8c31fd573ad4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:31.186139 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-bf923ea3-8c10-4627-8017-8c31fd573ad4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097020 Sep 05 17:24:31.186709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 898/1951] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:31 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:31.542924 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=8 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:24:31.550735 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5cafcbd4-e4fe-4446-b2dd-d37a4acb0c0b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:31.551902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5cafcbd4-e4fe-4446-b2dd-d37a4acb0c0b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:31.562849 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5cafcbd4-e4fe-4446-b2dd-d37a4acb0c0b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:31.563648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5cafcbd4-e4fe-4446-b2dd-d37a4acb0c0b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:31.564977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5cafcbd4-e4fe-4446-b2dd-d37a4acb0c0b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:31.565704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5cafcbd4-e4fe-4446-b2dd-d37a4acb0c0b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:31.566178 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5cafcbd4-e4fe-4446-b2dd-d37a4acb0c0b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:31.566585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5cafcbd4-e4fe-4446-b2dd-d37a4acb0c0b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:31.712511 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5cafcbd4-e4fe-4446-b2dd-d37a4acb0c0b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:31.725530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5cafcbd4-e4fe-4446-b2dd-d37a4acb0c0b tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 200 len: 1366 microversion: 2.1 time: 0.184099 Sep 05 17:24:31.726263 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1054/1952] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:24:31 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:24:32.215571 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-520f802b-9e38-4c69-8d3c-0badc4fc81a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:32.216607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-520f802b-9e38-4c69-8d3c-0badc4fc81a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:32.225962 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-520f802b-9e38-4c69-8d3c-0badc4fc81a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:32.226443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-520f802b-9e38-4c69-8d3c-0badc4fc81a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:32.226875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-520f802b-9e38-4c69-8d3c-0badc4fc81a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:32.227562 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-520f802b-9e38-4c69-8d3c-0badc4fc81a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:32.228008 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-520f802b-9e38-4c69-8d3c-0badc4fc81a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:32.228463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-520f802b-9e38-4c69-8d3c-0badc4fc81a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:32.293236 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-520f802b-9e38-4c69-8d3c-0badc4fc81a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:32.302995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-520f802b-9e38-4c69-8d3c-0badc4fc81a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:32.304467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-520f802b-9e38-4c69-8d3c-0badc4fc81a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:32.305614 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-520f802b-9e38-4c69-8d3c-0badc4fc81a2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.096502 Sep 05 17:24:32.306179 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 899/1953] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:32 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:32.751200 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8bab398a-0db8-4698-90e5-a2bf3b5069b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:32.751816 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8bab398a-0db8-4698-90e5-a2bf3b5069b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:32.760467 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8bab398a-0db8-4698-90e5-a2bf3b5069b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:32.761073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8bab398a-0db8-4698-90e5-a2bf3b5069b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:32.761575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8bab398a-0db8-4698-90e5-a2bf3b5069b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:32.762342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8bab398a-0db8-4698-90e5-a2bf3b5069b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:32.762868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8bab398a-0db8-4698-90e5-a2bf3b5069b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:32.763358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8bab398a-0db8-4698-90e5-a2bf3b5069b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:32.901978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8bab398a-0db8-4698-90e5-a2bf3b5069b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:32.912932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8bab398a-0db8-4698-90e5-a2bf3b5069b3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 200 len: 1556 microversion: 2.1 time: 0.165805 Sep 05 17:24:32.913537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1055/1954] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:24:32 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:24:32.935539 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1a48d312-322a-44c1-b5d1-a2e18d32372c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:32.936033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1a48d312-322a-44c1-b5d1-a2e18d32372c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:32.942704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a48d312-322a-44c1-b5d1-a2e18d32372c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:32.943187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a48d312-322a-44c1-b5d1-a2e18d32372c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:32.943614 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a48d312-322a-44c1-b5d1-a2e18d32372c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:32.944444 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a48d312-322a-44c1-b5d1-a2e18d32372c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:32.944893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a48d312-322a-44c1-b5d1-a2e18d32372c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:32.945311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a48d312-322a-44c1-b5d1-a2e18d32372c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:33.039489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1a48d312-322a-44c1-b5d1-a2e18d32372c tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107455 Sep 05 17:24:33.040314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 900/1955] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Sep 5 17:24:32 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:24:33.331124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-82c1d466-3865-407d-ab07-cf6be56597cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:33.331968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-82c1d466-3865-407d-ab07-cf6be56597cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:33.338416 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82c1d466-3865-407d-ab07-cf6be56597cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:33.338891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82c1d466-3865-407d-ab07-cf6be56597cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:33.339316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82c1d466-3865-407d-ab07-cf6be56597cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:33.339980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82c1d466-3865-407d-ab07-cf6be56597cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:33.340483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82c1d466-3865-407d-ab07-cf6be56597cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:33.340900 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82c1d466-3865-407d-ab07-cf6be56597cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:33.425406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-82c1d466-3865-407d-ab07-cf6be56597cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:33.434426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-82c1d466-3865-407d-ab07-cf6be56597cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:33.435873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-82c1d466-3865-407d-ab07-cf6be56597cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:33.437056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-82c1d466-3865-407d-ab07-cf6be56597cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.109915 Sep 05 17:24:33.437916 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1056/1956] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:33 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:34.115359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-ced66bf6-0048-4729-8efe-2d5f21d37099 req-f0bd0030-a4be-47c4-9cc4-1296d5c3408c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b84a236f-3d97-4011-b0d9-0c42454895c1", "tag": "df90783c-9a54-4fd7-a02c-14a305c048f7"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:24:34.125092 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-ced66bf6-0048-4729-8efe-2d5f21d37099 req-f0bd0030-a4be-47c4-9cc4-1296d5c3408c service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:34.125574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-ced66bf6-0048-4729-8efe-2d5f21d37099 req-f0bd0030-a4be-47c4-9cc4-1296d5c3408c service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:34.125992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-ced66bf6-0048-4729-8efe-2d5f21d37099 req-f0bd0030-a4be-47c4-9cc4-1296d5c3408c service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:34.137263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-ced66bf6-0048-4729-8efe-2d5f21d37099 req-f0bd0030-a4be-47c4-9cc4-1296d5c3408c service nova] Creating event network-changed:df90783c-9a54-4fd7-a02c-14a305c048f7 for instance b84a236f-3d97-4011-b0d9-0c42454895c1 on hv-cinder-85596 Sep 05 17:24:34.142808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-ced66bf6-0048-4729-8efe-2d5f21d37099 req-f0bd0030-a4be-47c4-9cc4-1296d5c3408c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087110 Sep 05 17:24:34.143695 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 901/1957] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:24:34.463812 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-48b9faf7-1ac9-45ac-8f69-37635b062572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:34.464565 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-48b9faf7-1ac9-45ac-8f69-37635b062572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:34.471591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48b9faf7-1ac9-45ac-8f69-37635b062572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:34.472552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48b9faf7-1ac9-45ac-8f69-37635b062572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:34.473177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48b9faf7-1ac9-45ac-8f69-37635b062572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:34.474037 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48b9faf7-1ac9-45ac-8f69-37635b062572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:34.474679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48b9faf7-1ac9-45ac-8f69-37635b062572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:34.475098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48b9faf7-1ac9-45ac-8f69-37635b062572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:34.539637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-48b9faf7-1ac9-45ac-8f69-37635b062572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:34.549112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-48b9faf7-1ac9-45ac-8f69-37635b062572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:34.550603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-48b9faf7-1ac9-45ac-8f69-37635b062572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:34.551848 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-48b9faf7-1ac9-45ac-8f69-37635b062572 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.092558 Sep 05 17:24:34.552487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1057/1958] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:34 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:35.583321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f1fadee1-3aa4-4e0d-8de0-9f5d1d38fb63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:35.583956 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f1fadee1-3aa4-4e0d-8de0-9f5d1d38fb63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:35.590826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1fadee1-3aa4-4e0d-8de0-9f5d1d38fb63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:35.591278 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1fadee1-3aa4-4e0d-8de0-9f5d1d38fb63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:35.591701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1fadee1-3aa4-4e0d-8de0-9f5d1d38fb63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:35.592770 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1fadee1-3aa4-4e0d-8de0-9f5d1d38fb63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:35.593248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1fadee1-3aa4-4e0d-8de0-9f5d1d38fb63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:35.593658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1fadee1-3aa4-4e0d-8de0-9f5d1d38fb63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:35.661773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f1fadee1-3aa4-4e0d-8de0-9f5d1d38fb63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:35.670507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f1fadee1-3aa4-4e0d-8de0-9f5d1d38fb63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:35.671957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f1fadee1-3aa4-4e0d-8de0-9f5d1d38fb63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:35.673123 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f1fadee1-3aa4-4e0d-8de0-9f5d1d38fb63 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097903 Sep 05 17:24:35.673990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 902/1959] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:35 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:36.699227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bab5549d-2f85-4836-9809-5d58dff0d981 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:36.699817 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bab5549d-2f85-4836-9809-5d58dff0d981 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:36.706523 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bab5549d-2f85-4836-9809-5d58dff0d981 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:36.707003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bab5549d-2f85-4836-9809-5d58dff0d981 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:36.707429 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bab5549d-2f85-4836-9809-5d58dff0d981 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:36.708474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bab5549d-2f85-4836-9809-5d58dff0d981 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:36.708626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bab5549d-2f85-4836-9809-5d58dff0d981 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:36.708997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bab5549d-2f85-4836-9809-5d58dff0d981 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:36.772675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bab5549d-2f85-4836-9809-5d58dff0d981 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:36.781366 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bab5549d-2f85-4836-9809-5d58dff0d981 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:36.782791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bab5549d-2f85-4836-9809-5d58dff0d981 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:36.783930 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bab5549d-2f85-4836-9809-5d58dff0d981 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.088931 Sep 05 17:24:36.784527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1058/1960] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:36 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:37.820766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d664f216-1dbb-4ebb-960c-5d4360f746a8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:37.821418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d664f216-1dbb-4ebb-960c-5d4360f746a8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:37.830832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d664f216-1dbb-4ebb-960c-5d4360f746a8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:37.831356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d664f216-1dbb-4ebb-960c-5d4360f746a8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:37.831782 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d664f216-1dbb-4ebb-960c-5d4360f746a8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:37.832505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d664f216-1dbb-4ebb-960c-5d4360f746a8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:37.832951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d664f216-1dbb-4ebb-960c-5d4360f746a8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:37.833364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d664f216-1dbb-4ebb-960c-5d4360f746a8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:37.908433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d664f216-1dbb-4ebb-960c-5d4360f746a8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:37.918800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d664f216-1dbb-4ebb-960c-5d4360f746a8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:37.920272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d664f216-1dbb-4ebb-960c-5d4360f746a8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:37.921371 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d664f216-1dbb-4ebb-960c-5d4360f746a8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.106311 Sep 05 17:24:37.921927 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 903/1961] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:37 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:38.951637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a396fdc0-0207-43f8-9256-3eff56b85001 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:38.952687 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a396fdc0-0207-43f8-9256-3eff56b85001 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:38.964400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a396fdc0-0207-43f8-9256-3eff56b85001 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:38.965220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a396fdc0-0207-43f8-9256-3eff56b85001 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:38.965937 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a396fdc0-0207-43f8-9256-3eff56b85001 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:38.967140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a396fdc0-0207-43f8-9256-3eff56b85001 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:38.968304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a396fdc0-0207-43f8-9256-3eff56b85001 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:38.968981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a396fdc0-0207-43f8-9256-3eff56b85001 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:39.035476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a396fdc0-0207-43f8-9256-3eff56b85001 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:39.045169 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a396fdc0-0207-43f8-9256-3eff56b85001 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:39.046601 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a396fdc0-0207-43f8-9256-3eff56b85001 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:39.047746 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a396fdc0-0207-43f8-9256-3eff56b85001 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102744 Sep 05 17:24:39.048339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1059/1962] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:38 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:40.074394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a8c8a786-76d2-4aab-8d93-8e7c35ea14d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:40.075052 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a8c8a786-76d2-4aab-8d93-8e7c35ea14d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:40.082088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8c8a786-76d2-4aab-8d93-8e7c35ea14d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:40.082561 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8c8a786-76d2-4aab-8d93-8e7c35ea14d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:40.082961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8c8a786-76d2-4aab-8d93-8e7c35ea14d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:40.083662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8c8a786-76d2-4aab-8d93-8e7c35ea14d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:40.084104 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8c8a786-76d2-4aab-8d93-8e7c35ea14d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:40.084547 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8c8a786-76d2-4aab-8d93-8e7c35ea14d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:40.152892 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a8c8a786-76d2-4aab-8d93-8e7c35ea14d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:40.165002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a8c8a786-76d2-4aab-8d93-8e7c35ea14d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:40.166446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a8c8a786-76d2-4aab-8d93-8e7c35ea14d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:40.167601 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a8c8a786-76d2-4aab-8d93-8e7c35ea14d0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097371 Sep 05 17:24:40.168195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 904/1963] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:40 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:41.193599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2f410521-4ab4-4815-a088-a399fe0bb757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:41.194297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2f410521-4ab4-4815-a088-a399fe0bb757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:41.201602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f410521-4ab4-4815-a088-a399fe0bb757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:41.202060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f410521-4ab4-4815-a088-a399fe0bb757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:41.202516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f410521-4ab4-4815-a088-a399fe0bb757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:41.203218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f410521-4ab4-4815-a088-a399fe0bb757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:41.203665 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f410521-4ab4-4815-a088-a399fe0bb757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:41.204081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f410521-4ab4-4815-a088-a399fe0bb757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:41.268971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2f410521-4ab4-4815-a088-a399fe0bb757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:41.278279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2f410521-4ab4-4815-a088-a399fe0bb757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:41.279709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2f410521-4ab4-4815-a088-a399fe0bb757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:41.280876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2f410521-4ab4-4815-a088-a399fe0bb757 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.091676 Sep 05 17:24:41.281433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1060/1964] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:41 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:42.310938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4c9b9268-ed4c-4af9-af6c-71375f1c5e0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:42.311677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4c9b9268-ed4c-4af9-af6c-71375f1c5e0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:42.322903 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c9b9268-ed4c-4af9-af6c-71375f1c5e0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:42.323611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c9b9268-ed4c-4af9-af6c-71375f1c5e0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:42.324356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c9b9268-ed4c-4af9-af6c-71375f1c5e0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:42.325392 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c9b9268-ed4c-4af9-af6c-71375f1c5e0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:42.326079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c9b9268-ed4c-4af9-af6c-71375f1c5e0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:42.326717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c9b9268-ed4c-4af9-af6c-71375f1c5e0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:42.393939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4c9b9268-ed4c-4af9-af6c-71375f1c5e0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:42.404695 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4c9b9268-ed4c-4af9-af6c-71375f1c5e0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:42.406154 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4c9b9268-ed4c-4af9-af6c-71375f1c5e0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:42.407332 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4c9b9268-ed4c-4af9-af6c-71375f1c5e0e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102986 Sep 05 17:24:42.407887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 905/1965] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:42 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:43.438091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5f23fc78-261c-4c3d-8ef4-1f8cfa18bb80 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:43.439097 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5f23fc78-261c-4c3d-8ef4-1f8cfa18bb80 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:43.449011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f23fc78-261c-4c3d-8ef4-1f8cfa18bb80 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:43.449529 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f23fc78-261c-4c3d-8ef4-1f8cfa18bb80 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:43.449962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f23fc78-261c-4c3d-8ef4-1f8cfa18bb80 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:43.450648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f23fc78-261c-4c3d-8ef4-1f8cfa18bb80 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:43.451097 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f23fc78-261c-4c3d-8ef4-1f8cfa18bb80 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:43.451501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f23fc78-261c-4c3d-8ef4-1f8cfa18bb80 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:43.517088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f23fc78-261c-4c3d-8ef4-1f8cfa18bb80 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:43.526511 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f23fc78-261c-4c3d-8ef4-1f8cfa18bb80 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:43.527910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f23fc78-261c-4c3d-8ef4-1f8cfa18bb80 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:43.529068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5f23fc78-261c-4c3d-8ef4-1f8cfa18bb80 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097671 Sep 05 17:24:43.529632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1061/1966] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:43 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:44.556309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-bd45a7de-cd3f-48cf-b829-fe41882f7ec8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:44.556906 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-bd45a7de-cd3f-48cf-b829-fe41882f7ec8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:44.563490 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bd45a7de-cd3f-48cf-b829-fe41882f7ec8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:44.563972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bd45a7de-cd3f-48cf-b829-fe41882f7ec8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:44.564431 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bd45a7de-cd3f-48cf-b829-fe41882f7ec8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:44.565115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bd45a7de-cd3f-48cf-b829-fe41882f7ec8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:44.565567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bd45a7de-cd3f-48cf-b829-fe41882f7ec8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:44.565988 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bd45a7de-cd3f-48cf-b829-fe41882f7ec8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:44.582956 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:24:44.634801 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bd45a7de-cd3f-48cf-b829-fe41882f7ec8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:44.643423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bd45a7de-cd3f-48cf-b829-fe41882f7ec8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:44.644882 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bd45a7de-cd3f-48cf-b829-fe41882f7ec8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:44.646028 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-bd45a7de-cd3f-48cf-b829-fe41882f7ec8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.094895 Sep 05 17:24:44.646562 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 906/1967] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:44 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:45.675957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4173eec3-2f8b-4d14-a23c-7918b11209f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:45.677618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4173eec3-2f8b-4d14-a23c-7918b11209f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:45.689918 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4173eec3-2f8b-4d14-a23c-7918b11209f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:45.690731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4173eec3-2f8b-4d14-a23c-7918b11209f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:45.691452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4173eec3-2f8b-4d14-a23c-7918b11209f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:45.692665 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4173eec3-2f8b-4d14-a23c-7918b11209f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:45.693536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4173eec3-2f8b-4d14-a23c-7918b11209f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:45.694250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4173eec3-2f8b-4d14-a23c-7918b11209f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:45.709570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:24:45.764862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4173eec3-2f8b-4d14-a23c-7918b11209f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:45.776346 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4173eec3-2f8b-4d14-a23c-7918b11209f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:45.777797 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4173eec3-2f8b-4d14-a23c-7918b11209f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:45.778943 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4173eec3-2f8b-4d14-a23c-7918b11209f8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.110196 Sep 05 17:24:45.779503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1062/1968] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:45 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:46.806790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f3529b22-d039-43c6-b132-7549d22f7a48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:46.807473 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f3529b22-d039-43c6-b132-7549d22f7a48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:46.815216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3529b22-d039-43c6-b132-7549d22f7a48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:46.815774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3529b22-d039-43c6-b132-7549d22f7a48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:46.816304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3529b22-d039-43c6-b132-7549d22f7a48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:46.817105 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3529b22-d039-43c6-b132-7549d22f7a48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:46.817625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3529b22-d039-43c6-b132-7549d22f7a48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:46.818110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3529b22-d039-43c6-b132-7549d22f7a48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:46.884675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f3529b22-d039-43c6-b132-7549d22f7a48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:46.894106 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f3529b22-d039-43c6-b132-7549d22f7a48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:46.895544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f3529b22-d039-43c6-b132-7549d22f7a48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:46.896736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f3529b22-d039-43c6-b132-7549d22f7a48 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.096239 Sep 05 17:24:46.897295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 907/1969] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:46 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:47.926895 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aada8bed-bd6a-4274-b78b-a9310db68184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:47.927887 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aada8bed-bd6a-4274-b78b-a9310db68184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:47.939288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aada8bed-bd6a-4274-b78b-a9310db68184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:47.940084 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aada8bed-bd6a-4274-b78b-a9310db68184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:47.940860 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aada8bed-bd6a-4274-b78b-a9310db68184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:47.941999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aada8bed-bd6a-4274-b78b-a9310db68184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:47.942759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aada8bed-bd6a-4274-b78b-a9310db68184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:47.943463 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aada8bed-bd6a-4274-b78b-a9310db68184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:48.008709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aada8bed-bd6a-4274-b78b-a9310db68184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:48.022764 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aada8bed-bd6a-4274-b78b-a9310db68184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:48.024853 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aada8bed-bd6a-4274-b78b-a9310db68184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:48.026006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aada8bed-bd6a-4274-b78b-a9310db68184 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.105958 Sep 05 17:24:48.026610 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1063/1970] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:47 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:49.051910 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-df476513-9737-4f20-beaa-86b3149433c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:49.052533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-df476513-9737-4f20-beaa-86b3149433c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:49.059551 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df476513-9737-4f20-beaa-86b3149433c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:49.060009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df476513-9737-4f20-beaa-86b3149433c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:49.060464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df476513-9737-4f20-beaa-86b3149433c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:49.061164 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df476513-9737-4f20-beaa-86b3149433c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:49.061611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df476513-9737-4f20-beaa-86b3149433c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:49.062021 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df476513-9737-4f20-beaa-86b3149433c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:49.126370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-df476513-9737-4f20-beaa-86b3149433c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:49.135594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-df476513-9737-4f20-beaa-86b3149433c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:49.137060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-df476513-9737-4f20-beaa-86b3149433c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:49.138204 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-df476513-9737-4f20-beaa-86b3149433c2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.090837 Sep 05 17:24:49.138801 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 908/1971] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:49 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:50.166960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8b83c87d-2d50-4f5f-b009-836b040ba813 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:50.167691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8b83c87d-2d50-4f5f-b009-836b040ba813 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:50.174566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b83c87d-2d50-4f5f-b009-836b040ba813 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:50.175038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b83c87d-2d50-4f5f-b009-836b040ba813 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:50.175464 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b83c87d-2d50-4f5f-b009-836b040ba813 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:50.176155 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b83c87d-2d50-4f5f-b009-836b040ba813 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:50.176612 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b83c87d-2d50-4f5f-b009-836b040ba813 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:50.177024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b83c87d-2d50-4f5f-b009-836b040ba813 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:50.246044 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8b83c87d-2d50-4f5f-b009-836b040ba813 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:50.259869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8b83c87d-2d50-4f5f-b009-836b040ba813 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:50.262261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8b83c87d-2d50-4f5f-b009-836b040ba813 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:50.264016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8b83c87d-2d50-4f5f-b009-836b040ba813 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102993 Sep 05 17:24:50.264939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1064/1972] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:50 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:51.289707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6e7b2807-1965-4fe1-8e3a-23ebbb9bfef8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:51.290293 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6e7b2807-1965-4fe1-8e3a-23ebbb9bfef8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:51.297359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6e7b2807-1965-4fe1-8e3a-23ebbb9bfef8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:51.297840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6e7b2807-1965-4fe1-8e3a-23ebbb9bfef8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:51.298268 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6e7b2807-1965-4fe1-8e3a-23ebbb9bfef8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:51.298973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6e7b2807-1965-4fe1-8e3a-23ebbb9bfef8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:51.299536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6e7b2807-1965-4fe1-8e3a-23ebbb9bfef8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:51.299961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6e7b2807-1965-4fe1-8e3a-23ebbb9bfef8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:51.362558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6e7b2807-1965-4fe1-8e3a-23ebbb9bfef8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:51.372118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6e7b2807-1965-4fe1-8e3a-23ebbb9bfef8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:51.373596 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6e7b2807-1965-4fe1-8e3a-23ebbb9bfef8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:51.374776 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6e7b2807-1965-4fe1-8e3a-23ebbb9bfef8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.089255 Sep 05 17:24:51.375553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 909/1973] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:51 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:52.399855 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7920db94-6985-490f-9523-2c93fd43fc5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:52.400479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7920db94-6985-490f-9523-2c93fd43fc5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:52.402875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=40 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:24:52.409569 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7920db94-6985-490f-9523-2c93fd43fc5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:52.410039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7920db94-6985-490f-9523-2c93fd43fc5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:52.410471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7920db94-6985-490f-9523-2c93fd43fc5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:52.411165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7920db94-6985-490f-9523-2c93fd43fc5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:52.411609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7920db94-6985-490f-9523-2c93fd43fc5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:52.412022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7920db94-6985-490f-9523-2c93fd43fc5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:52.475620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7920db94-6985-490f-9523-2c93fd43fc5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:52.484957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7920db94-6985-490f-9523-2c93fd43fc5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:52.486379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7920db94-6985-490f-9523-2c93fd43fc5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:52.487540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7920db94-6985-490f-9523-2c93fd43fc5c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.091705 Sep 05 17:24:52.488098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1065/1974] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:52 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:53.514789 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c56dc122-0405-4f94-895a-3488808dd392 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:53.515723 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c56dc122-0405-4f94-895a-3488808dd392 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:53.518492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=40 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:24:53.524910 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c56dc122-0405-4f94-895a-3488808dd392 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:53.525387 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c56dc122-0405-4f94-895a-3488808dd392 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:53.525815 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c56dc122-0405-4f94-895a-3488808dd392 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:53.526510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c56dc122-0405-4f94-895a-3488808dd392 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:53.526960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c56dc122-0405-4f94-895a-3488808dd392 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:53.527378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c56dc122-0405-4f94-895a-3488808dd392 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:53.602882 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c56dc122-0405-4f94-895a-3488808dd392 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:53.612317 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c56dc122-0405-4f94-895a-3488808dd392 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:53.613751 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c56dc122-0405-4f94-895a-3488808dd392 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:53.614883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c56dc122-0405-4f94-895a-3488808dd392 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.105748 Sep 05 17:24:53.615446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 910/1975] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:53 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:54.644652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2b3d85ef-21ef-426a-a405-2293727c2673 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:54.645657 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2b3d85ef-21ef-426a-a405-2293727c2673 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:54.656921 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b3d85ef-21ef-426a-a405-2293727c2673 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:54.657721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b3d85ef-21ef-426a-a405-2293727c2673 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:54.658448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b3d85ef-21ef-426a-a405-2293727c2673 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:54.659592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b3d85ef-21ef-426a-a405-2293727c2673 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:54.660405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b3d85ef-21ef-426a-a405-2293727c2673 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:54.661115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b3d85ef-21ef-426a-a405-2293727c2673 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:54.726246 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2b3d85ef-21ef-426a-a405-2293727c2673 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:54.736175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2b3d85ef-21ef-426a-a405-2293727c2673 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:54.737543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2b3d85ef-21ef-426a-a405-2293727c2673 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:54.738700 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2b3d85ef-21ef-426a-a405-2293727c2673 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100717 Sep 05 17:24:54.739270 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1066/1976] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:54 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:55.769777 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8070f446-e6f4-46e0-85dd-09eee0f4ebe7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:55.770704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8070f446-e6f4-46e0-85dd-09eee0f4ebe7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:55.779409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8070f446-e6f4-46e0-85dd-09eee0f4ebe7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:55.779915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8070f446-e6f4-46e0-85dd-09eee0f4ebe7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:55.780429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8070f446-e6f4-46e0-85dd-09eee0f4ebe7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:55.781186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8070f446-e6f4-46e0-85dd-09eee0f4ebe7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:55.781679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8070f446-e6f4-46e0-85dd-09eee0f4ebe7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:55.782138 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8070f446-e6f4-46e0-85dd-09eee0f4ebe7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:55.851404 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8070f446-e6f4-46e0-85dd-09eee0f4ebe7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:55.861919 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8070f446-e6f4-46e0-85dd-09eee0f4ebe7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:55.863345 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8070f446-e6f4-46e0-85dd-09eee0f4ebe7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:55.864511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8070f446-e6f4-46e0-85dd-09eee0f4ebe7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101618 Sep 05 17:24:55.865065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 911/1977] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:55 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:56.889323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-20a70e2f-1404-4a81-bebc-084dedfb9177 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:56.889956 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-20a70e2f-1404-4a81-bebc-084dedfb9177 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:56.897016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20a70e2f-1404-4a81-bebc-084dedfb9177 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:56.897499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20a70e2f-1404-4a81-bebc-084dedfb9177 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:56.897930 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20a70e2f-1404-4a81-bebc-084dedfb9177 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:56.898743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20a70e2f-1404-4a81-bebc-084dedfb9177 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:56.899668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20a70e2f-1404-4a81-bebc-084dedfb9177 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:56.900093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20a70e2f-1404-4a81-bebc-084dedfb9177 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:56.966454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-20a70e2f-1404-4a81-bebc-084dedfb9177 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:56.975643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-20a70e2f-1404-4a81-bebc-084dedfb9177 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:56.977895 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-20a70e2f-1404-4a81-bebc-084dedfb9177 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:56.979038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-20a70e2f-1404-4a81-bebc-084dedfb9177 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.093958 Sep 05 17:24:56.979597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1067/1978] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:56 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:58.008535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7ed0ffa6-b93d-4a7f-b8ed-1cdcc3c65ad8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:58.009609 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7ed0ffa6-b93d-4a7f-b8ed-1cdcc3c65ad8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:58.020606 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ed0ffa6-b93d-4a7f-b8ed-1cdcc3c65ad8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:58.021406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ed0ffa6-b93d-4a7f-b8ed-1cdcc3c65ad8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:58.022113 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ed0ffa6-b93d-4a7f-b8ed-1cdcc3c65ad8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:58.023243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ed0ffa6-b93d-4a7f-b8ed-1cdcc3c65ad8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:58.024092 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ed0ffa6-b93d-4a7f-b8ed-1cdcc3c65ad8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:58.025051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ed0ffa6-b93d-4a7f-b8ed-1cdcc3c65ad8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:58.101622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7ed0ffa6-b93d-4a7f-b8ed-1cdcc3c65ad8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:58.111254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7ed0ffa6-b93d-4a7f-b8ed-1cdcc3c65ad8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:58.112713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7ed0ffa6-b93d-4a7f-b8ed-1cdcc3c65ad8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:58.113850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7ed0ffa6-b93d-4a7f-b8ed-1cdcc3c65ad8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.112163 Sep 05 17:24:58.114388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 912/1979] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:58 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:24:59.143608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4413d3c3-d1f0-4340-8079-936d46a66bcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:24:59.144251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4413d3c3-d1f0-4340-8079-936d46a66bcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:24:59.151014 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4413d3c3-d1f0-4340-8079-936d46a66bcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:59.151499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4413d3c3-d1f0-4340-8079-936d46a66bcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:59.151932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4413d3c3-d1f0-4340-8079-936d46a66bcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:59.152651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4413d3c3-d1f0-4340-8079-936d46a66bcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:24:59.153100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4413d3c3-d1f0-4340-8079-936d46a66bcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:24:59.153537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4413d3c3-d1f0-4340-8079-936d46a66bcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:24:59.217961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4413d3c3-d1f0-4340-8079-936d46a66bcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:59.228111 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4413d3c3-d1f0-4340-8079-936d46a66bcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:59.229670 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4413d3c3-d1f0-4340-8079-936d46a66bcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:24:59.230759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4413d3c3-d1f0-4340-8079-936d46a66bcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.091556 Sep 05 17:24:59.231356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1068/1980] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:24:59 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:00.260294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f4a93b6e-ac9b-4a9b-aaf2-ccb78df19ad9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:00.261262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f4a93b6e-ac9b-4a9b-aaf2-ccb78df19ad9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:00.272189 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f4a93b6e-ac9b-4a9b-aaf2-ccb78df19ad9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:00.272999 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f4a93b6e-ac9b-4a9b-aaf2-ccb78df19ad9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:00.273716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f4a93b6e-ac9b-4a9b-aaf2-ccb78df19ad9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:00.274639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f4a93b6e-ac9b-4a9b-aaf2-ccb78df19ad9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:00.275093 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f4a93b6e-ac9b-4a9b-aaf2-ccb78df19ad9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:00.275511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f4a93b6e-ac9b-4a9b-aaf2-ccb78df19ad9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:00.338728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f4a93b6e-ac9b-4a9b-aaf2-ccb78df19ad9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:00.347921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f4a93b6e-ac9b-4a9b-aaf2-ccb78df19ad9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:00.349395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f4a93b6e-ac9b-4a9b-aaf2-ccb78df19ad9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:00.350543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f4a93b6e-ac9b-4a9b-aaf2-ccb78df19ad9 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097010 Sep 05 17:25:00.351106 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 913/1981] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:00 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:01.379710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-745b9d95-e784-4c77-95e4-a97e9d3a9923 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:01.380625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-745b9d95-e784-4c77-95e4-a97e9d3a9923 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:01.388920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-745b9d95-e784-4c77-95e4-a97e9d3a9923 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:01.389405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-745b9d95-e784-4c77-95e4-a97e9d3a9923 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:01.389864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-745b9d95-e784-4c77-95e4-a97e9d3a9923 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:01.390558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-745b9d95-e784-4c77-95e4-a97e9d3a9923 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:01.391010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-745b9d95-e784-4c77-95e4-a97e9d3a9923 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:01.391428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-745b9d95-e784-4c77-95e4-a97e9d3a9923 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:01.462539 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-745b9d95-e784-4c77-95e4-a97e9d3a9923 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:01.471843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-745b9d95-e784-4c77-95e4-a97e9d3a9923 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:01.473314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-745b9d95-e784-4c77-95e4-a97e9d3a9923 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:01.474489 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-745b9d95-e784-4c77-95e4-a97e9d3a9923 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101801 Sep 05 17:25:01.475047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1069/1982] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:01 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:02.500177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-393f7190-551b-45bd-afc0-d6e784de3b53 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:02.500773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-393f7190-551b-45bd-afc0-d6e784de3b53 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:02.507639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-393f7190-551b-45bd-afc0-d6e784de3b53 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:02.508115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-393f7190-551b-45bd-afc0-d6e784de3b53 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:02.508768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-393f7190-551b-45bd-afc0-d6e784de3b53 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:02.509632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-393f7190-551b-45bd-afc0-d6e784de3b53 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:02.510076 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-393f7190-551b-45bd-afc0-d6e784de3b53 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:02.510493 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-393f7190-551b-45bd-afc0-d6e784de3b53 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:02.577138 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-393f7190-551b-45bd-afc0-d6e784de3b53 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:02.588529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-393f7190-551b-45bd-afc0-d6e784de3b53 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:02.589986 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-393f7190-551b-45bd-afc0-d6e784de3b53 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:02.591134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-393f7190-551b-45bd-afc0-d6e784de3b53 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.095093 Sep 05 17:25:02.591725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 914/1983] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:02 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:03.621199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bbdc52f4-fe43-48e2-b8db-1a780093c7b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:03.622149 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bbdc52f4-fe43-48e2-b8db-1a780093c7b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:03.633160 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbdc52f4-fe43-48e2-b8db-1a780093c7b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:03.634150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbdc52f4-fe43-48e2-b8db-1a780093c7b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:03.634649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbdc52f4-fe43-48e2-b8db-1a780093c7b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:03.635398 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbdc52f4-fe43-48e2-b8db-1a780093c7b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:03.635775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbdc52f4-fe43-48e2-b8db-1a780093c7b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:03.636188 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbdc52f4-fe43-48e2-b8db-1a780093c7b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:03.699730 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bbdc52f4-fe43-48e2-b8db-1a780093c7b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:03.708439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bbdc52f4-fe43-48e2-b8db-1a780093c7b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:03.709870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bbdc52f4-fe43-48e2-b8db-1a780093c7b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:03.710992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bbdc52f4-fe43-48e2-b8db-1a780093c7b0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.096679 Sep 05 17:25:03.711677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1070/1984] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:03 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:04.740899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ab2c6d05-fef7-454c-8ace-6a1184eace0a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:04.741772 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ab2c6d05-fef7-454c-8ace-6a1184eace0a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:04.749687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ab2c6d05-fef7-454c-8ace-6a1184eace0a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:04.750167 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ab2c6d05-fef7-454c-8ace-6a1184eace0a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:04.750591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ab2c6d05-fef7-454c-8ace-6a1184eace0a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:04.751280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ab2c6d05-fef7-454c-8ace-6a1184eace0a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:04.751728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ab2c6d05-fef7-454c-8ace-6a1184eace0a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:04.752170 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ab2c6d05-fef7-454c-8ace-6a1184eace0a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:04.817300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ab2c6d05-fef7-454c-8ace-6a1184eace0a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:04.826149 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ab2c6d05-fef7-454c-8ace-6a1184eace0a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:04.827574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ab2c6d05-fef7-454c-8ace-6a1184eace0a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:04.828750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ab2c6d05-fef7-454c-8ace-6a1184eace0a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.094737 Sep 05 17:25:04.829288 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 915/1985] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:04 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:05.859483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f0ce4828-18d6-462c-b387-3ba846ed7de2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:05.860529 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f0ce4828-18d6-462c-b387-3ba846ed7de2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:05.871643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0ce4828-18d6-462c-b387-3ba846ed7de2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:05.872509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0ce4828-18d6-462c-b387-3ba846ed7de2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:05.873227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0ce4828-18d6-462c-b387-3ba846ed7de2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:05.874358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0ce4828-18d6-462c-b387-3ba846ed7de2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:05.875104 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0ce4828-18d6-462c-b387-3ba846ed7de2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:05.875815 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0ce4828-18d6-462c-b387-3ba846ed7de2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:05.942665 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f0ce4828-18d6-462c-b387-3ba846ed7de2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:05.956224 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f0ce4828-18d6-462c-b387-3ba846ed7de2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:05.958543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f0ce4828-18d6-462c-b387-3ba846ed7de2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:05.960360 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f0ce4828-18d6-462c-b387-3ba846ed7de2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.107672 Sep 05 17:25:05.961152 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1071/1986] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:05 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:06.991300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9331cb5f-405f-414d-9ef9-85753b1024c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:06.992325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9331cb5f-405f-414d-9ef9-85753b1024c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:07.000781 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9331cb5f-405f-414d-9ef9-85753b1024c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:07.001261 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9331cb5f-405f-414d-9ef9-85753b1024c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:07.001689 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9331cb5f-405f-414d-9ef9-85753b1024c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:07.002375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9331cb5f-405f-414d-9ef9-85753b1024c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:07.002828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9331cb5f-405f-414d-9ef9-85753b1024c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:07.003247 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9331cb5f-405f-414d-9ef9-85753b1024c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:07.070888 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9331cb5f-405f-414d-9ef9-85753b1024c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:07.079661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9331cb5f-405f-414d-9ef9-85753b1024c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:07.081124 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9331cb5f-405f-414d-9ef9-85753b1024c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:07.082268 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9331cb5f-405f-414d-9ef9-85753b1024c4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097542 Sep 05 17:25:07.082803 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 916/1987] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:06 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:08.111288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-357de130-1fb9-4d47-99fb-0405bb85eaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:08.112398 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-357de130-1fb9-4d47-99fb-0405bb85eaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:08.122864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-357de130-1fb9-4d47-99fb-0405bb85eaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:08.123345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-357de130-1fb9-4d47-99fb-0405bb85eaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:08.123774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-357de130-1fb9-4d47-99fb-0405bb85eaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:08.124509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-357de130-1fb9-4d47-99fb-0405bb85eaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:08.124955 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-357de130-1fb9-4d47-99fb-0405bb85eaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:08.125375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-357de130-1fb9-4d47-99fb-0405bb85eaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:08.187276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-357de130-1fb9-4d47-99fb-0405bb85eaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:08.196334 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-357de130-1fb9-4d47-99fb-0405bb85eaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:08.197773 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-357de130-1fb9-4d47-99fb-0405bb85eaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:08.199148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-357de130-1fb9-4d47-99fb-0405bb85eaa7 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.094502 Sep 05 17:25:08.199829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1072/1988] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:08 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:09.228413 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-51c067f9-fafc-4223-9f49-a2ae657309ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:09.229368 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-51c067f9-fafc-4223-9f49-a2ae657309ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:09.237225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51c067f9-fafc-4223-9f49-a2ae657309ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:09.237700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51c067f9-fafc-4223-9f49-a2ae657309ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:09.238125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51c067f9-fafc-4223-9f49-a2ae657309ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:09.238801 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51c067f9-fafc-4223-9f49-a2ae657309ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:09.239246 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51c067f9-fafc-4223-9f49-a2ae657309ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:09.239658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51c067f9-fafc-4223-9f49-a2ae657309ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:09.304649 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-51c067f9-fafc-4223-9f49-a2ae657309ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:09.315588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-51c067f9-fafc-4223-9f49-a2ae657309ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:09.317058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-51c067f9-fafc-4223-9f49-a2ae657309ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:09.318200 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-51c067f9-fafc-4223-9f49-a2ae657309ae tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.096365 Sep 05 17:25:09.318726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 917/1989] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:09 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:10.345664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-57b9e16c-e338-45c5-85cf-4c786cd8145e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:10.346403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-57b9e16c-e338-45c5-85cf-4c786cd8145e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:10.353110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57b9e16c-e338-45c5-85cf-4c786cd8145e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:10.353704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57b9e16c-e338-45c5-85cf-4c786cd8145e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:10.354138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57b9e16c-e338-45c5-85cf-4c786cd8145e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:10.354816 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57b9e16c-e338-45c5-85cf-4c786cd8145e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:10.355293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57b9e16c-e338-45c5-85cf-4c786cd8145e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:10.355711 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57b9e16c-e338-45c5-85cf-4c786cd8145e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:10.423829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-57b9e16c-e338-45c5-85cf-4c786cd8145e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:10.432875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-57b9e16c-e338-45c5-85cf-4c786cd8145e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:10.434340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-57b9e16c-e338-45c5-85cf-4c786cd8145e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:10.435479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-57b9e16c-e338-45c5-85cf-4c786cd8145e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.094917 Sep 05 17:25:10.436019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1073/1990] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:10 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:11.465227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-bc203169-20c8-4ab5-af7f-0c78679b3518 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:11.466168 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-bc203169-20c8-4ab5-af7f-0c78679b3518 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:11.473764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bc203169-20c8-4ab5-af7f-0c78679b3518 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:11.474248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bc203169-20c8-4ab5-af7f-0c78679b3518 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:11.474676 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bc203169-20c8-4ab5-af7f-0c78679b3518 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:11.475363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bc203169-20c8-4ab5-af7f-0c78679b3518 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:11.475811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bc203169-20c8-4ab5-af7f-0c78679b3518 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:11.476259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bc203169-20c8-4ab5-af7f-0c78679b3518 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:11.542706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bc203169-20c8-4ab5-af7f-0c78679b3518 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:11.551546 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bc203169-20c8-4ab5-af7f-0c78679b3518 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:11.553023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bc203169-20c8-4ab5-af7f-0c78679b3518 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:11.554195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-bc203169-20c8-4ab5-af7f-0c78679b3518 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.095775 Sep 05 17:25:11.554766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 918/1991] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:11 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:12.581649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-27521b30-516a-43cb-9755-6478524f9a92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:12.582306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-27521b30-516a-43cb-9755-6478524f9a92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:12.589655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27521b30-516a-43cb-9755-6478524f9a92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:12.590161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27521b30-516a-43cb-9755-6478524f9a92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:12.591385 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27521b30-516a-43cb-9755-6478524f9a92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:12.593002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27521b30-516a-43cb-9755-6478524f9a92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:12.593749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27521b30-516a-43cb-9755-6478524f9a92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:12.594409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27521b30-516a-43cb-9755-6478524f9a92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:12.669700 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-27521b30-516a-43cb-9755-6478524f9a92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:12.689249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-27521b30-516a-43cb-9755-6478524f9a92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:12.690715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-27521b30-516a-43cb-9755-6478524f9a92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:12.691872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-27521b30-516a-43cb-9755-6478524f9a92 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.114883 Sep 05 17:25:12.692483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1074/1992] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:12 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:13.722837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c119aad5-79f3-4927-a92c-132b8a7ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:13.723424 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c119aad5-79f3-4927-a92c-132b8a7ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:13.730085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c119aad5-79f3-4927-a92c-132b8a7ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:13.730609 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c119aad5-79f3-4927-a92c-132b8a7ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:13.731062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c119aad5-79f3-4927-a92c-132b8a7ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:13.731796 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c119aad5-79f3-4927-a92c-132b8a7ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:13.732294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c119aad5-79f3-4927-a92c-132b8a7ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:13.732736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c119aad5-79f3-4927-a92c-132b8a7ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:13.801328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c119aad5-79f3-4927-a92c-132b8a7ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:13.810454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c119aad5-79f3-4927-a92c-132b8a7ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:13.811880 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c119aad5-79f3-4927-a92c-132b8a7ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:13.813142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c119aad5-79f3-4927-a92c-132b8a7ff755 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.094835 Sep 05 17:25:13.813694 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 919/1993] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:13 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:14.842514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-33bfd929-6bfe-428c-95c3-0c1e4d8e3fcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:14.843495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-33bfd929-6bfe-428c-95c3-0c1e4d8e3fcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:14.855440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33bfd929-6bfe-428c-95c3-0c1e4d8e3fcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:14.856254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33bfd929-6bfe-428c-95c3-0c1e4d8e3fcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:14.857011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33bfd929-6bfe-428c-95c3-0c1e4d8e3fcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:14.858147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33bfd929-6bfe-428c-95c3-0c1e4d8e3fcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:14.858894 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33bfd929-6bfe-428c-95c3-0c1e4d8e3fcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:14.860353 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33bfd929-6bfe-428c-95c3-0c1e4d8e3fcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:14.923129 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-33bfd929-6bfe-428c-95c3-0c1e4d8e3fcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:14.931799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-33bfd929-6bfe-428c-95c3-0c1e4d8e3fcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:14.933277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-33bfd929-6bfe-428c-95c3-0c1e4d8e3fcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:14.934415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-33bfd929-6bfe-428c-95c3-0c1e4d8e3fcc tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098918 Sep 05 17:25:14.934978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1075/1994] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:14 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:15.964690 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2098419f-72c3-4cfa-aabe-7f8aca1264bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:15.965679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2098419f-72c3-4cfa-aabe-7f8aca1264bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:15.970931 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:25:15.971221 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:25:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 (ip 10.222.0.23) !!! Sep 05 17:25:15.984213 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2098419f-72c3-4cfa-aabe-7f8aca1264bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:15.985010 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2098419f-72c3-4cfa-aabe-7f8aca1264bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:15.985624 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2098419f-72c3-4cfa-aabe-7f8aca1264bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:15.986321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2098419f-72c3-4cfa-aabe-7f8aca1264bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:15.986847 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2098419f-72c3-4cfa-aabe-7f8aca1264bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:15.987261 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2098419f-72c3-4cfa-aabe-7f8aca1264bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:15.992378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=82 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:25:16.053026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2098419f-72c3-4cfa-aabe-7f8aca1264bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:16.062006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2098419f-72c3-4cfa-aabe-7f8aca1264bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:16.063491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2098419f-72c3-4cfa-aabe-7f8aca1264bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:16.064667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2098419f-72c3-4cfa-aabe-7f8aca1264bd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.107178 Sep 05 17:25:16.065227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 920/1995] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:15 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:17.090560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8437a4f4-7ef7-4676-8aa2-d9ebba2b1186 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:17.091169 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8437a4f4-7ef7-4676-8aa2-d9ebba2b1186 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:17.098502 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8437a4f4-7ef7-4676-8aa2-d9ebba2b1186 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:17.098985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8437a4f4-7ef7-4676-8aa2-d9ebba2b1186 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:17.099418 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8437a4f4-7ef7-4676-8aa2-d9ebba2b1186 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:17.100109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8437a4f4-7ef7-4676-8aa2-d9ebba2b1186 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:17.100592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8437a4f4-7ef7-4676-8aa2-d9ebba2b1186 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:17.101017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8437a4f4-7ef7-4676-8aa2-d9ebba2b1186 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:17.103585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=82 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:25:17.392359 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8437a4f4-7ef7-4676-8aa2-d9ebba2b1186 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:17.401165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8437a4f4-7ef7-4676-8aa2-d9ebba2b1186 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:17.402588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8437a4f4-7ef7-4676-8aa2-d9ebba2b1186 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:17.403720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8437a4f4-7ef7-4676-8aa2-d9ebba2b1186 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.317176 Sep 05 17:25:17.404308 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1076/1996] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:17 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:18.433208 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5fb39844-0313-4cde-9014-01779074f3e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:18.434205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5fb39844-0313-4cde-9014-01779074f3e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:18.445121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fb39844-0313-4cde-9014-01779074f3e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:18.445908 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fb39844-0313-4cde-9014-01779074f3e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:18.446605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fb39844-0313-4cde-9014-01779074f3e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:18.447724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fb39844-0313-4cde-9014-01779074f3e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:18.448520 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fb39844-0313-4cde-9014-01779074f3e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:18.449214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5fb39844-0313-4cde-9014-01779074f3e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:18.514203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5fb39844-0313-4cde-9014-01779074f3e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:18.523058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5fb39844-0313-4cde-9014-01779074f3e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:18.524516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5fb39844-0313-4cde-9014-01779074f3e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:18.525645 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5fb39844-0313-4cde-9014-01779074f3e0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.099186 Sep 05 17:25:18.526199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 921/1997] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:18 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:19.555039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6240b68b-21ed-4c5c-96fd-2812fd1ca79a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:19.555986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6240b68b-21ed-4c5c-96fd-2812fd1ca79a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:19.565950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6240b68b-21ed-4c5c-96fd-2812fd1ca79a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:19.566429 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6240b68b-21ed-4c5c-96fd-2812fd1ca79a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:19.566863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6240b68b-21ed-4c5c-96fd-2812fd1ca79a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:19.567555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6240b68b-21ed-4c5c-96fd-2812fd1ca79a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:19.568007 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6240b68b-21ed-4c5c-96fd-2812fd1ca79a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:19.568461 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6240b68b-21ed-4c5c-96fd-2812fd1ca79a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:19.638997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6240b68b-21ed-4c5c-96fd-2812fd1ca79a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:19.648417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6240b68b-21ed-4c5c-96fd-2812fd1ca79a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:19.649863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6240b68b-21ed-4c5c-96fd-2812fd1ca79a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:19.651011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6240b68b-21ed-4c5c-96fd-2812fd1ca79a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102860 Sep 05 17:25:19.651579 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1077/1998] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:19 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:20.681252 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-552a3c6d-1b1f-41ea-9aca-761a9aff25d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:20.682182 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-552a3c6d-1b1f-41ea-9aca-761a9aff25d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:20.692969 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-552a3c6d-1b1f-41ea-9aca-761a9aff25d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:20.693710 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-552a3c6d-1b1f-41ea-9aca-761a9aff25d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:20.694459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-552a3c6d-1b1f-41ea-9aca-761a9aff25d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:20.695585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-552a3c6d-1b1f-41ea-9aca-761a9aff25d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:20.696330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-552a3c6d-1b1f-41ea-9aca-761a9aff25d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:20.697058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-552a3c6d-1b1f-41ea-9aca-761a9aff25d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:20.762034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-552a3c6d-1b1f-41ea-9aca-761a9aff25d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:20.770923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-552a3c6d-1b1f-41ea-9aca-761a9aff25d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:20.772392 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-552a3c6d-1b1f-41ea-9aca-761a9aff25d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:20.773548 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-552a3c6d-1b1f-41ea-9aca-761a9aff25d4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.099034 Sep 05 17:25:20.774083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 922/1999] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:20 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:21.800078 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-67e8c692-5c0b-4521-9415-a7ed2d626387 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:21.800689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-67e8c692-5c0b-4521-9415-a7ed2d626387 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:21.807553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e8c692-5c0b-4521-9415-a7ed2d626387 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:21.808030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e8c692-5c0b-4521-9415-a7ed2d626387 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:21.808519 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e8c692-5c0b-4521-9415-a7ed2d626387 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:21.809264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e8c692-5c0b-4521-9415-a7ed2d626387 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:21.809705 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e8c692-5c0b-4521-9415-a7ed2d626387 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:21.810123 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e8c692-5c0b-4521-9415-a7ed2d626387 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:21.875958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-67e8c692-5c0b-4521-9415-a7ed2d626387 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:21.885945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-67e8c692-5c0b-4521-9415-a7ed2d626387 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:21.887376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-67e8c692-5c0b-4521-9415-a7ed2d626387 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:21.888532 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-67e8c692-5c0b-4521-9415-a7ed2d626387 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.093766 Sep 05 17:25:21.889091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1078/2000] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:21 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:22.918068 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ef80268a-3bab-4fef-a961-5bdd4e3df907 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:22.919019 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ef80268a-3bab-4fef-a961-5bdd4e3df907 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:22.927830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef80268a-3bab-4fef-a961-5bdd4e3df907 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:22.928333 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef80268a-3bab-4fef-a961-5bdd4e3df907 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:22.928759 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef80268a-3bab-4fef-a961-5bdd4e3df907 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:22.929433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef80268a-3bab-4fef-a961-5bdd4e3df907 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:22.929875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef80268a-3bab-4fef-a961-5bdd4e3df907 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:22.930314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef80268a-3bab-4fef-a961-5bdd4e3df907 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:23.000745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ef80268a-3bab-4fef-a961-5bdd4e3df907 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:23.009924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ef80268a-3bab-4fef-a961-5bdd4e3df907 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:23.011351 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ef80268a-3bab-4fef-a961-5bdd4e3df907 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:23.012518 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ef80268a-3bab-4fef-a961-5bdd4e3df907 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101085 Sep 05 17:25:23.013082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 923/2001] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:22 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:24.043268 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-382c1fc9-62fb-4f3b-9471-d3180d7f1531 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:24.044280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-382c1fc9-62fb-4f3b-9471-d3180d7f1531 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:24.047929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=28 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:25:24.057390 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-382c1fc9-62fb-4f3b-9471-d3180d7f1531 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:24.058175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-382c1fc9-62fb-4f3b-9471-d3180d7f1531 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:24.058883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-382c1fc9-62fb-4f3b-9471-d3180d7f1531 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:24.059997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-382c1fc9-62fb-4f3b-9471-d3180d7f1531 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:24.060782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-382c1fc9-62fb-4f3b-9471-d3180d7f1531 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:24.061525 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-382c1fc9-62fb-4f3b-9471-d3180d7f1531 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:24.138636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-382c1fc9-62fb-4f3b-9471-d3180d7f1531 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:24.153400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-382c1fc9-62fb-4f3b-9471-d3180d7f1531 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:24.155605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-382c1fc9-62fb-4f3b-9471-d3180d7f1531 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:24.157242 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-382c1fc9-62fb-4f3b-9471-d3180d7f1531 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.120334 Sep 05 17:25:24.158219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1079/2002] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:24 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:25.185555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1e13ae89-ab88-4adb-a187-2215207d8e95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:25.186358 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1e13ae89-ab88-4adb-a187-2215207d8e95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:25.190076 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=28 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:25:25.197680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e13ae89-ab88-4adb-a187-2215207d8e95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:25.198317 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e13ae89-ab88-4adb-a187-2215207d8e95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:25.198884 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e13ae89-ab88-4adb-a187-2215207d8e95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:25.199788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e13ae89-ab88-4adb-a187-2215207d8e95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:25.200433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e13ae89-ab88-4adb-a187-2215207d8e95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:25.200991 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e13ae89-ab88-4adb-a187-2215207d8e95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:25.267019 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1e13ae89-ab88-4adb-a187-2215207d8e95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:25.276735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1e13ae89-ab88-4adb-a187-2215207d8e95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:25.278166 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1e13ae89-ab88-4adb-a187-2215207d8e95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:25.279300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1e13ae89-ab88-4adb-a187-2215207d8e95 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.099068 Sep 05 17:25:25.279859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 924/2003] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:25 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:26.304795 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-92756474-f6c7-4e39-8602-fc41e60891b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:26.305487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-92756474-f6c7-4e39-8602-fc41e60891b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:26.312613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92756474-f6c7-4e39-8602-fc41e60891b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:26.313085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92756474-f6c7-4e39-8602-fc41e60891b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:26.313516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92756474-f6c7-4e39-8602-fc41e60891b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:26.314194 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92756474-f6c7-4e39-8602-fc41e60891b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:26.314674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92756474-f6c7-4e39-8602-fc41e60891b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:26.315064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92756474-f6c7-4e39-8602-fc41e60891b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:26.391972 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-92756474-f6c7-4e39-8602-fc41e60891b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:26.401085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-92756474-f6c7-4e39-8602-fc41e60891b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:26.402518 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-92756474-f6c7-4e39-8602-fc41e60891b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:26.403654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-92756474-f6c7-4e39-8602-fc41e60891b8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102891 Sep 05 17:25:26.404200 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1080/2004] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:26 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:27.428844 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3b229e4c-7fef-44ad-89cd-0c1e1b7bdcff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:27.429433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3b229e4c-7fef-44ad-89cd-0c1e1b7bdcff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:27.436284 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b229e4c-7fef-44ad-89cd-0c1e1b7bdcff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:27.436762 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b229e4c-7fef-44ad-89cd-0c1e1b7bdcff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:27.437181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b229e4c-7fef-44ad-89cd-0c1e1b7bdcff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:27.437860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b229e4c-7fef-44ad-89cd-0c1e1b7bdcff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:27.438302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b229e4c-7fef-44ad-89cd-0c1e1b7bdcff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:27.438716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3b229e4c-7fef-44ad-89cd-0c1e1b7bdcff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:27.508779 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3b229e4c-7fef-44ad-89cd-0c1e1b7bdcff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:27.522107 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3b229e4c-7fef-44ad-89cd-0c1e1b7bdcff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:27.524412 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3b229e4c-7fef-44ad-89cd-0c1e1b7bdcff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:27.526112 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3b229e4c-7fef-44ad-89cd-0c1e1b7bdcff tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101045 Sep 05 17:25:27.526850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 925/2005] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:27 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:28.557060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6aed3438-12f7-48ef-97d5-063c13dec36a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:28.558023 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6aed3438-12f7-48ef-97d5-063c13dec36a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:28.567330 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6aed3438-12f7-48ef-97d5-063c13dec36a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:28.567807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6aed3438-12f7-48ef-97d5-063c13dec36a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:28.568273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6aed3438-12f7-48ef-97d5-063c13dec36a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:28.568958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6aed3438-12f7-48ef-97d5-063c13dec36a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:28.569407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6aed3438-12f7-48ef-97d5-063c13dec36a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:28.569854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6aed3438-12f7-48ef-97d5-063c13dec36a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:28.632142 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6aed3438-12f7-48ef-97d5-063c13dec36a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:28.640948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6aed3438-12f7-48ef-97d5-063c13dec36a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:28.642384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6aed3438-12f7-48ef-97d5-063c13dec36a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:28.643780 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6aed3438-12f7-48ef-97d5-063c13dec36a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.093428 Sep 05 17:25:28.644375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1081/2006] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:28 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:29.673411 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-88e41c00-aeeb-4233-9dc3-b4ef34f4a45b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:29.674606 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-88e41c00-aeeb-4233-9dc3-b4ef34f4a45b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:29.681792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88e41c00-aeeb-4233-9dc3-b4ef34f4a45b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:29.682360 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88e41c00-aeeb-4233-9dc3-b4ef34f4a45b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:29.682792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88e41c00-aeeb-4233-9dc3-b4ef34f4a45b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:29.683492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88e41c00-aeeb-4233-9dc3-b4ef34f4a45b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:29.683940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88e41c00-aeeb-4233-9dc3-b4ef34f4a45b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:29.684389 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88e41c00-aeeb-4233-9dc3-b4ef34f4a45b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:29.753796 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-88e41c00-aeeb-4233-9dc3-b4ef34f4a45b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:29.762853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-88e41c00-aeeb-4233-9dc3-b4ef34f4a45b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:29.764326 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-88e41c00-aeeb-4233-9dc3-b4ef34f4a45b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:29.765475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-88e41c00-aeeb-4233-9dc3-b4ef34f4a45b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098801 Sep 05 17:25:29.766017 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 926/2007] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:29 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:30.801689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3faf1db9-3608-404c-92ec-5bd3605a756d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:30.802596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3faf1db9-3608-404c-92ec-5bd3605a756d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:30.813515 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3faf1db9-3608-404c-92ec-5bd3605a756d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:30.814308 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3faf1db9-3608-404c-92ec-5bd3605a756d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:30.815020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3faf1db9-3608-404c-92ec-5bd3605a756d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:30.816196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3faf1db9-3608-404c-92ec-5bd3605a756d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:30.816674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3faf1db9-3608-404c-92ec-5bd3605a756d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:30.817099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3faf1db9-3608-404c-92ec-5bd3605a756d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:30.881735 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3faf1db9-3608-404c-92ec-5bd3605a756d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:30.890739 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3faf1db9-3608-404c-92ec-5bd3605a756d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:30.892174 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3faf1db9-3608-404c-92ec-5bd3605a756d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:30.893353 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3faf1db9-3608-404c-92ec-5bd3605a756d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098563 Sep 05 17:25:30.893903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1082/2008] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:30 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:31.923229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4901b2a0-314a-4c2e-b9b9-9d08653c4fea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:31.924052 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4901b2a0-314a-4c2e-b9b9-9d08653c4fea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:31.931719 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4901b2a0-314a-4c2e-b9b9-9d08653c4fea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:31.932203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4901b2a0-314a-4c2e-b9b9-9d08653c4fea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:31.932657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4901b2a0-314a-4c2e-b9b9-9d08653c4fea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:31.933451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4901b2a0-314a-4c2e-b9b9-9d08653c4fea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:31.933908 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4901b2a0-314a-4c2e-b9b9-9d08653c4fea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:31.934343 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4901b2a0-314a-4c2e-b9b9-9d08653c4fea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:32.004823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4901b2a0-314a-4c2e-b9b9-9d08653c4fea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:32.013643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4901b2a0-314a-4c2e-b9b9-9d08653c4fea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:32.015065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4901b2a0-314a-4c2e-b9b9-9d08653c4fea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:32.016211 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4901b2a0-314a-4c2e-b9b9-9d08653c4fea tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.099680 Sep 05 17:25:32.016786 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 927/2009] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:31 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:33.052354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-30862211-1f09-46ef-9857-e34bb84aea21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:33.053346 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-30862211-1f09-46ef-9857-e34bb84aea21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:33.064120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30862211-1f09-46ef-9857-e34bb84aea21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:33.064975 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30862211-1f09-46ef-9857-e34bb84aea21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:33.065686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30862211-1f09-46ef-9857-e34bb84aea21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:33.066913 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30862211-1f09-46ef-9857-e34bb84aea21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:33.067355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30862211-1f09-46ef-9857-e34bb84aea21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:33.067876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30862211-1f09-46ef-9857-e34bb84aea21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:33.129692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-30862211-1f09-46ef-9857-e34bb84aea21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:33.138633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-30862211-1f09-46ef-9857-e34bb84aea21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:33.140050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-30862211-1f09-46ef-9857-e34bb84aea21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:33.141206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-30862211-1f09-46ef-9857-e34bb84aea21 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.095672 Sep 05 17:25:33.141769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1083/2010] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:33 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:34.171448 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-268cc56c-aa47-4615-980f-6eaed6116e37 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:34.172837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-268cc56c-aa47-4615-980f-6eaed6116e37 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:34.181390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-268cc56c-aa47-4615-980f-6eaed6116e37 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:34.181869 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-268cc56c-aa47-4615-980f-6eaed6116e37 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:34.182290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-268cc56c-aa47-4615-980f-6eaed6116e37 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:34.182974 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-268cc56c-aa47-4615-980f-6eaed6116e37 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:34.183420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-268cc56c-aa47-4615-980f-6eaed6116e37 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:34.183834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-268cc56c-aa47-4615-980f-6eaed6116e37 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:34.247053 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-268cc56c-aa47-4615-980f-6eaed6116e37 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:34.256614 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-268cc56c-aa47-4615-980f-6eaed6116e37 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:34.258040 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-268cc56c-aa47-4615-980f-6eaed6116e37 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:34.259181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-268cc56c-aa47-4615-980f-6eaed6116e37 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.095488 Sep 05 17:25:34.259732 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 928/2011] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:34 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:35.287946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-425597fa-cfd8-4a22-bc8f-af41c5a50c27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:35.288738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-425597fa-cfd8-4a22-bc8f-af41c5a50c27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:35.297161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-425597fa-cfd8-4a22-bc8f-af41c5a50c27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:35.297760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-425597fa-cfd8-4a22-bc8f-af41c5a50c27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:35.298297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-425597fa-cfd8-4a22-bc8f-af41c5a50c27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:35.299152 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-425597fa-cfd8-4a22-bc8f-af41c5a50c27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:35.299710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-425597fa-cfd8-4a22-bc8f-af41c5a50c27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:35.300275 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-425597fa-cfd8-4a22-bc8f-af41c5a50c27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:35.381135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-425597fa-cfd8-4a22-bc8f-af41c5a50c27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:35.390501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-425597fa-cfd8-4a22-bc8f-af41c5a50c27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:35.392004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-425597fa-cfd8-4a22-bc8f-af41c5a50c27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:35.393177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-425597fa-cfd8-4a22-bc8f-af41c5a50c27 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.112077 Sep 05 17:25:35.393731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1084/2012] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:35 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:36.419720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c6a6d79d-b03b-465e-a843-eba48ddfe747 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:36.420363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c6a6d79d-b03b-465e-a843-eba48ddfe747 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:36.427673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c6a6d79d-b03b-465e-a843-eba48ddfe747 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:36.428176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c6a6d79d-b03b-465e-a843-eba48ddfe747 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:36.428613 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c6a6d79d-b03b-465e-a843-eba48ddfe747 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:36.429309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c6a6d79d-b03b-465e-a843-eba48ddfe747 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:36.429842 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c6a6d79d-b03b-465e-a843-eba48ddfe747 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:36.430239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c6a6d79d-b03b-465e-a843-eba48ddfe747 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:36.496048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c6a6d79d-b03b-465e-a843-eba48ddfe747 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:36.505012 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c6a6d79d-b03b-465e-a843-eba48ddfe747 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:36.506449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c6a6d79d-b03b-465e-a843-eba48ddfe747 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:36.507601 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c6a6d79d-b03b-465e-a843-eba48ddfe747 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.091940 Sep 05 17:25:36.508173 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 929/2013] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:36 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:37.533426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8c51039f-3ab4-44d7-bfc7-34130753cc6a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:37.534018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8c51039f-3ab4-44d7-bfc7-34130753cc6a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:37.541437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c51039f-3ab4-44d7-bfc7-34130753cc6a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:37.541911 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c51039f-3ab4-44d7-bfc7-34130753cc6a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:37.542333 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c51039f-3ab4-44d7-bfc7-34130753cc6a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:37.543005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c51039f-3ab4-44d7-bfc7-34130753cc6a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:37.543449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c51039f-3ab4-44d7-bfc7-34130753cc6a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:37.543860 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c51039f-3ab4-44d7-bfc7-34130753cc6a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:37.610173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8c51039f-3ab4-44d7-bfc7-34130753cc6a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:37.619060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8c51039f-3ab4-44d7-bfc7-34130753cc6a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:37.620558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8c51039f-3ab4-44d7-bfc7-34130753cc6a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:37.621686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8c51039f-3ab4-44d7-bfc7-34130753cc6a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.092308 Sep 05 17:25:37.622235 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1085/2014] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:37 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:38.654574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2ee090d2-8602-4884-b3fa-fb314ae28c6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:38.655474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2ee090d2-8602-4884-b3fa-fb314ae28c6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:38.666487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ee090d2-8602-4884-b3fa-fb314ae28c6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:38.667273 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ee090d2-8602-4884-b3fa-fb314ae28c6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:38.667985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ee090d2-8602-4884-b3fa-fb314ae28c6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:38.669162 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ee090d2-8602-4884-b3fa-fb314ae28c6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:38.669998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ee090d2-8602-4884-b3fa-fb314ae28c6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:38.670729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2ee090d2-8602-4884-b3fa-fb314ae28c6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:38.685254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3c110570-9cb6-4d23-b9da-08a6cc36ce1d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:38.685854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3c110570-9cb6-4d23-b9da-08a6cc36ce1d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:38.693391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c110570-9cb6-4d23-b9da-08a6cc36ce1d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:38.693869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c110570-9cb6-4d23-b9da-08a6cc36ce1d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:38.694295 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c110570-9cb6-4d23-b9da-08a6cc36ce1d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:38.694972 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c110570-9cb6-4d23-b9da-08a6cc36ce1d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:38.695415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c110570-9cb6-4d23-b9da-08a6cc36ce1d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:38.695826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c110570-9cb6-4d23-b9da-08a6cc36ce1d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:38.720141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3c110570-9cb6-4d23-b9da-08a6cc36ce1d tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1/ips" status: 200 len: 150 microversion: 2.1 time: 0.038746 Sep 05 17:25:38.720758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1086/2015] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Sep 5 17:25:38 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:25:38.736519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2ee090d2-8602-4884-b3fa-fb314ae28c6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:38.745342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2ee090d2-8602-4884-b3fa-fb314ae28c6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:38.746784 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2ee090d2-8602-4884-b3fa-fb314ae28c6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:38.747929 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2ee090d2-8602-4884-b3fa-fb314ae28c6b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.100019 Sep 05 17:25:38.748531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 930/2016] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:38 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:39.777769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-53da8b0c-937a-4dde-b7f4-ef51f80fa208 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:39.778714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-53da8b0c-937a-4dde-b7f4-ef51f80fa208 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:39.788250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53da8b0c-937a-4dde-b7f4-ef51f80fa208 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:39.788731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53da8b0c-937a-4dde-b7f4-ef51f80fa208 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:39.789157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53da8b0c-937a-4dde-b7f4-ef51f80fa208 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:39.789832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53da8b0c-937a-4dde-b7f4-ef51f80fa208 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:39.790274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53da8b0c-937a-4dde-b7f4-ef51f80fa208 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:39.790691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53da8b0c-937a-4dde-b7f4-ef51f80fa208 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:39.858680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-53da8b0c-937a-4dde-b7f4-ef51f80fa208 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:39.867448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-53da8b0c-937a-4dde-b7f4-ef51f80fa208 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:39.868891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-53da8b0c-937a-4dde-b7f4-ef51f80fa208 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:39.870004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-53da8b0c-937a-4dde-b7f4-ef51f80fa208 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.099011 Sep 05 17:25:39.870583 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1087/2017] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:39 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:40.895995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8d7141f7-3de9-4e4f-a570-632d77b6960a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:40.896748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8d7141f7-3de9-4e4f-a570-632d77b6960a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:40.903137 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d7141f7-3de9-4e4f-a570-632d77b6960a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:40.903605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d7141f7-3de9-4e4f-a570-632d77b6960a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:40.904022 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d7141f7-3de9-4e4f-a570-632d77b6960a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:40.904731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d7141f7-3de9-4e4f-a570-632d77b6960a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:40.905169 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d7141f7-3de9-4e4f-a570-632d77b6960a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:40.905571 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d7141f7-3de9-4e4f-a570-632d77b6960a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:40.987265 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8d7141f7-3de9-4e4f-a570-632d77b6960a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:41.000716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8d7141f7-3de9-4e4f-a570-632d77b6960a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:41.002780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8d7141f7-3de9-4e4f-a570-632d77b6960a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:41.004495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8d7141f7-3de9-4e4f-a570-632d77b6960a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.112484 Sep 05 17:25:41.005116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 931/2018] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:40 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:42.034029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2e8052a9-73eb-448b-830c-51eaea93dfeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:42.035085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2e8052a9-73eb-448b-830c-51eaea93dfeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:42.042352 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e8052a9-73eb-448b-830c-51eaea93dfeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:42.042830 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e8052a9-73eb-448b-830c-51eaea93dfeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:42.043262 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e8052a9-73eb-448b-830c-51eaea93dfeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:42.043925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e8052a9-73eb-448b-830c-51eaea93dfeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:42.044432 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e8052a9-73eb-448b-830c-51eaea93dfeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:42.044856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e8052a9-73eb-448b-830c-51eaea93dfeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:42.107836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2e8052a9-73eb-448b-830c-51eaea93dfeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:42.116913 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2e8052a9-73eb-448b-830c-51eaea93dfeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:42.118342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2e8052a9-73eb-448b-830c-51eaea93dfeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:42.119478 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2e8052a9-73eb-448b-830c-51eaea93dfeb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.092057 Sep 05 17:25:42.120035 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1088/2019] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:42 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:43.147602 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0041d387-de9e-4141-95aa-b8d1e718b2e1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:43.148299 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0041d387-de9e-4141-95aa-b8d1e718b2e1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:43.156592 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0041d387-de9e-4141-95aa-b8d1e718b2e1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:43.157219 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0041d387-de9e-4141-95aa-b8d1e718b2e1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:43.157749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0041d387-de9e-4141-95aa-b8d1e718b2e1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:43.158625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0041d387-de9e-4141-95aa-b8d1e718b2e1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:43.159204 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0041d387-de9e-4141-95aa-b8d1e718b2e1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:43.159731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0041d387-de9e-4141-95aa-b8d1e718b2e1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:43.225494 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0041d387-de9e-4141-95aa-b8d1e718b2e1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:43.242735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0041d387-de9e-4141-95aa-b8d1e718b2e1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:43.244190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0041d387-de9e-4141-95aa-b8d1e718b2e1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:43.245351 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0041d387-de9e-4141-95aa-b8d1e718b2e1 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.103309 Sep 05 17:25:43.245915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 932/2020] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:43 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:44.275562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-51678ec0-71d1-4d9e-8788-8b97dfb377ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:44.276605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-51678ec0-71d1-4d9e-8788-8b97dfb377ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:44.287083 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51678ec0-71d1-4d9e-8788-8b97dfb377ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:44.287563 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51678ec0-71d1-4d9e-8788-8b97dfb377ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:44.287990 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51678ec0-71d1-4d9e-8788-8b97dfb377ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:44.288716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51678ec0-71d1-4d9e-8788-8b97dfb377ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:44.289162 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51678ec0-71d1-4d9e-8788-8b97dfb377ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:44.289579 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51678ec0-71d1-4d9e-8788-8b97dfb377ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:44.360545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-51678ec0-71d1-4d9e-8788-8b97dfb377ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:44.370705 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-51678ec0-71d1-4d9e-8788-8b97dfb377ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:44.372180 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-51678ec0-71d1-4d9e-8788-8b97dfb377ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:44.373336 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-51678ec0-71d1-4d9e-8788-8b97dfb377ba tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.104646 Sep 05 17:25:44.374108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1089/2021] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:44 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:45.400129 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f3676a5c-28ae-4db2-ab49-3e4b12ab0441 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:45.400761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f3676a5c-28ae-4db2-ab49-3e4b12ab0441 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:45.407631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3676a5c-28ae-4db2-ab49-3e4b12ab0441 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:45.408113 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3676a5c-28ae-4db2-ab49-3e4b12ab0441 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:45.408578 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3676a5c-28ae-4db2-ab49-3e4b12ab0441 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:45.409300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3676a5c-28ae-4db2-ab49-3e4b12ab0441 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:45.409758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3676a5c-28ae-4db2-ab49-3e4b12ab0441 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:45.410180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3676a5c-28ae-4db2-ab49-3e4b12ab0441 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:45.483891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f3676a5c-28ae-4db2-ab49-3e4b12ab0441 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:45.492950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f3676a5c-28ae-4db2-ab49-3e4b12ab0441 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:45.494375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f3676a5c-28ae-4db2-ab49-3e4b12ab0441 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:45.495521 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f3676a5c-28ae-4db2-ab49-3e4b12ab0441 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.099433 Sep 05 17:25:45.496084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 933/2022] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:45 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:46.524127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8f84d685-578a-477f-94a2-60b8f0648b29 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:46.525021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8f84d685-578a-477f-94a2-60b8f0648b29 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:46.534586 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f84d685-578a-477f-94a2-60b8f0648b29 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:46.535278 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f84d685-578a-477f-94a2-60b8f0648b29 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:46.536520 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f84d685-578a-477f-94a2-60b8f0648b29 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:46.537222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f84d685-578a-477f-94a2-60b8f0648b29 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:46.537674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f84d685-578a-477f-94a2-60b8f0648b29 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:46.538098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f84d685-578a-477f-94a2-60b8f0648b29 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:46.600326 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8f84d685-578a-477f-94a2-60b8f0648b29 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:46.609128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8f84d685-578a-477f-94a2-60b8f0648b29 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:46.610564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8f84d685-578a-477f-94a2-60b8f0648b29 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:46.611704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8f84d685-578a-477f-94a2-60b8f0648b29 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.093966 Sep 05 17:25:46.612287 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1090/2023] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:46 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:47.639779 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-110c6ee6-6213-430e-955e-c662804e5dab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:47.640579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-110c6ee6-6213-430e-955e-c662804e5dab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:47.650245 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-110c6ee6-6213-430e-955e-c662804e5dab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:47.650917 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-110c6ee6-6213-430e-955e-c662804e5dab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:47.651524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-110c6ee6-6213-430e-955e-c662804e5dab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:47.652564 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-110c6ee6-6213-430e-955e-c662804e5dab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:47.653207 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-110c6ee6-6213-430e-955e-c662804e5dab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:47.653763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-110c6ee6-6213-430e-955e-c662804e5dab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:47.657621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=84 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:25:47.719960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-110c6ee6-6213-430e-955e-c662804e5dab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:47.728952 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-110c6ee6-6213-430e-955e-c662804e5dab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:47.730384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-110c6ee6-6213-430e-955e-c662804e5dab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:47.731534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-110c6ee6-6213-430e-955e-c662804e5dab tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097612 Sep 05 17:25:47.732118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 934/2024] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:47 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:48.762138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4019354b-8107-46c2-a680-fd3b211e850f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:48.763046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4019354b-8107-46c2-a680-fd3b211e850f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:48.774066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4019354b-8107-46c2-a680-fd3b211e850f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:48.774852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4019354b-8107-46c2-a680-fd3b211e850f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:48.775556 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4019354b-8107-46c2-a680-fd3b211e850f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:48.776747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4019354b-8107-46c2-a680-fd3b211e850f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:48.777477 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4019354b-8107-46c2-a680-fd3b211e850f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:48.778170 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4019354b-8107-46c2-a680-fd3b211e850f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:48.782397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=88 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:25:48.846264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4019354b-8107-46c2-a680-fd3b211e850f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:48.855949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4019354b-8107-46c2-a680-fd3b211e850f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:48.857403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4019354b-8107-46c2-a680-fd3b211e850f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:48.858539 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4019354b-8107-46c2-a680-fd3b211e850f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.103775 Sep 05 17:25:48.859090 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1091/2025] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:48 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:49.888142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2792e9e7-e698-48d8-b385-8491a8bcd654 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:49.889156 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2792e9e7-e698-48d8-b385-8491a8bcd654 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:49.898774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2792e9e7-e698-48d8-b385-8491a8bcd654 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:49.899255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2792e9e7-e698-48d8-b385-8491a8bcd654 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:49.899679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2792e9e7-e698-48d8-b385-8491a8bcd654 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:49.900405 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2792e9e7-e698-48d8-b385-8491a8bcd654 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:49.900859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2792e9e7-e698-48d8-b385-8491a8bcd654 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:49.901276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2792e9e7-e698-48d8-b385-8491a8bcd654 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:49.965822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2792e9e7-e698-48d8-b385-8491a8bcd654 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:49.977491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2792e9e7-e698-48d8-b385-8491a8bcd654 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:49.978911 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2792e9e7-e698-48d8-b385-8491a8bcd654 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:49.980041 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2792e9e7-e698-48d8-b385-8491a8bcd654 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.098545 Sep 05 17:25:49.980626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 935/2026] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:49 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:51.009927 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ba317fa6-d820-4a1b-a20f-95dc74159d72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:51.010888 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ba317fa6-d820-4a1b-a20f-95dc74159d72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:51.021636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba317fa6-d820-4a1b-a20f-95dc74159d72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:51.022425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba317fa6-d820-4a1b-a20f-95dc74159d72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:51.023136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba317fa6-d820-4a1b-a20f-95dc74159d72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:51.024279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba317fa6-d820-4a1b-a20f-95dc74159d72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:51.025046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba317fa6-d820-4a1b-a20f-95dc74159d72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:51.025748 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba317fa6-d820-4a1b-a20f-95dc74159d72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:51.093804 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ba317fa6-d820-4a1b-a20f-95dc74159d72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:51.103595 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ba317fa6-d820-4a1b-a20f-95dc74159d72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:51.105065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ba317fa6-d820-4a1b-a20f-95dc74159d72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:51.106204 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ba317fa6-d820-4a1b-a20f-95dc74159d72 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.103184 Sep 05 17:25:51.106772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1092/2027] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:51 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:52.140692 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-58927ee3-6757-4971-bac8-3aa6c2227773 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:52.141681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-58927ee3-6757-4971-bac8-3aa6c2227773 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:52.150120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58927ee3-6757-4971-bac8-3aa6c2227773 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:52.150602 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58927ee3-6757-4971-bac8-3aa6c2227773 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:52.151029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58927ee3-6757-4971-bac8-3aa6c2227773 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:52.151717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58927ee3-6757-4971-bac8-3aa6c2227773 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:52.152178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58927ee3-6757-4971-bac8-3aa6c2227773 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:52.152618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-58927ee3-6757-4971-bac8-3aa6c2227773 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:52.216047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-58927ee3-6757-4971-bac8-3aa6c2227773 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:52.227820 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-58927ee3-6757-4971-bac8-3aa6c2227773 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:52.229302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-58927ee3-6757-4971-bac8-3aa6c2227773 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:52.230458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-58927ee3-6757-4971-bac8-3aa6c2227773 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.096401 Sep 05 17:25:52.231010 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 936/2028] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:52 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:53.254827 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-053053e3-e940-4156-9d27-d686c28d2cd5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:53.255611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-053053e3-e940-4156-9d27-d686c28d2cd5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:53.263078 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-053053e3-e940-4156-9d27-d686c28d2cd5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:53.263531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-053053e3-e940-4156-9d27-d686c28d2cd5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:53.264013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-053053e3-e940-4156-9d27-d686c28d2cd5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:53.264806 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-053053e3-e940-4156-9d27-d686c28d2cd5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:53.265247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-053053e3-e940-4156-9d27-d686c28d2cd5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:53.265662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-053053e3-e940-4156-9d27-d686c28d2cd5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:53.336297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-053053e3-e940-4156-9d27-d686c28d2cd5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:53.349648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-053053e3-e940-4156-9d27-d686c28d2cd5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:53.351948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-053053e3-e940-4156-9d27-d686c28d2cd5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:53.353728 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-053053e3-e940-4156-9d27-d686c28d2cd5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.102565 Sep 05 17:25:53.354463 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1093/2029] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:53 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:54.388014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2dee7752-b7e2-4a28-8dc9-bd433726fad3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:54.389048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2dee7752-b7e2-4a28-8dc9-bd433726fad3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:54.399488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2dee7752-b7e2-4a28-8dc9-bd433726fad3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:54.399968 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2dee7752-b7e2-4a28-8dc9-bd433726fad3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:54.400428 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2dee7752-b7e2-4a28-8dc9-bd433726fad3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:54.401117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2dee7752-b7e2-4a28-8dc9-bd433726fad3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:54.401597 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2dee7752-b7e2-4a28-8dc9-bd433726fad3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:54.402035 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2dee7752-b7e2-4a28-8dc9-bd433726fad3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:54.473195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2dee7752-b7e2-4a28-8dc9-bd433726fad3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:54.482506 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2dee7752-b7e2-4a28-8dc9-bd433726fad3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:54.483949 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2dee7752-b7e2-4a28-8dc9-bd433726fad3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:54.485099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2dee7752-b7e2-4a28-8dc9-bd433726fad3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.103700 Sep 05 17:25:54.485658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 937/2030] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:54 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:55.511717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fa16c168-e439-4710-8a67-b80cd26f7154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:55.512401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fa16c168-e439-4710-8a67-b80cd26f7154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:55.514752 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=30 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:25:55.520543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa16c168-e439-4710-8a67-b80cd26f7154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:55.521101 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa16c168-e439-4710-8a67-b80cd26f7154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:55.521787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa16c168-e439-4710-8a67-b80cd26f7154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:55.522401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa16c168-e439-4710-8a67-b80cd26f7154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:55.522857 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa16c168-e439-4710-8a67-b80cd26f7154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:55.523276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa16c168-e439-4710-8a67-b80cd26f7154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:55.597465 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fa16c168-e439-4710-8a67-b80cd26f7154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:55.606962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fa16c168-e439-4710-8a67-b80cd26f7154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:55.608440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fa16c168-e439-4710-8a67-b80cd26f7154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:55.609621 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fa16c168-e439-4710-8a67-b80cd26f7154 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.101950 Sep 05 17:25:55.610174 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1094/2031] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:55 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:56.634781 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a7739a86-3c0f-4208-afa9-16c9de629083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:56.635371 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a7739a86-3c0f-4208-afa9-16c9de629083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:56.637731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=28 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:25:56.643607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7739a86-3c0f-4208-afa9-16c9de629083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:56.644082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7739a86-3c0f-4208-afa9-16c9de629083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:56.644530 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7739a86-3c0f-4208-afa9-16c9de629083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:56.645199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7739a86-3c0f-4208-afa9-16c9de629083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:56.645645 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7739a86-3c0f-4208-afa9-16c9de629083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:56.646054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7739a86-3c0f-4208-afa9-16c9de629083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:56.711616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a7739a86-3c0f-4208-afa9-16c9de629083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:56.720733 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a7739a86-3c0f-4208-afa9-16c9de629083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:56.722158 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a7739a86-3c0f-4208-afa9-16c9de629083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:56.723318 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a7739a86-3c0f-4208-afa9-16c9de629083 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.093260 Sep 05 17:25:56.723855 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 938/2032] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:56 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:57.752967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-956a135b-b7ef-4b6d-b27f-c9fe316a65a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:57.753847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-956a135b-b7ef-4b6d-b27f-c9fe316a65a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:57.765792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-956a135b-b7ef-4b6d-b27f-c9fe316a65a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:57.766589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-956a135b-b7ef-4b6d-b27f-c9fe316a65a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:57.767304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-956a135b-b7ef-4b6d-b27f-c9fe316a65a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:57.768509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-956a135b-b7ef-4b6d-b27f-c9fe316a65a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:57.769257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-956a135b-b7ef-4b6d-b27f-c9fe316a65a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:57.769958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-956a135b-b7ef-4b6d-b27f-c9fe316a65a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:57.838618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-956a135b-b7ef-4b6d-b27f-c9fe316a65a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:57.852408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-956a135b-b7ef-4b6d-b27f-c9fe316a65a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:57.854604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-956a135b-b7ef-4b6d-b27f-c9fe316a65a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:57.856096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-956a135b-b7ef-4b6d-b27f-c9fe316a65a0 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.109731 Sep 05 17:25:57.856928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1095/2033] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:57 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:58.881607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-43022838-f83c-4b06-b482-c32fdfb76885 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:58.882242 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-43022838-f83c-4b06-b482-c32fdfb76885 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:25:58.889974 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43022838-f83c-4b06-b482-c32fdfb76885 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:58.890454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43022838-f83c-4b06-b482-c32fdfb76885 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:58.890884 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43022838-f83c-4b06-b482-c32fdfb76885 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:58.891576 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43022838-f83c-4b06-b482-c32fdfb76885 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:25:58.892026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43022838-f83c-4b06-b482-c32fdfb76885 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:25:58.892477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-43022838-f83c-4b06-b482-c32fdfb76885 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:25:58.958048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-43022838-f83c-4b06-b482-c32fdfb76885 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:58.968338 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-43022838-f83c-4b06-b482-c32fdfb76885 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:58.969817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-43022838-f83c-4b06-b482-c32fdfb76885 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:25:58.970965 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-43022838-f83c-4b06-b482-c32fdfb76885 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.093383 Sep 05 17:25:58.971727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 939/2034] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:58 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:25:59.997750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e764a8d4-643e-42e4-8311-14b5bf6d9a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:25:59.998401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e764a8d4-643e-42e4-8311-14b5bf6d9a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:00.005399 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e764a8d4-643e-42e4-8311-14b5bf6d9a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:00.005883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e764a8d4-643e-42e4-8311-14b5bf6d9a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:00.006337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e764a8d4-643e-42e4-8311-14b5bf6d9a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:00.007001 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e764a8d4-643e-42e4-8311-14b5bf6d9a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:00.007450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e764a8d4-643e-42e4-8311-14b5bf6d9a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:00.007873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e764a8d4-643e-42e4-8311-14b5bf6d9a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:00.070611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e764a8d4-643e-42e4-8311-14b5bf6d9a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:00.080015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e764a8d4-643e-42e4-8311-14b5bf6d9a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:00.081476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e764a8d4-643e-42e4-8311-14b5bf6d9a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:00.082613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e764a8d4-643e-42e4-8311-14b5bf6d9a33 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.088851 Sep 05 17:26:00.083181 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1096/2035] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:25:59 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:01.108893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-99032bf5-a06e-4a3a-bb66-2a8211c24c9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:01.109505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-99032bf5-a06e-4a3a-bb66-2a8211c24c9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:01.116311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99032bf5-a06e-4a3a-bb66-2a8211c24c9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:01.116785 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99032bf5-a06e-4a3a-bb66-2a8211c24c9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:01.117207 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99032bf5-a06e-4a3a-bb66-2a8211c24c9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:01.117918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99032bf5-a06e-4a3a-bb66-2a8211c24c9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:01.118359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99032bf5-a06e-4a3a-bb66-2a8211c24c9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:01.118775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99032bf5-a06e-4a3a-bb66-2a8211c24c9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:01.180175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-99032bf5-a06e-4a3a-bb66-2a8211c24c9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:01.189065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-99032bf5-a06e-4a3a-bb66-2a8211c24c9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:01.190505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-99032bf5-a06e-4a3a-bb66-2a8211c24c9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:01.191629 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-99032bf5-a06e-4a3a-bb66-2a8211c24c9f tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.086724 Sep 05 17:26:01.192185 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 940/2036] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:01 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:02.219754 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-216f79dc-7829-49a7-aefc-23c789d8a4f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:02.220514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-216f79dc-7829-49a7-aefc-23c789d8a4f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:02.229460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-216f79dc-7829-49a7-aefc-23c789d8a4f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:02.230047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-216f79dc-7829-49a7-aefc-23c789d8a4f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:02.230577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-216f79dc-7829-49a7-aefc-23c789d8a4f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:02.231419 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-216f79dc-7829-49a7-aefc-23c789d8a4f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:02.231971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-216f79dc-7829-49a7-aefc-23c789d8a4f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:02.232516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-216f79dc-7829-49a7-aefc-23c789d8a4f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:02.300081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-216f79dc-7829-49a7-aefc-23c789d8a4f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:02.309672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-216f79dc-7829-49a7-aefc-23c789d8a4f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:02.311123 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-216f79dc-7829-49a7-aefc-23c789d8a4f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:02.312309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-216f79dc-7829-49a7-aefc-23c789d8a4f3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097821 Sep 05 17:26:02.312883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1097/2037] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:02 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:03.342184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fd7b1e67-6217-44ea-91d8-d4e12405f937 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:03.343163 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fd7b1e67-6217-44ea-91d8-d4e12405f937 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:03.353646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd7b1e67-6217-44ea-91d8-d4e12405f937 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:03.354093 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd7b1e67-6217-44ea-91d8-d4e12405f937 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:03.354604 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd7b1e67-6217-44ea-91d8-d4e12405f937 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:03.355232 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd7b1e67-6217-44ea-91d8-d4e12405f937 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:03.355682 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd7b1e67-6217-44ea-91d8-d4e12405f937 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:03.356100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd7b1e67-6217-44ea-91d8-d4e12405f937 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:03.417478 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fd7b1e67-6217-44ea-91d8-d4e12405f937 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:03.426026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fd7b1e67-6217-44ea-91d8-d4e12405f937 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:03.427465 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fd7b1e67-6217-44ea-91d8-d4e12405f937 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:03.428670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fd7b1e67-6217-44ea-91d8-d4e12405f937 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.093730 Sep 05 17:26:03.429233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 941/2038] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:03 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:04.458825 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-08f0c188-e153-46fe-b8d6-64e435d8a59d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:04.459759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-08f0c188-e153-46fe-b8d6-64e435d8a59d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:04.467922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08f0c188-e153-46fe-b8d6-64e435d8a59d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:04.468430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08f0c188-e153-46fe-b8d6-64e435d8a59d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:04.468855 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08f0c188-e153-46fe-b8d6-64e435d8a59d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:04.469542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08f0c188-e153-46fe-b8d6-64e435d8a59d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:04.469985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08f0c188-e153-46fe-b8d6-64e435d8a59d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:04.470400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08f0c188-e153-46fe-b8d6-64e435d8a59d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:04.538456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-08f0c188-e153-46fe-b8d6-64e435d8a59d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:04.547198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-08f0c188-e153-46fe-b8d6-64e435d8a59d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:04.548653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-08f0c188-e153-46fe-b8d6-64e435d8a59d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:04.549783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-08f0c188-e153-46fe-b8d6-64e435d8a59d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.097665 Sep 05 17:26:04.550336 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1098/2039] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:04 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:05.579788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-149bc881-e3b3-4d26-8e97-93d650b5ac65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:05.580844 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-149bc881-e3b3-4d26-8e97-93d650b5ac65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:05.589938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-149bc881-e3b3-4d26-8e97-93d650b5ac65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:05.590419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-149bc881-e3b3-4d26-8e97-93d650b5ac65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:05.590845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-149bc881-e3b3-4d26-8e97-93d650b5ac65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:05.591542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-149bc881-e3b3-4d26-8e97-93d650b5ac65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:05.592375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-149bc881-e3b3-4d26-8e97-93d650b5ac65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:05.592795 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-149bc881-e3b3-4d26-8e97-93d650b5ac65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:05.666271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-149bc881-e3b3-4d26-8e97-93d650b5ac65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:05.675090 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-149bc881-e3b3-4d26-8e97-93d650b5ac65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:05.676561 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-149bc881-e3b3-4d26-8e97-93d650b5ac65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:05.677703 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-149bc881-e3b3-4d26-8e97-93d650b5ac65 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.104484 Sep 05 17:26:05.678272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 942/2040] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:05 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:06.703038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-03216df5-42c1-4dd4-a255-37170a09d20a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:06.703648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-03216df5-42c1-4dd4-a255-37170a09d20a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:06.710521 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03216df5-42c1-4dd4-a255-37170a09d20a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:06.711006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03216df5-42c1-4dd4-a255-37170a09d20a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:06.711435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03216df5-42c1-4dd4-a255-37170a09d20a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:06.712248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03216df5-42c1-4dd4-a255-37170a09d20a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:06.712845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03216df5-42c1-4dd4-a255-37170a09d20a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:06.713266 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03216df5-42c1-4dd4-a255-37170a09d20a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:06.778755 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-03216df5-42c1-4dd4-a255-37170a09d20a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:06.790872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-03216df5-42c1-4dd4-a255-37170a09d20a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:06.793111 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-03216df5-42c1-4dd4-a255-37170a09d20a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:06.794749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-03216df5-42c1-4dd4-a255-37170a09d20a tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.095462 Sep 05 17:26:06.795495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1099/2041] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:06 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:07.823572 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ec70da2a-f668-4ca2-aef0-fd6066d65811 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:07.824300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ec70da2a-f668-4ca2-aef0-fd6066d65811 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:07.831288 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec70da2a-f668-4ca2-aef0-fd6066d65811 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:07.831770 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec70da2a-f668-4ca2-aef0-fd6066d65811 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:07.832236 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec70da2a-f668-4ca2-aef0-fd6066d65811 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:07.832926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec70da2a-f668-4ca2-aef0-fd6066d65811 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:07.833375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec70da2a-f668-4ca2-aef0-fd6066d65811 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:07.833798 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec70da2a-f668-4ca2-aef0-fd6066d65811 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:07.902729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ec70da2a-f668-4ca2-aef0-fd6066d65811 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:07.911730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ec70da2a-f668-4ca2-aef0-fd6066d65811 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:07.913199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ec70da2a-f668-4ca2-aef0-fd6066d65811 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:07.914369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ec70da2a-f668-4ca2-aef0-fd6066d65811 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.096690 Sep 05 17:26:07.914929 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 943/2042] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:07 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:08.943592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2ce9d46b-57ba-4957-b6e0-337caa4944e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:08.944867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2ce9d46b-57ba-4957-b6e0-337caa4944e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:08.952568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ce9d46b-57ba-4957-b6e0-337caa4944e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:08.953015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ce9d46b-57ba-4957-b6e0-337caa4944e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:08.953473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ce9d46b-57ba-4957-b6e0-337caa4944e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:08.954165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ce9d46b-57ba-4957-b6e0-337caa4944e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:08.954612 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ce9d46b-57ba-4957-b6e0-337caa4944e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:08.955031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ce9d46b-57ba-4957-b6e0-337caa4944e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:09.019899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2ce9d46b-57ba-4957-b6e0-337caa4944e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:09.028991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2ce9d46b-57ba-4957-b6e0-337caa4944e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:09.030428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2ce9d46b-57ba-4957-b6e0-337caa4944e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:09.031568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2ce9d46b-57ba-4957-b6e0-337caa4944e4 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.094575 Sep 05 17:26:09.032127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1100/2043] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:08 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:10.060797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5a0cfb23-40f8-4858-a459-ede0d1af218c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:10.062158 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5a0cfb23-40f8-4858-a459-ede0d1af218c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:10.075228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a0cfb23-40f8-4858-a459-ede0d1af218c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:10.075789 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a0cfb23-40f8-4858-a459-ede0d1af218c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:10.076322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a0cfb23-40f8-4858-a459-ede0d1af218c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:10.077062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a0cfb23-40f8-4858-a459-ede0d1af218c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:10.077536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a0cfb23-40f8-4858-a459-ede0d1af218c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:10.077946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a0cfb23-40f8-4858-a459-ede0d1af218c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:10.145465 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5a0cfb23-40f8-4858-a459-ede0d1af218c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:10.158930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5a0cfb23-40f8-4858-a459-ede0d1af218c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:10.160796 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5a0cfb23-40f8-4858-a459-ede0d1af218c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:10.162503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5a0cfb23-40f8-4858-a459-ede0d1af218c tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.108286 Sep 05 17:26:10.163252 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 944/2044] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:10 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:11.190654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9ac0303c-1b93-4310-98fb-573aea53356d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:11.191252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9ac0303c-1b93-4310-98fb-573aea53356d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:11.199979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ac0303c-1b93-4310-98fb-573aea53356d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:11.200496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ac0303c-1b93-4310-98fb-573aea53356d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:11.200936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ac0303c-1b93-4310-98fb-573aea53356d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:11.201623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ac0303c-1b93-4310-98fb-573aea53356d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:11.202073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ac0303c-1b93-4310-98fb-573aea53356d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:11.202493 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ac0303c-1b93-4310-98fb-573aea53356d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:11.268553 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9ac0303c-1b93-4310-98fb-573aea53356d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:11.277424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9ac0303c-1b93-4310-98fb-573aea53356d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:11.278869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9ac0303c-1b93-4310-98fb-573aea53356d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:11.280011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9ac0303c-1b93-4310-98fb-573aea53356d tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 200 len: 1444 microversion: 2.20 time: 0.095879 Sep 05 17:26:11.280954 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1101/2045] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:11 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:11.305720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-95aabaed-9d1e-4112-b121-c6830449c5b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '.version_select at 0x7f1d3e33e790>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:11.329944 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-95aabaed-9d1e-4112-b121-c6830449c5b2 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-428398837" status: 204 len: 0 microversion: 2.20 time: 0.027975 Sep 05 17:26:11.330672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 945/2046] 10.222.0.23 () {60 vars in 1259 bytes} [Mon Sep 5 17:26:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-428398837 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 05 17:26:12.139855 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-68f227db-ae92-443a-8bbe-f19d8c1334bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Action: 'create', calling method: .version_select at 0x7f1d3abf2160>, body: {"keypair": {"name": "tempest-keypair-763857151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRtFvrwP7RpXdGXV+F3poysAZPqggtYgZBXzMPbtqrb8H1zT23SvD4Z2caub8L2uIG+AEmtBicNNBmu66MFHC7QaIziG3wymbOfFSa+CNJWwiCtvZWc6B2/mkTdJlKnvw=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:26:12.156074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-68f227db-ae92-443a-8bbe-f19d8c1334bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Getting quotas for project e933bc308b31482a9db533a7e89aeb4b. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:26:12.160650 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-68f227db-ae92-443a-8bbe-f19d8c1334bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Getting quotas for user c53ac49fbc054c01a5a1ef41e04bf253 and project e933bc308b31482a9db533a7e89aeb4b. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:26:12.186021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-68f227db-ae92-443a-8bbe-f19d8c1334bf tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050196 Sep 05 17:26:12.186697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1102/2047] 10.222.0.23 () {62 vars in 1200 bytes} [Mon Sep 5 17:26:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 05 17:26:13.530992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-771963246", "imageRef": "c1a4f3d3-4d68-489a-a57b-bae7854beb29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d006ed92-0ea2-4b32-aeec-4c7eba6dad1e"}], "security_groups": [{"name": "tempest-securitygroup--1599480545"}], "key_name": "tempest-keypair-763857151", "user_data": "}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:26:13.651709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.network.neutron [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] validate_networks() for [('d006ed92-0ea2-4b32-aeec-4c7eba6dad1e', None, None, None, None, None)] {{(pid=120733) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:26:14.166693 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Flavor limits 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:26:14.167302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Image limits 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:26:14.167828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Flavor pref 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:26:14.168308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Image pref 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:26:14.168707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:26:14.180586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:14.181060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:14.182688 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:14.184355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:14.184818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:14.185254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:14.204429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Getting quotas for project e933bc308b31482a9db533a7e89aeb4b. Resources: {'ram', 'cores', 'instances'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:26:14.208633 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Getting quotas for user c53ac49fbc054c01a5a1ef41e04bf253 and project e933bc308b31482a9db533a7e89aeb4b. Resources: {'ram', 'cores', 'instances'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:26:14.222912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Going to run 1 instances... {{(pid=120733) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:26:14.225365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a4f3d3-4d68-489a-a57b-bae7854beb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120733) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:26:14.307591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-50d471c3-c63d-42e1-a90b-27d86fc077aa tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.774185 Sep 05 17:26:14.307591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 946/2048] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Sep 5 17:26:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 05 17:26:14.310406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0a60512e-68d2-46fd-bb33-72fcac3ce0fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:14.311028 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0a60512e-68d2-46fd-bb33-72fcac3ce0fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:14.421115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0a60512e-68d2-46fd-bb33-72fcac3ce0fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:14.431042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0a60512e-68d2-46fd-bb33-72fcac3ce0fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:14.433930 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0a60512e-68d2-46fd-bb33-72fcac3ce0fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:14.435487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0a60512e-68d2-46fd-bb33-72fcac3ce0fd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 200 len: 1280 microversion: 2.20 time: 0.129787 Sep 05 17:26:14.436720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1103/2049] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:14 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 1280 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 17:26:14.762468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a7ec52ae-cc9f-47f9-9c6c-64f593b5a92d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:14.763025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a7ec52ae-cc9f-47f9-9c6c-64f593b5a92d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:14.773670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7ec52ae-cc9f-47f9-9c6c-64f593b5a92d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:14.774390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7ec52ae-cc9f-47f9-9c6c-64f593b5a92d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:14.775076 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7ec52ae-cc9f-47f9-9c6c-64f593b5a92d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:14.777464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7ec52ae-cc9f-47f9-9c6c-64f593b5a92d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:14.778326 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7ec52ae-cc9f-47f9-9c6c-64f593b5a92d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:14.778747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7ec52ae-cc9f-47f9-9c6c-64f593b5a92d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:14.814133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-925ea358-167f-4bd3-a59f-661a903f4f34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:14.814641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-925ea358-167f-4bd3-a59f-661a903f4f34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:14.831489 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925ea358-167f-4bd3-a59f-661a903f4f34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:14.833147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925ea358-167f-4bd3-a59f-661a903f4f34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:14.833593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925ea358-167f-4bd3-a59f-661a903f4f34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:14.834307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925ea358-167f-4bd3-a59f-661a903f4f34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:14.834757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925ea358-167f-4bd3-a59f-661a903f4f34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:14.835179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925ea358-167f-4bd3-a59f-661a903f4f34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:14.843253 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a7ec52ae-cc9f-47f9-9c6c-64f593b5a92d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Going to try to terminate instance {{(pid=120733) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:26:14.873596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-925ea358-167f-4bd3-a59f-661a903f4f34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:26:14.999567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-925ea358-167f-4bd3-a59f-661a903f4f34 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 204 len: 0 microversion: 2.1 time: 0.189281 Sep 05 17:26:15.001807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1104/2050] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:26:14 2022] DELETE /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:26:15.007224 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a7ec52ae-cc9f-47f9-9c6c-64f593b5a92d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 204 len: 0 microversion: 2.1 time: 0.248391 Sep 05 17:26:15.011486 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b0f4ed38-ad3c-41e1-adef-6465806bd6f7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] Calling method '.version_select at 0x7f1d3a61e160>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:15.011984 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 947/2051] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:26:14 2022] DELETE /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:26:15.022409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8e74ce08-f1ea-4215-b8ab-e31f64bfe412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:15.023672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8e74ce08-f1ea-4215-b8ab-e31f64bfe412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:15.031674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e74ce08-f1ea-4215-b8ab-e31f64bfe412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:15.032406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e74ce08-f1ea-4215-b8ab-e31f64bfe412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:15.032882 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e74ce08-f1ea-4215-b8ab-e31f64bfe412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:15.034550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e74ce08-f1ea-4215-b8ab-e31f64bfe412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:15.035114 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e74ce08-f1ea-4215-b8ab-e31f64bfe412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:15.035540 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e74ce08-f1ea-4215-b8ab-e31f64bfe412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:15.037360 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b0f4ed38-ad3c-41e1-adef-6465806bd6f7 tempest-TestVolumeBootPattern-1331929111 tempest-TestVolumeBootPattern-1331929111-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1456766241" status: 202 len: 0 microversion: 2.1 time: 0.034122 Sep 05 17:26:15.038010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1105/2052] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Sep 5 17:26:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1456766241 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:26:15.046982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-697520db-b619-43e0-933e-44267ae8d54f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:15.047719 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-697520db-b619-43e0-933e-44267ae8d54f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:15.054769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-697520db-b619-43e0-933e-44267ae8d54f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:15.055156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-697520db-b619-43e0-933e-44267ae8d54f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:15.055672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-697520db-b619-43e0-933e-44267ae8d54f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:15.056379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-697520db-b619-43e0-933e-44267ae8d54f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:15.056831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-697520db-b619-43e0-933e-44267ae8d54f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:15.057244 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-697520db-b619-43e0-933e-44267ae8d54f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:15.329725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8e74ce08-f1ea-4215-b8ab-e31f64bfe412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:15.342061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8e74ce08-f1ea-4215-b8ab-e31f64bfe412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.327955 Sep 05 17:26:15.348963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 948/2053] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:15 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:15.350533 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-697520db-b619-43e0-933e-44267ae8d54f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:15.359766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-697520db-b619-43e0-933e-44267ae8d54f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.320750 Sep 05 17:26:15.367200 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1106/2054] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:15 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:15.461392 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c61e4c05-4a8f-49de-8fa4-520344ebbcec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:15.462075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c61e4c05-4a8f-49de-8fa4-520344ebbcec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:15.468984 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c61e4c05-4a8f-49de-8fa4-520344ebbcec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:15.469545 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c61e4c05-4a8f-49de-8fa4-520344ebbcec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:15.470043 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c61e4c05-4a8f-49de-8fa4-520344ebbcec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:15.470829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c61e4c05-4a8f-49de-8fa4-520344ebbcec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:15.471344 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c61e4c05-4a8f-49de-8fa4-520344ebbcec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:15.471831 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c61e4c05-4a8f-49de-8fa4-520344ebbcec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:15.541302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c61e4c05-4a8f-49de-8fa4-520344ebbcec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:15.550007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c61e4c05-4a8f-49de-8fa4-520344ebbcec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:15.551788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c61e4c05-4a8f-49de-8fa4-520344ebbcec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:15.553062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c61e4c05-4a8f-49de-8fa4-520344ebbcec tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 200 len: 1332 microversion: 2.20 time: 0.095573 Sep 05 17:26:15.561287 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 949/2055] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:15 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:16.365679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9084bee5-d78c-4635-a734-0bd96ad67976 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:16.366315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9084bee5-d78c-4635-a734-0bd96ad67976 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:16.374112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9084bee5-d78c-4635-a734-0bd96ad67976 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:16.374857 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9084bee5-d78c-4635-a734-0bd96ad67976 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:16.375479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9084bee5-d78c-4635-a734-0bd96ad67976 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:16.376406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9084bee5-d78c-4635-a734-0bd96ad67976 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:16.377022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9084bee5-d78c-4635-a734-0bd96ad67976 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:16.377630 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9084bee5-d78c-4635-a734-0bd96ad67976 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:16.386142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-79ec93df-5437-405b-ab65-4b7b48ccc956 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:16.387645 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-79ec93df-5437-405b-ab65-4b7b48ccc956 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:16.394840 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79ec93df-5437-405b-ab65-4b7b48ccc956 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:16.395668 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79ec93df-5437-405b-ab65-4b7b48ccc956 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:16.396283 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79ec93df-5437-405b-ab65-4b7b48ccc956 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:16.397423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79ec93df-5437-405b-ab65-4b7b48ccc956 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:16.398055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79ec93df-5437-405b-ab65-4b7b48ccc956 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:16.398621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79ec93df-5437-405b-ab65-4b7b48ccc956 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:16.584556 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9084bee5-d78c-4635-a734-0bd96ad67976 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:16.586628 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-79ec93df-5437-405b-ab65-4b7b48ccc956 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:16.590662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:26:16.595780 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9084bee5-d78c-4635-a734-0bd96ad67976 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.234035 Sep 05 17:26:16.596389 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-79ec93df-5437-405b-ab65-4b7b48ccc956 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.214954 Sep 05 17:26:16.596973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 950/2056] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:16 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:16.605611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b32130e5-ce91-4ba4-bca0-26a6e4dc5fc8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:16.606057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1107/2057] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:16 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:16.606815 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b32130e5-ce91-4ba4-bca0-26a6e4dc5fc8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:16.617099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b32130e5-ce91-4ba4-bca0-26a6e4dc5fc8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:16.617587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b32130e5-ce91-4ba4-bca0-26a6e4dc5fc8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:16.618020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b32130e5-ce91-4ba4-bca0-26a6e4dc5fc8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:16.618980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b32130e5-ce91-4ba4-bca0-26a6e4dc5fc8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:16.619433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b32130e5-ce91-4ba4-bca0-26a6e4dc5fc8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:16.619855 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b32130e5-ce91-4ba4-bca0-26a6e4dc5fc8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:16.688946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b32130e5-ce91-4ba4-bca0-26a6e4dc5fc8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:16.697359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b32130e5-ce91-4ba4-bca0-26a6e4dc5fc8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:16.698833 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b32130e5-ce91-4ba4-bca0-26a6e4dc5fc8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:16.699938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b32130e5-ce91-4ba4-bca0-26a6e4dc5fc8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 200 len: 1338 microversion: 2.20 time: 0.101768 Sep 05 17:26:16.700902 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 951/2058] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:16 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 1338 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:17.621321 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a8545fba-8637-440f-939f-83b91f420ca0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:17.621868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-874e5b7f-c69e-4ba9-86be-8f8610e2a9b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:17.622270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-874e5b7f-c69e-4ba9-86be-8f8610e2a9b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:17.622500 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a8545fba-8637-440f-939f-83b91f420ca0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:17.629372 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8545fba-8637-440f-939f-83b91f420ca0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:17.629624 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-874e5b7f-c69e-4ba9-86be-8f8610e2a9b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:17.630042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8545fba-8637-440f-939f-83b91f420ca0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:17.630168 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-874e5b7f-c69e-4ba9-86be-8f8610e2a9b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:17.630526 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-874e5b7f-c69e-4ba9-86be-8f8610e2a9b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:17.630921 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8545fba-8637-440f-939f-83b91f420ca0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:17.631216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-874e5b7f-c69e-4ba9-86be-8f8610e2a9b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:17.631684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-874e5b7f-c69e-4ba9-86be-8f8610e2a9b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:17.631861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8545fba-8637-440f-939f-83b91f420ca0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:17.632394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8545fba-8637-440f-939f-83b91f420ca0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:17.632506 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-874e5b7f-c69e-4ba9-86be-8f8610e2a9b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:17.632826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8545fba-8637-440f-939f-83b91f420ca0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:17.859823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-874e5b7f-c69e-4ba9-86be-8f8610e2a9b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:17.860630 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a8545fba-8637-440f-939f-83b91f420ca0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:17.869554 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a8545fba-8637-440f-939f-83b91f420ca0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.252740 Sep 05 17:26:17.876580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1108/2059] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:17 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:17.882696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ebda1548-bd0b-4f50-bb08-8cd58bd8b7cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:17.883223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ebda1548-bd0b-4f50-bb08-8cd58bd8b7cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:17.884648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-874e5b7f-c69e-4ba9-86be-8f8610e2a9b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.267364 Sep 05 17:26:17.899583 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ebda1548-bd0b-4f50-bb08-8cd58bd8b7cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:17.900723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ebda1548-bd0b-4f50-bb08-8cd58bd8b7cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:17.901120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 952/2060] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:17 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:26:17.901492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ebda1548-bd0b-4f50-bb08-8cd58bd8b7cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:17.902383 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ebda1548-bd0b-4f50-bb08-8cd58bd8b7cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:17.902833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ebda1548-bd0b-4f50-bb08-8cd58bd8b7cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:17.903251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ebda1548-bd0b-4f50-bb08-8cd58bd8b7cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:17.918275 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:26:18.057775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ebda1548-bd0b-4f50-bb08-8cd58bd8b7cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:18.067061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ebda1548-bd0b-4f50-bb08-8cd58bd8b7cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:18.068567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ebda1548-bd0b-4f50-bb08-8cd58bd8b7cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:18.069686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ebda1548-bd0b-4f50-bb08-8cd58bd8b7cd tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 200 len: 1406 microversion: 2.20 time: 0.191954 Sep 05 17:26:18.070413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1109/2061] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:17 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:18.717385 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-ed0b08c7-c5df-4bb2-b616-fd03e3502d41 req-c9769cb2-a736-4808-82b5-b62275b0e417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4a9521e-4081-4432-b0c7-c8e5fca8eb38", "tag": "7d125039-8903-48e4-801f-49457fc5f7e4"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:26:18.729251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-ed0b08c7-c5df-4bb2-b616-fd03e3502d41 req-c9769cb2-a736-4808-82b5-b62275b0e417 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:18.730048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-ed0b08c7-c5df-4bb2-b616-fd03e3502d41 req-c9769cb2-a736-4808-82b5-b62275b0e417 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:18.730721 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-ed0b08c7-c5df-4bb2-b616-fd03e3502d41 req-c9769cb2-a736-4808-82b5-b62275b0e417 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:18.743663 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-ed0b08c7-c5df-4bb2-b616-fd03e3502d41 req-c9769cb2-a736-4808-82b5-b62275b0e417 service nova] Creating event network-changed:7d125039-8903-48e4-801f-49457fc5f7e4 for instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 on hv-cinder-85596 Sep 05 17:26:18.749391 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-ed0b08c7-c5df-4bb2-b616-fd03e3502d41 req-c9769cb2-a736-4808-82b5-b62275b0e417 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099747 Sep 05 17:26:18.750420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 953/2062] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:26:18.903077 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cd3f10df-6d7d-4b62-98ce-da6d491e539d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:18.903535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cd3f10df-6d7d-4b62-98ce-da6d491e539d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:18.910439 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9612acb5-3fbe-4247-b8bd-4085346ff32c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:18.910720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd3f10df-6d7d-4b62-98ce-da6d491e539d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:18.911033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd3f10df-6d7d-4b62-98ce-da6d491e539d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:18.911207 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9612acb5-3fbe-4247-b8bd-4085346ff32c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:18.911550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd3f10df-6d7d-4b62-98ce-da6d491e539d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:18.912283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd3f10df-6d7d-4b62-98ce-da6d491e539d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:18.912738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd3f10df-6d7d-4b62-98ce-da6d491e539d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:18.913301 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd3f10df-6d7d-4b62-98ce-da6d491e539d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:18.920417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9612acb5-3fbe-4247-b8bd-4085346ff32c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:18.921305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9612acb5-3fbe-4247-b8bd-4085346ff32c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:18.921950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9612acb5-3fbe-4247-b8bd-4085346ff32c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:18.922926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9612acb5-3fbe-4247-b8bd-4085346ff32c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:18.923535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9612acb5-3fbe-4247-b8bd-4085346ff32c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:18.924117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9612acb5-3fbe-4247-b8bd-4085346ff32c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:19.117246 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cd3f10df-6d7d-4b62-98ce-da6d491e539d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:19.128686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cd3f10df-6d7d-4b62-98ce-da6d491e539d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.229765 Sep 05 17:26:19.135154 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9612acb5-3fbe-4247-b8bd-4085346ff32c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:19.137979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1110/2063] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:18 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:19.145985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f5fcea31-ff07-4fd1-a47c-805d33116508 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:19.153527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f5fcea31-ff07-4fd1-a47c-805d33116508 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:19.157329 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9612acb5-3fbe-4247-b8bd-4085346ff32c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.251282 Sep 05 17:26:19.160725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 954/2064] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:18 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:19.166786 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5fcea31-ff07-4fd1-a47c-805d33116508 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:19.167342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5fcea31-ff07-4fd1-a47c-805d33116508 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:19.167834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5fcea31-ff07-4fd1-a47c-805d33116508 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:19.168655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5fcea31-ff07-4fd1-a47c-805d33116508 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:19.169148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5fcea31-ff07-4fd1-a47c-805d33116508 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:19.169623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5fcea31-ff07-4fd1-a47c-805d33116508 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:19.328662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f5fcea31-ff07-4fd1-a47c-805d33116508 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:19.337776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f5fcea31-ff07-4fd1-a47c-805d33116508 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:19.339234 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f5fcea31-ff07-4fd1-a47c-805d33116508 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:19.340482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f5fcea31-ff07-4fd1-a47c-805d33116508 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 200 len: 1406 microversion: 2.20 time: 0.201329 Sep 05 17:26:19.341029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1111/2065] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:19 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:20.152276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-592be1fb-e08f-4210-bc90-a0089697dc30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:20.152918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-592be1fb-e08f-4210-bc90-a0089697dc30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:20.159555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-592be1fb-e08f-4210-bc90-a0089697dc30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:20.160285 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-592be1fb-e08f-4210-bc90-a0089697dc30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:20.160888 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-592be1fb-e08f-4210-bc90-a0089697dc30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:20.161764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-592be1fb-e08f-4210-bc90-a0089697dc30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:20.162379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-592be1fb-e08f-4210-bc90-a0089697dc30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:20.162965 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-592be1fb-e08f-4210-bc90-a0089697dc30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:20.192369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-38ca6c59-6208-4803-a512-64d24c2da3d1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:20.192938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-38ca6c59-6208-4803-a512-64d24c2da3d1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:20.200019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38ca6c59-6208-4803-a512-64d24c2da3d1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:20.200833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38ca6c59-6208-4803-a512-64d24c2da3d1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:20.201275 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38ca6c59-6208-4803-a512-64d24c2da3d1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:20.202162 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38ca6c59-6208-4803-a512-64d24c2da3d1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:20.202537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38ca6c59-6208-4803-a512-64d24c2da3d1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:20.202991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38ca6c59-6208-4803-a512-64d24c2da3d1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:20.454510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-592be1fb-e08f-4210-bc90-a0089697dc30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:20.462910 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-592be1fb-e08f-4210-bc90-a0089697dc30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.314670 Sep 05 17:26:20.463501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 955/2066] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:20 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:20.472794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-162e3c3c-c21c-4e31-8e40-e88268fea34b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:20.473629 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-162e3c3c-c21c-4e31-8e40-e88268fea34b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:20.480483 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-162e3c3c-c21c-4e31-8e40-e88268fea34b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:20.481274 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-162e3c3c-c21c-4e31-8e40-e88268fea34b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:20.481711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-162e3c3c-c21c-4e31-8e40-e88268fea34b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:20.482655 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-162e3c3c-c21c-4e31-8e40-e88268fea34b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:20.483071 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-162e3c3c-c21c-4e31-8e40-e88268fea34b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:20.483517 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-162e3c3c-c21c-4e31-8e40-e88268fea34b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:20.491979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-38ca6c59-6208-4803-a512-64d24c2da3d1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:20.500606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-38ca6c59-6208-4803-a512-64d24c2da3d1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.319366 Sep 05 17:26:20.501499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1112/2067] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:20 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:20.621970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-162e3c3c-c21c-4e31-8e40-e88268fea34b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:20.630514 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-162e3c3c-c21c-4e31-8e40-e88268fea34b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:20.631970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-162e3c3c-c21c-4e31-8e40-e88268fea34b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:20.633116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-162e3c3c-c21c-4e31-8e40-e88268fea34b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 200 len: 1406 microversion: 2.20 time: 0.168378 Sep 05 17:26:20.633685 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 956/2068] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:20 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:21.488450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a29a3f35-9d31-457e-adca-bc0e8791c67a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:21.489760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a29a3f35-9d31-457e-adca-bc0e8791c67a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:21.500136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a29a3f35-9d31-457e-adca-bc0e8791c67a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:21.500726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a29a3f35-9d31-457e-adca-bc0e8791c67a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:21.501240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a29a3f35-9d31-457e-adca-bc0e8791c67a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:21.501998 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a29a3f35-9d31-457e-adca-bc0e8791c67a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:21.502505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a29a3f35-9d31-457e-adca-bc0e8791c67a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:21.503134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a29a3f35-9d31-457e-adca-bc0e8791c67a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:21.527069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-95942adc-3731-41e7-9f39-b8d391fa388f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:21.527821 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-95942adc-3731-41e7-9f39-b8d391fa388f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:21.534324 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95942adc-3731-41e7-9f39-b8d391fa388f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:21.535528 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95942adc-3731-41e7-9f39-b8d391fa388f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:21.535959 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95942adc-3731-41e7-9f39-b8d391fa388f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:21.536884 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95942adc-3731-41e7-9f39-b8d391fa388f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:21.537507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95942adc-3731-41e7-9f39-b8d391fa388f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:21.538114 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-95942adc-3731-41e7-9f39-b8d391fa388f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:21.695610 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a29a3f35-9d31-457e-adca-bc0e8791c67a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:21.705303 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a29a3f35-9d31-457e-adca-bc0e8791c67a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.220477 Sep 05 17:26:21.716446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1113/2069] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:21 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:21.723308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-95942adc-3731-41e7-9f39-b8d391fa388f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:21.727122 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a0c4db1b-f36d-4e4c-a43d-5835b7fbed0b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:21.728201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a0c4db1b-f36d-4e4c-a43d-5835b7fbed0b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:21.732541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-95942adc-3731-41e7-9f39-b8d391fa388f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.210511 Sep 05 17:26:21.733196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 957/2070] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:21 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:26:21.734564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0c4db1b-f36d-4e4c-a43d-5835b7fbed0b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:21.735049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0c4db1b-f36d-4e4c-a43d-5835b7fbed0b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:21.735464 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0c4db1b-f36d-4e4c-a43d-5835b7fbed0b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:21.736356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0c4db1b-f36d-4e4c-a43d-5835b7fbed0b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:21.737017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0c4db1b-f36d-4e4c-a43d-5835b7fbed0b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:21.737608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0c4db1b-f36d-4e4c-a43d-5835b7fbed0b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:21.876408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a0c4db1b-f36d-4e4c-a43d-5835b7fbed0b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:21.886201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a0c4db1b-f36d-4e4c-a43d-5835b7fbed0b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:21.887650 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a0c4db1b-f36d-4e4c-a43d-5835b7fbed0b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:21.888816 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a0c4db1b-f36d-4e4c-a43d-5835b7fbed0b tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 200 len: 1406 microversion: 2.20 time: 0.165483 Sep 05 17:26:21.889707 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1114/2071] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:21 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:22.731356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ec237c17-f163-4c00-a7a7-7f627b44a410 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:22.732562 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ec237c17-f163-4c00-a7a7-7f627b44a410 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:22.739509 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec237c17-f163-4c00-a7a7-7f627b44a410 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:22.739988 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec237c17-f163-4c00-a7a7-7f627b44a410 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:22.740472 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec237c17-f163-4c00-a7a7-7f627b44a410 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:22.741188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec237c17-f163-4c00-a7a7-7f627b44a410 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:22.741628 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec237c17-f163-4c00-a7a7-7f627b44a410 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:22.742035 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec237c17-f163-4c00-a7a7-7f627b44a410 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:22.758841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-42253cc1-641b-4fd5-a125-d888ed360ef8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:22.764341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-42253cc1-641b-4fd5-a125-d888ed360ef8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:22.774581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42253cc1-641b-4fd5-a125-d888ed360ef8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:22.775652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42253cc1-641b-4fd5-a125-d888ed360ef8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:22.776497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42253cc1-641b-4fd5-a125-d888ed360ef8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:22.777442 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42253cc1-641b-4fd5-a125-d888ed360ef8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:22.778005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42253cc1-641b-4fd5-a125-d888ed360ef8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:22.778544 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42253cc1-641b-4fd5-a125-d888ed360ef8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:22.939612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ec237c17-f163-4c00-a7a7-7f627b44a410 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:22.949144 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ec237c17-f163-4c00-a7a7-7f627b44a410 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.222907 Sep 05 17:26:22.950055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 958/2072] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:22 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:22.955766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8378941c-f48b-43d0-b657-a7756f6ac1cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:22.956738 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8378941c-f48b-43d0-b657-a7756f6ac1cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:22.959342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-42253cc1-641b-4fd5-a125-d888ed360ef8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:22.965390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8378941c-f48b-43d0-b657-a7756f6ac1cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:22.966176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8378941c-f48b-43d0-b657-a7756f6ac1cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:22.967039 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8378941c-f48b-43d0-b657-a7756f6ac1cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:22.967812 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8378941c-f48b-43d0-b657-a7756f6ac1cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:22.968378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8378941c-f48b-43d0-b657-a7756f6ac1cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:22.968873 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8378941c-f48b-43d0-b657-a7756f6ac1cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:22.973732 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-42253cc1-641b-4fd5-a125-d888ed360ef8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.219776 Sep 05 17:26:22.974347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1115/2073] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:22 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:23.105934 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8378941c-f48b-43d0-b657-a7756f6ac1cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:23.115418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8378941c-f48b-43d0-b657-a7756f6ac1cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:23.117011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8378941c-f48b-43d0-b657-a7756f6ac1cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:23.118178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8378941c-f48b-43d0-b657-a7756f6ac1cb tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 200 len: 1406 microversion: 2.20 time: 0.166757 Sep 05 17:26:23.125815 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 959/2074] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:22 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:23.973815 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-43449dcb-39ec-414b-8aac-c620ac1f66e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:23.974249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-43449dcb-39ec-414b-8aac-c620ac1f66e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:23.982590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43449dcb-39ec-414b-8aac-c620ac1f66e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:23.983147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43449dcb-39ec-414b-8aac-c620ac1f66e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:23.983608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43449dcb-39ec-414b-8aac-c620ac1f66e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:23.984791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43449dcb-39ec-414b-8aac-c620ac1f66e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:23.985448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43449dcb-39ec-414b-8aac-c620ac1f66e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:23.986052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43449dcb-39ec-414b-8aac-c620ac1f66e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:24.001198 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ae385a6a-94a3-4d4e-8241-89cfcd9110a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:24.001725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ae385a6a-94a3-4d4e-8241-89cfcd9110a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:24.011599 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ae385a6a-94a3-4d4e-8241-89cfcd9110a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:24.012332 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ae385a6a-94a3-4d4e-8241-89cfcd9110a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:24.012983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ae385a6a-94a3-4d4e-8241-89cfcd9110a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:24.013861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ae385a6a-94a3-4d4e-8241-89cfcd9110a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:24.014482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ae385a6a-94a3-4d4e-8241-89cfcd9110a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:24.015098 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ae385a6a-94a3-4d4e-8241-89cfcd9110a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:24.193031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=2 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:26:24.208536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ae385a6a-94a3-4d4e-8241-89cfcd9110a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:24.210781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-43449dcb-39ec-414b-8aac-c620ac1f66e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:24.218396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ae385a6a-94a3-4d4e-8241-89cfcd9110a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.224811 Sep 05 17:26:24.219350 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 960/2075] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:23 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:24.220030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-43449dcb-39ec-414b-8aac-c620ac1f66e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.250610 Sep 05 17:26:24.220918 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1116/2076] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:23 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:24.224131 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c60ae581-02f3-46ab-ad5a-8b4f0fabc54e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:24.224903 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c60ae581-02f3-46ab-ad5a-8b4f0fabc54e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:24.226894 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=6 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:26:24.233413 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c60ae581-02f3-46ab-ad5a-8b4f0fabc54e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:24.234116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c60ae581-02f3-46ab-ad5a-8b4f0fabc54e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:24.234573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c60ae581-02f3-46ab-ad5a-8b4f0fabc54e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:24.235251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c60ae581-02f3-46ab-ad5a-8b4f0fabc54e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:24.235696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c60ae581-02f3-46ab-ad5a-8b4f0fabc54e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:24.236273 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c60ae581-02f3-46ab-ad5a-8b4f0fabc54e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:24.563968 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c60ae581-02f3-46ab-ad5a-8b4f0fabc54e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:24.573207 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c60ae581-02f3-46ab-ad5a-8b4f0fabc54e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:24.574796 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c60ae581-02f3-46ab-ad5a-8b4f0fabc54e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:24.576016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c60ae581-02f3-46ab-ad5a-8b4f0fabc54e tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 200 len: 1406 microversion: 2.20 time: 0.355543 Sep 05 17:26:24.576643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 961/2077] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:24 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:25.241223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8fddba78-9789-4b12-bba2-010614a0c74f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:25.242020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8fddba78-9789-4b12-bba2-010614a0c74f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:25.244177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=6 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:26:25.245581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4fda8e6a-8cbc-40fb-a6a7-d836fb427514 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:25.246213 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4fda8e6a-8cbc-40fb-a6a7-d836fb427514 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:25.250675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fddba78-9789-4b12-bba2-010614a0c74f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:25.251297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fddba78-9789-4b12-bba2-010614a0c74f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:25.251814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fddba78-9789-4b12-bba2-010614a0c74f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:25.252744 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fddba78-9789-4b12-bba2-010614a0c74f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:25.253114 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4fda8e6a-8cbc-40fb-a6a7-d836fb427514 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:25.253566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fddba78-9789-4b12-bba2-010614a0c74f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:25.253716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4fda8e6a-8cbc-40fb-a6a7-d836fb427514 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:25.254017 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4fda8e6a-8cbc-40fb-a6a7-d836fb427514 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:25.254506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fddba78-9789-4b12-bba2-010614a0c74f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:25.254711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4fda8e6a-8cbc-40fb-a6a7-d836fb427514 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:25.255534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4fda8e6a-8cbc-40fb-a6a7-d836fb427514 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:25.256730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4fda8e6a-8cbc-40fb-a6a7-d836fb427514 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:25.685193 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4fda8e6a-8cbc-40fb-a6a7-d836fb427514 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:25.689316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8fddba78-9789-4b12-bba2-010614a0c74f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:25.693676 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4fda8e6a-8cbc-40fb-a6a7-d836fb427514 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.452281 Sep 05 17:26:25.694218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 962/2078] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:25 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:26:25.698072 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8fddba78-9789-4b12-bba2-010614a0c74f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.460729 Sep 05 17:26:25.708253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1117/2079] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:25 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:25.708411 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-675bda2e-2e29-4a6b-9708-379821efa5cd req-5660483d-6849-4583-89c6-16e0d2259dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a9521e-4081-4432-b0c7-c8e5fca8eb38", "name": "network-vif-plugged", "status": "completed", "tag": "7d125039-8903-48e4-801f-49457fc5f7e4"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:26:25.711808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-675bda2e-2e29-4a6b-9708-379821efa5cd req-5660483d-6849-4583-89c6-16e0d2259dfe service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:25.711981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a9312ca8-88b2-40cb-a39b-7ac2eb9cf0a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:25.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-675bda2e-2e29-4a6b-9708-379821efa5cd req-5660483d-6849-4583-89c6-16e0d2259dfe service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:25.712861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a9312ca8-88b2-40cb-a39b-7ac2eb9cf0a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:25.713061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-675bda2e-2e29-4a6b-9708-379821efa5cd req-5660483d-6849-4583-89c6-16e0d2259dfe service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:25.715037 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:26:25.721042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9312ca8-88b2-40cb-a39b-7ac2eb9cf0a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:25.721529 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9312ca8-88b2-40cb-a39b-7ac2eb9cf0a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:25.721965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9312ca8-88b2-40cb-a39b-7ac2eb9cf0a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:25.722689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9312ca8-88b2-40cb-a39b-7ac2eb9cf0a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:25.723171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9312ca8-88b2-40cb-a39b-7ac2eb9cf0a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:25.723593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9312ca8-88b2-40cb-a39b-7ac2eb9cf0a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:25.724770 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-675bda2e-2e29-4a6b-9708-379821efa5cd req-5660483d-6849-4583-89c6-16e0d2259dfe service nova] Creating event network-vif-plugged:7d125039-8903-48e4-801f-49457fc5f7e4 for instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 on hv-cinder-85596 Sep 05 17:26:25.730150 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-675bda2e-2e29-4a6b-9708-379821efa5cd req-5660483d-6849-4583-89c6-16e0d2259dfe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034786 Sep 05 17:26:25.730787 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 963/2080] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:26:25.864074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a9312ca8-88b2-40cb-a39b-7ac2eb9cf0a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:25.874074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a9312ca8-88b2-40cb-a39b-7ac2eb9cf0a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:25.875530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a9312ca8-88b2-40cb-a39b-7ac2eb9cf0a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:25.876683 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a9312ca8-88b2-40cb-a39b-7ac2eb9cf0a3 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 200 len: 1406 microversion: 2.20 time: 0.177118 Sep 05 17:26:25.877250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1118/2081] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:25 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:26.719743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b6e12e85-9383-4e45-9c77-133ba475f664 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:26.720398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b6e12e85-9383-4e45-9c77-133ba475f664 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:26.722252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1cbc1a18-e343-4e88-a25e-76ccc540a0d8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:26.722698 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:26:26.722839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1cbc1a18-e343-4e88-a25e-76ccc540a0d8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:26.729722 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b6e12e85-9383-4e45-9c77-133ba475f664 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:26.730183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b6e12e85-9383-4e45-9c77-133ba475f664 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:26.730603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b6e12e85-9383-4e45-9c77-133ba475f664 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:26.731287 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cbc1a18-e343-4e88-a25e-76ccc540a0d8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:26.731410 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b6e12e85-9383-4e45-9c77-133ba475f664 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:26.731730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b6e12e85-9383-4e45-9c77-133ba475f664 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:26.731839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cbc1a18-e343-4e88-a25e-76ccc540a0d8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:26.732136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b6e12e85-9383-4e45-9c77-133ba475f664 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:26.732264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cbc1a18-e343-4e88-a25e-76ccc540a0d8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:26.732902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cbc1a18-e343-4e88-a25e-76ccc540a0d8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:26.733367 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cbc1a18-e343-4e88-a25e-76ccc540a0d8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:26.733774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cbc1a18-e343-4e88-a25e-76ccc540a0d8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:26.924485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1cbc1a18-e343-4e88-a25e-76ccc540a0d8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:26.927688 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b6e12e85-9383-4e45-9c77-133ba475f664 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:26.933054 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1cbc1a18-e343-4e88-a25e-76ccc540a0d8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.215234 Sep 05 17:26:26.944169 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1119/2082] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:26 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:26.944355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b6e12e85-9383-4e45-9c77-133ba475f664 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.222390 Sep 05 17:26:26.944355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 964/2083] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:26 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:26.944548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8007d9b8-e8e5-466b-b2d9-ba14e0a03aac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:26.944548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8007d9b8-e8e5-466b-b2d9-ba14e0a03aac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:26.945327 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8007d9b8-e8e5-466b-b2d9-ba14e0a03aac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:26.946543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8007d9b8-e8e5-466b-b2d9-ba14e0a03aac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:26.947045 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8007d9b8-e8e5-466b-b2d9-ba14e0a03aac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:26.947813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8007d9b8-e8e5-466b-b2d9-ba14e0a03aac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:26.948360 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8007d9b8-e8e5-466b-b2d9-ba14e0a03aac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:26.948854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8007d9b8-e8e5-466b-b2d9-ba14e0a03aac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:27.100216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8007d9b8-e8e5-466b-b2d9-ba14e0a03aac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:27.110210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8007d9b8-e8e5-466b-b2d9-ba14e0a03aac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:27.111664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8007d9b8-e8e5-466b-b2d9-ba14e0a03aac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:27.112835 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8007d9b8-e8e5-466b-b2d9-ba14e0a03aac tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 200 len: 1406 microversion: 2.20 time: 0.177952 Sep 05 17:26:27.113379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1120/2084] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:26 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:27.959270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c570374d-47f8-40dd-8bc0-d01189b5ea67 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:27.960025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c570374d-47f8-40dd-8bc0-d01189b5ea67 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:27.962650 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9afeff3f-7f3a-4522-91b8-2883ff159ff7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:27.963705 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9afeff3f-7f3a-4522-91b8-2883ff159ff7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:27.968269 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c570374d-47f8-40dd-8bc0-d01189b5ea67 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:27.968820 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c570374d-47f8-40dd-8bc0-d01189b5ea67 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:27.969161 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c570374d-47f8-40dd-8bc0-d01189b5ea67 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:27.969857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c570374d-47f8-40dd-8bc0-d01189b5ea67 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:27.970304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c570374d-47f8-40dd-8bc0-d01189b5ea67 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:27.970470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9afeff3f-7f3a-4522-91b8-2883ff159ff7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:27.970744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c570374d-47f8-40dd-8bc0-d01189b5ea67 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:27.970893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9afeff3f-7f3a-4522-91b8-2883ff159ff7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:27.971265 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9afeff3f-7f3a-4522-91b8-2883ff159ff7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:27.971947 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9afeff3f-7f3a-4522-91b8-2883ff159ff7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:27.972429 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9afeff3f-7f3a-4522-91b8-2883ff159ff7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:27.973184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9afeff3f-7f3a-4522-91b8-2883ff159ff7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:28.159741 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c570374d-47f8-40dd-8bc0-d01189b5ea67 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:28.164227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9afeff3f-7f3a-4522-91b8-2883ff159ff7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:28.169094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c570374d-47f8-40dd-8bc0-d01189b5ea67 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.215140 Sep 05 17:26:28.169660 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 965/2085] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:27 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:28.173783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9afeff3f-7f3a-4522-91b8-2883ff159ff7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.216836 Sep 05 17:26:28.174085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a899f112-7199-48b7-9909-2523a4b4ffef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:28.174694 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a899f112-7199-48b7-9909-2523a4b4ffef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:28.175013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1121/2086] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:27 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:28.181378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a899f112-7199-48b7-9909-2523a4b4ffef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:28.181988 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a899f112-7199-48b7-9909-2523a4b4ffef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:28.182624 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a899f112-7199-48b7-9909-2523a4b4ffef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:28.183315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a899f112-7199-48b7-9909-2523a4b4ffef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:28.183763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a899f112-7199-48b7-9909-2523a4b4ffef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:28.184185 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a899f112-7199-48b7-9909-2523a4b4ffef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:28.317313 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a899f112-7199-48b7-9909-2523a4b4ffef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:28.326010 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a899f112-7199-48b7-9909-2523a4b4ffef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:28.327452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a899f112-7199-48b7-9909-2523a4b4ffef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:28.328658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a899f112-7199-48b7-9909-2523a4b4ffef tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 200 len: 1598 microversion: 2.20 time: 0.158062 Sep 05 17:26:28.329215 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 966/2087] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:26:28 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:26:28.355129 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f7d4fb01-2110-4e3a-b9a7-5310da7f55c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:28.355624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f7d4fb01-2110-4e3a-b9a7-5310da7f55c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:28.362296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7d4fb01-2110-4e3a-b9a7-5310da7f55c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:28.362779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7d4fb01-2110-4e3a-b9a7-5310da7f55c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:28.363307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7d4fb01-2110-4e3a-b9a7-5310da7f55c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:28.364026 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7d4fb01-2110-4e3a-b9a7-5310da7f55c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:28.364512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7d4fb01-2110-4e3a-b9a7-5310da7f55c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:28.364932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7d4fb01-2110-4e3a-b9a7-5310da7f55c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:28.450926 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f7d4fb01-2110-4e3a-b9a7-5310da7f55c6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100841 Sep 05 17:26:28.451702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1122/2088] 10.222.0.23 () {60 vars in 1316 bytes} [Mon Sep 5 17:26:28 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:26:29.193237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-33c74470-9d01-4253-b2dc-5d811e6c75fd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:29.193966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-33c74470-9d01-4253-b2dc-5d811e6c75fd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:29.197730 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fb61a8b2-6632-4877-a053-bc3228cf4765 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:29.198538 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fb61a8b2-6632-4877-a053-bc3228cf4765 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:29.201874 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33c74470-9d01-4253-b2dc-5d811e6c75fd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:29.202361 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33c74470-9d01-4253-b2dc-5d811e6c75fd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:29.202784 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33c74470-9d01-4253-b2dc-5d811e6c75fd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:29.203662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33c74470-9d01-4253-b2dc-5d811e6c75fd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:29.204444 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33c74470-9d01-4253-b2dc-5d811e6c75fd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:29.204872 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-33c74470-9d01-4253-b2dc-5d811e6c75fd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:29.205140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb61a8b2-6632-4877-a053-bc3228cf4765 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:29.205811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb61a8b2-6632-4877-a053-bc3228cf4765 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:29.206412 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb61a8b2-6632-4877-a053-bc3228cf4765 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:29.207254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb61a8b2-6632-4877-a053-bc3228cf4765 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:29.207863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb61a8b2-6632-4877-a053-bc3228cf4765 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:29.208655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb61a8b2-6632-4877-a053-bc3228cf4765 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:29.439024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fb61a8b2-6632-4877-a053-bc3228cf4765 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:29.448029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fb61a8b2-6632-4877-a053-bc3228cf4765 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.253992 Sep 05 17:26:29.448658 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1123/2089] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:29 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:29.474175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-33c74470-9d01-4253-b2dc-5d811e6c75fd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:29.482858 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-33c74470-9d01-4253-b2dc-5d811e6c75fd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.293771 Sep 05 17:26:29.483506 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 967/2090] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:29 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:29.582008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-b95d06b8-fb40-45d3-ad88-ad7a8e36d4bc req-483799c6-ad83-4cc0-a66e-214903344532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4a9521e-4081-4432-b0c7-c8e5fca8eb38", "tag": "7d125039-8903-48e4-801f-49457fc5f7e4"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:26:29.592220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-b95d06b8-fb40-45d3-ad88-ad7a8e36d4bc req-483799c6-ad83-4cc0-a66e-214903344532 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:29.592713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-b95d06b8-fb40-45d3-ad88-ad7a8e36d4bc req-483799c6-ad83-4cc0-a66e-214903344532 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:29.593109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-b95d06b8-fb40-45d3-ad88-ad7a8e36d4bc req-483799c6-ad83-4cc0-a66e-214903344532 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:29.604845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-b95d06b8-fb40-45d3-ad88-ad7a8e36d4bc req-483799c6-ad83-4cc0-a66e-214903344532 service nova] Creating event network-changed:7d125039-8903-48e4-801f-49457fc5f7e4 for instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 on hv-cinder-85596 Sep 05 17:26:29.609976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-b95d06b8-fb40-45d3-ad88-ad7a8e36d4bc req-483799c6-ad83-4cc0-a66e-214903344532 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031872 Sep 05 17:26:29.610978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1124/2091] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:26:30.471596 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-23748b0a-179c-483a-a7e3-99114967ecbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:30.472300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-23748b0a-179c-483a-a7e3-99114967ecbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:30.479333 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23748b0a-179c-483a-a7e3-99114967ecbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:30.479873 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23748b0a-179c-483a-a7e3-99114967ecbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:30.480360 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23748b0a-179c-483a-a7e3-99114967ecbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:30.481023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23748b0a-179c-483a-a7e3-99114967ecbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:30.481513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23748b0a-179c-483a-a7e3-99114967ecbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:30.481935 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23748b0a-179c-483a-a7e3-99114967ecbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:30.508188 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-915b60a1-7762-4e8e-be7a-878052817688 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:30.508983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-915b60a1-7762-4e8e-be7a-878052817688 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:30.516858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-915b60a1-7762-4e8e-be7a-878052817688 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:30.517429 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-915b60a1-7762-4e8e-be7a-878052817688 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:30.517915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-915b60a1-7762-4e8e-be7a-878052817688 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:30.518736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-915b60a1-7762-4e8e-be7a-878052817688 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:30.519254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-915b60a1-7762-4e8e-be7a-878052817688 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:30.519741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-915b60a1-7762-4e8e-be7a-878052817688 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:30.676684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-23748b0a-179c-483a-a7e3-99114967ecbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:30.678964 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:26:30.688731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-23748b0a-179c-483a-a7e3-99114967ecbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.221084 Sep 05 17:26:30.689296 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 968/2092] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:30 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:30.701065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-915b60a1-7762-4e8e-be7a-878052817688 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:30.709516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-915b60a1-7762-4e8e-be7a-878052817688 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.206391 Sep 05 17:26:30.710089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1125/2093] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:30 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:31.714450 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-17117bb5-936a-446c-a494-0bfa85a1ce5c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:31.715096 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-17117bb5-936a-446c-a494-0bfa85a1ce5c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:31.722296 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17117bb5-936a-446c-a494-0bfa85a1ce5c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:31.722785 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17117bb5-936a-446c-a494-0bfa85a1ce5c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:31.723212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17117bb5-936a-446c-a494-0bfa85a1ce5c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:31.723930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17117bb5-936a-446c-a494-0bfa85a1ce5c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:31.724424 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17117bb5-936a-446c-a494-0bfa85a1ce5c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:31.724843 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17117bb5-936a-446c-a494-0bfa85a1ce5c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:31.733940 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cf8e460f-85a5-480e-a21f-12b92ce98df9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:31.734582 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cf8e460f-85a5-480e-a21f-12b92ce98df9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:31.741632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf8e460f-85a5-480e-a21f-12b92ce98df9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:31.742053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf8e460f-85a5-480e-a21f-12b92ce98df9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:31.742490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf8e460f-85a5-480e-a21f-12b92ce98df9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:31.743187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf8e460f-85a5-480e-a21f-12b92ce98df9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:31.743673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf8e460f-85a5-480e-a21f-12b92ce98df9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:31.744579 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf8e460f-85a5-480e-a21f-12b92ce98df9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:31.920186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-17117bb5-936a-446c-a494-0bfa85a1ce5c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:31.927444 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cf8e460f-85a5-480e-a21f-12b92ce98df9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:31.929076 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-17117bb5-936a-446c-a494-0bfa85a1ce5c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.220231 Sep 05 17:26:31.929655 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 969/2094] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:31 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:31.930047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:26:31.938033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cf8e460f-85a5-480e-a21f-12b92ce98df9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.207994 Sep 05 17:26:31.938620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1126/2095] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:31 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:32.957430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-25aeff00-ec23-4463-9d3e-5c902619ae1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:32.958413 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-25aeff00-ec23-4463-9d3e-5c902619ae1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:32.964667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0d536bc2-ee33-4eec-bcbb-b6c219dc6181 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:32.965314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0d536bc2-ee33-4eec-bcbb-b6c219dc6181 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:32.967809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25aeff00-ec23-4463-9d3e-5c902619ae1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:32.968325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25aeff00-ec23-4463-9d3e-5c902619ae1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:32.968772 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25aeff00-ec23-4463-9d3e-5c902619ae1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:32.969426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25aeff00-ec23-4463-9d3e-5c902619ae1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:32.969869 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25aeff00-ec23-4463-9d3e-5c902619ae1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:32.970285 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-25aeff00-ec23-4463-9d3e-5c902619ae1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:32.972889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d536bc2-ee33-4eec-bcbb-b6c219dc6181 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:32.973376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d536bc2-ee33-4eec-bcbb-b6c219dc6181 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:32.973807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d536bc2-ee33-4eec-bcbb-b6c219dc6181 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:32.974506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d536bc2-ee33-4eec-bcbb-b6c219dc6181 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:32.974961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d536bc2-ee33-4eec-bcbb-b6c219dc6181 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:32.975401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d536bc2-ee33-4eec-bcbb-b6c219dc6181 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:33.164518 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-25aeff00-ec23-4463-9d3e-5c902619ae1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:33.167049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0d536bc2-ee33-4eec-bcbb-b6c219dc6181 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:33.172833 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-25aeff00-ec23-4463-9d3e-5c902619ae1f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.222125 Sep 05 17:26:33.173457 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 970/2096] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:32 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:33.175826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0d536bc2-ee33-4eec-bcbb-b6c219dc6181 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.217070 Sep 05 17:26:33.176648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1127/2097] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:32 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:34.200630 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d881c522-8e4a-4733-832e-3aef316a1789 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:34.201188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d881c522-8e4a-4733-832e-3aef316a1789 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:34.201567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4ef59382-99f1-48dc-a12d-17c09ca9d27a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:34.202186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4ef59382-99f1-48dc-a12d-17c09ca9d27a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:34.207892 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d881c522-8e4a-4733-832e-3aef316a1789 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:34.208399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d881c522-8e4a-4733-832e-3aef316a1789 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:34.208830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d881c522-8e4a-4733-832e-3aef316a1789 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:34.209053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ef59382-99f1-48dc-a12d-17c09ca9d27a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:34.209532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d881c522-8e4a-4733-832e-3aef316a1789 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:34.209645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ef59382-99f1-48dc-a12d-17c09ca9d27a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:34.209984 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ef59382-99f1-48dc-a12d-17c09ca9d27a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:34.210155 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d881c522-8e4a-4733-832e-3aef316a1789 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:34.210399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d881c522-8e4a-4733-832e-3aef316a1789 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:34.210668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ef59382-99f1-48dc-a12d-17c09ca9d27a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:34.211125 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ef59382-99f1-48dc-a12d-17c09ca9d27a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:34.211552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ef59382-99f1-48dc-a12d-17c09ca9d27a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:34.402675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4ef59382-99f1-48dc-a12d-17c09ca9d27a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:34.405656 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d881c522-8e4a-4733-832e-3aef316a1789 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:34.411056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4ef59382-99f1-48dc-a12d-17c09ca9d27a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.214172 Sep 05 17:26:34.411765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1128/2098] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:34 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:34.414792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d881c522-8e4a-4733-832e-3aef316a1789 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.219954 Sep 05 17:26:34.415354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 971/2099] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:34 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:35.435184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fd67db5b-18df-4e04-938a-f549a94599d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:35.435801 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fd67db5b-18df-4e04-938a-f549a94599d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:35.438666 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-081d3494-dc8d-4fed-a10c-a3f9ddb5c2c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:35.439332 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-081d3494-dc8d-4fed-a10c-a3f9ddb5c2c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:35.442869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd67db5b-18df-4e04-938a-f549a94599d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:35.443564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd67db5b-18df-4e04-938a-f549a94599d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:35.443999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd67db5b-18df-4e04-938a-f549a94599d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:35.444727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd67db5b-18df-4e04-938a-f549a94599d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:35.445181 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd67db5b-18df-4e04-938a-f549a94599d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:35.445622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd67db5b-18df-4e04-938a-f549a94599d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:35.446340 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-081d3494-dc8d-4fed-a10c-a3f9ddb5c2c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:35.446830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-081d3494-dc8d-4fed-a10c-a3f9ddb5c2c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:35.447250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-081d3494-dc8d-4fed-a10c-a3f9ddb5c2c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:35.447951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-081d3494-dc8d-4fed-a10c-a3f9ddb5c2c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:35.448438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-081d3494-dc8d-4fed-a10c-a3f9ddb5c2c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:35.448860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-081d3494-dc8d-4fed-a10c-a3f9ddb5c2c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:35.648779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fd67db5b-18df-4e04-938a-f549a94599d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:35.651981 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-081d3494-dc8d-4fed-a10c-a3f9ddb5c2c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:35.658003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fd67db5b-18df-4e04-938a-f549a94599d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.227244 Sep 05 17:26:35.658645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1129/2100] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:35 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:35.661458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-081d3494-dc8d-4fed-a10c-a3f9ddb5c2c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.226675 Sep 05 17:26:35.662111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 972/2101] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:35 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:26:36.685120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fd9fb0a0-2bb9-4469-aaaa-8df5c091051f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:36.685727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fd9fb0a0-2bb9-4469-aaaa-8df5c091051f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:36.686773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0ee40d15-9181-486d-88d7-084e7e64adea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:36.687406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0ee40d15-9181-486d-88d7-084e7e64adea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:36.692684 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd9fb0a0-2bb9-4469-aaaa-8df5c091051f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:36.693344 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd9fb0a0-2bb9-4469-aaaa-8df5c091051f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:36.693849 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd9fb0a0-2bb9-4469-aaaa-8df5c091051f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:36.694226 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ee40d15-9181-486d-88d7-084e7e64adea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:36.694674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd9fb0a0-2bb9-4469-aaaa-8df5c091051f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:36.694826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ee40d15-9181-486d-88d7-084e7e64adea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:36.695130 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ee40d15-9181-486d-88d7-084e7e64adea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:36.695296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd9fb0a0-2bb9-4469-aaaa-8df5c091051f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:36.695783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd9fb0a0-2bb9-4469-aaaa-8df5c091051f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:36.695934 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ee40d15-9181-486d-88d7-084e7e64adea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:36.696339 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ee40d15-9181-486d-88d7-084e7e64adea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:36.696705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ee40d15-9181-486d-88d7-084e7e64adea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:36.887963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0ee40d15-9181-486d-88d7-084e7e64adea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:36.892214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fd9fb0a0-2bb9-4469-aaaa-8df5c091051f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:36.900950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0ee40d15-9181-486d-88d7-084e7e64adea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.218616 Sep 05 17:26:36.902116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 973/2102] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:36 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:26:36.904823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fd9fb0a0-2bb9-4469-aaaa-8df5c091051f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.225708 Sep 05 17:26:36.905601 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1130/2103] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:36 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:37.930565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ce03c4af-8edc-4337-96bd-cc8952997b65 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:37.931540 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ce03c4af-8edc-4337-96bd-cc8952997b65 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:37.931848 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-91f379d1-a03e-4d40-8d7d-e6148044df0e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:37.933892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-91f379d1-a03e-4d40-8d7d-e6148044df0e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:37.941952 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce03c4af-8edc-4337-96bd-cc8952997b65 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:37.942737 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce03c4af-8edc-4337-96bd-cc8952997b65 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:37.943507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce03c4af-8edc-4337-96bd-cc8952997b65 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:37.944616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce03c4af-8edc-4337-96bd-cc8952997b65 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:37.945362 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce03c4af-8edc-4337-96bd-cc8952997b65 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:37.945600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f379d1-a03e-4d40-8d7d-e6148044df0e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:37.946047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce03c4af-8edc-4337-96bd-cc8952997b65 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:37.946301 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f379d1-a03e-4d40-8d7d-e6148044df0e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:37.946916 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f379d1-a03e-4d40-8d7d-e6148044df0e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:37.948048 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f379d1-a03e-4d40-8d7d-e6148044df0e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:37.948870 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f379d1-a03e-4d40-8d7d-e6148044df0e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:37.949536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f379d1-a03e-4d40-8d7d-e6148044df0e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:38.361808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ce03c4af-8edc-4337-96bd-cc8952997b65 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:38.364588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-91f379d1-a03e-4d40-8d7d-e6148044df0e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:38.371303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ce03c4af-8edc-4337-96bd-cc8952997b65 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.448043 Sep 05 17:26:38.372309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 974/2104] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:37 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:38.374617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-91f379d1-a03e-4d40-8d7d-e6148044df0e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.449019 Sep 05 17:26:38.376327 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1131/2105] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:37 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:39.395801 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c89a0d4d-5cb3-45a3-bdcd-6f0e463c6f02 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:39.396477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c89a0d4d-5cb3-45a3-bdcd-6f0e463c6f02 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:39.397501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a66c0799-f89a-47ab-8560-b6c2b74ac033 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:39.398113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a66c0799-f89a-47ab-8560-b6c2b74ac033 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:39.403433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c89a0d4d-5cb3-45a3-bdcd-6f0e463c6f02 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:39.403926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c89a0d4d-5cb3-45a3-bdcd-6f0e463c6f02 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:39.404410 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c89a0d4d-5cb3-45a3-bdcd-6f0e463c6f02 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:39.405120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c89a0d4d-5cb3-45a3-bdcd-6f0e463c6f02 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:39.405534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a66c0799-f89a-47ab-8560-b6c2b74ac033 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:39.405793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c89a0d4d-5cb3-45a3-bdcd-6f0e463c6f02 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:39.406042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a66c0799-f89a-47ab-8560-b6c2b74ac033 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:39.406205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c89a0d4d-5cb3-45a3-bdcd-6f0e463c6f02 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:39.406465 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a66c0799-f89a-47ab-8560-b6c2b74ac033 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:39.407163 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a66c0799-f89a-47ab-8560-b6c2b74ac033 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:39.407613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a66c0799-f89a-47ab-8560-b6c2b74ac033 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:39.408035 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a66c0799-f89a-47ab-8560-b6c2b74ac033 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:39.603515 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c89a0d4d-5cb3-45a3-bdcd-6f0e463c6f02 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:39.609134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a66c0799-f89a-47ab-8560-b6c2b74ac033 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:39.614719 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c89a0d4d-5cb3-45a3-bdcd-6f0e463c6f02 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.222851 Sep 05 17:26:39.615297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 975/2106] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:39 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:39.618375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a66c0799-f89a-47ab-8560-b6c2b74ac033 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.224465 Sep 05 17:26:39.619248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1132/2107] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:39 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:40.646564 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-15d0e033-18d1-4453-b3ac-bb654588b6f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:40.647417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a9a6b837-17c3-4cd5-8cad-48b2724da500 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:40.647417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a9a6b837-17c3-4cd5-8cad-48b2724da500 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:40.648228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-15d0e033-18d1-4453-b3ac-bb654588b6f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:40.657147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9a6b837-17c3-4cd5-8cad-48b2724da500 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:40.657334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-15d0e033-18d1-4453-b3ac-bb654588b6f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:40.657629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9a6b837-17c3-4cd5-8cad-48b2724da500 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:40.657812 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-15d0e033-18d1-4453-b3ac-bb654588b6f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:40.658058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9a6b837-17c3-4cd5-8cad-48b2724da500 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:40.658224 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-15d0e033-18d1-4453-b3ac-bb654588b6f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:40.658754 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9a6b837-17c3-4cd5-8cad-48b2724da500 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:40.658909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-15d0e033-18d1-4453-b3ac-bb654588b6f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:40.659206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9a6b837-17c3-4cd5-8cad-48b2724da500 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:40.659388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-15d0e033-18d1-4453-b3ac-bb654588b6f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:40.659625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9a6b837-17c3-4cd5-8cad-48b2724da500 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:40.659780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-15d0e033-18d1-4453-b3ac-bb654588b6f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:40.852266 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-15d0e033-18d1-4453-b3ac-bb654588b6f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:40.854709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a9a6b837-17c3-4cd5-8cad-48b2724da500 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:40.860865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-15d0e033-18d1-4453-b3ac-bb654588b6f9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.220462 Sep 05 17:26:40.861440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 976/2108] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:40 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:40.863309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a9a6b837-17c3-4cd5-8cad-48b2724da500 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.223028 Sep 05 17:26:40.863862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1133/2109] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:40 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:41.888196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-636d6e39-9a65-41a2-a941-8ac721e99827 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:41.890182 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-636d6e39-9a65-41a2-a941-8ac721e99827 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:41.892019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f5355df0-bea0-46bb-997e-9bfbdf838304 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:41.893073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f5355df0-bea0-46bb-997e-9bfbdf838304 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:41.901422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-636d6e39-9a65-41a2-a941-8ac721e99827 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:41.902207 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-636d6e39-9a65-41a2-a941-8ac721e99827 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:41.902918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-636d6e39-9a65-41a2-a941-8ac721e99827 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:41.903871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5355df0-bea0-46bb-997e-9bfbdf838304 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:41.904087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-636d6e39-9a65-41a2-a941-8ac721e99827 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:41.905066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5355df0-bea0-46bb-997e-9bfbdf838304 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:41.905365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-636d6e39-9a65-41a2-a941-8ac721e99827 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:41.905482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5355df0-bea0-46bb-997e-9bfbdf838304 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:41.905802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-636d6e39-9a65-41a2-a941-8ac721e99827 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:41.906172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5355df0-bea0-46bb-997e-9bfbdf838304 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:41.906620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5355df0-bea0-46bb-997e-9bfbdf838304 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:41.907027 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5355df0-bea0-46bb-997e-9bfbdf838304 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:42.099958 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-636d6e39-9a65-41a2-a941-8ac721e99827 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:42.102804 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f5355df0-bea0-46bb-997e-9bfbdf838304 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:42.109444 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-636d6e39-9a65-41a2-a941-8ac721e99827 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.227812 Sep 05 17:26:42.110005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 977/2110] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:41 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:42.111169 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f5355df0-bea0-46bb-997e-9bfbdf838304 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.227001 Sep 05 17:26:42.111767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1134/2111] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:41 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:43.137315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-403ffb7f-28c4-44fd-a2ac-e462b2c8ed97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:43.138343 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-403ffb7f-28c4-44fd-a2ac-e462b2c8ed97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:43.138544 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b32f86a2-370b-479a-bf25-d138230d6a12 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:43.139619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b32f86a2-370b-479a-bf25-d138230d6a12 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:43.146343 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-403ffb7f-28c4-44fd-a2ac-e462b2c8ed97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:43.146525 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b32f86a2-370b-479a-bf25-d138230d6a12 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:43.146829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-403ffb7f-28c4-44fd-a2ac-e462b2c8ed97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:43.146985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b32f86a2-370b-479a-bf25-d138230d6a12 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:43.147288 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-403ffb7f-28c4-44fd-a2ac-e462b2c8ed97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:43.147458 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b32f86a2-370b-479a-bf25-d138230d6a12 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:43.147989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-403ffb7f-28c4-44fd-a2ac-e462b2c8ed97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:43.148133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b32f86a2-370b-479a-bf25-d138230d6a12 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:43.148470 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-403ffb7f-28c4-44fd-a2ac-e462b2c8ed97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:43.148636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b32f86a2-370b-479a-bf25-d138230d6a12 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:43.148869 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-403ffb7f-28c4-44fd-a2ac-e462b2c8ed97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:43.148986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b32f86a2-370b-479a-bf25-d138230d6a12 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:43.347154 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b32f86a2-370b-479a-bf25-d138230d6a12 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:43.351292 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-403ffb7f-28c4-44fd-a2ac-e462b2c8ed97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:43.356395 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b32f86a2-370b-479a-bf25-d138230d6a12 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.224505 Sep 05 17:26:43.357017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1135/2112] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:43 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:43.360264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-403ffb7f-28c4-44fd-a2ac-e462b2c8ed97 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.229552 Sep 05 17:26:43.360825 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 978/2113] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:43 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:44.381726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-447c7cfe-331c-4579-9ee8-1df8b9c618a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:44.382445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-447c7cfe-331c-4579-9ee8-1df8b9c618a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:44.383967 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-36d9c23b-a5e8-4323-bcdf-774241c09c82 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:44.384674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-36d9c23b-a5e8-4323-bcdf-774241c09c82 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:44.390002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-447c7cfe-331c-4579-9ee8-1df8b9c618a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:44.390482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-447c7cfe-331c-4579-9ee8-1df8b9c618a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:44.390914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-447c7cfe-331c-4579-9ee8-1df8b9c618a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:44.391600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-447c7cfe-331c-4579-9ee8-1df8b9c618a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:44.392045 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-447c7cfe-331c-4579-9ee8-1df8b9c618a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:44.392256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36d9c23b-a5e8-4323-bcdf-774241c09c82 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:44.392460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-447c7cfe-331c-4579-9ee8-1df8b9c618a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:44.392722 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36d9c23b-a5e8-4323-bcdf-774241c09c82 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:44.393145 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36d9c23b-a5e8-4323-bcdf-774241c09c82 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:44.393837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36d9c23b-a5e8-4323-bcdf-774241c09c82 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:44.394295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36d9c23b-a5e8-4323-bcdf-774241c09c82 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:44.394708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-36d9c23b-a5e8-4323-bcdf-774241c09c82 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:44.590572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-447c7cfe-331c-4579-9ee8-1df8b9c618a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:44.594234 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-36d9c23b-a5e8-4323-bcdf-774241c09c82 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:44.599731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-447c7cfe-331c-4579-9ee8-1df8b9c618a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.222705 Sep 05 17:26:44.600332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1136/2114] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:44 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:44.602535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-36d9c23b-a5e8-4323-bcdf-774241c09c82 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.223025 Sep 05 17:26:44.603087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 979/2115] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:44 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:45.625293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c51d8cd0-7ee2-4bd7-84c1-6b478f109a87 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:45.625929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c51d8cd0-7ee2-4bd7-84c1-6b478f109a87 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:45.626846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-98e5eb3c-4695-476e-ae67-6cce1f5a2957 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:45.627453 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-98e5eb3c-4695-476e-ae67-6cce1f5a2957 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:45.632488 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c51d8cd0-7ee2-4bd7-84c1-6b478f109a87 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:45.632968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c51d8cd0-7ee2-4bd7-84c1-6b478f109a87 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:45.633400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c51d8cd0-7ee2-4bd7-84c1-6b478f109a87 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:45.634086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c51d8cd0-7ee2-4bd7-84c1-6b478f109a87 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:45.634348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-98e5eb3c-4695-476e-ae67-6cce1f5a2957 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:45.634518 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c51d8cd0-7ee2-4bd7-84c1-6b478f109a87 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:45.634837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-98e5eb3c-4695-476e-ae67-6cce1f5a2957 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:45.634997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c51d8cd0-7ee2-4bd7-84c1-6b478f109a87 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:45.635266 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-98e5eb3c-4695-476e-ae67-6cce1f5a2957 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:45.635940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-98e5eb3c-4695-476e-ae67-6cce1f5a2957 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:45.636422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-98e5eb3c-4695-476e-ae67-6cce1f5a2957 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:45.636844 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-98e5eb3c-4695-476e-ae67-6cce1f5a2957 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:45.832233 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c51d8cd0-7ee2-4bd7-84c1-6b478f109a87 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:45.835464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-98e5eb3c-4695-476e-ae67-6cce1f5a2957 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:45.843162 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c51d8cd0-7ee2-4bd7-84c1-6b478f109a87 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.223038 Sep 05 17:26:45.843958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1137/2116] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:45 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:45.846699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-98e5eb3c-4695-476e-ae67-6cce1f5a2957 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.224067 Sep 05 17:26:45.847264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 980/2117] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:45 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:46.871041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-233ffcb2-ed57-4385-9637-5ebfdfae1128 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:46.872237 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-233ffcb2-ed57-4385-9637-5ebfdfae1128 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:46.873457 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5b8f3a65-2bcd-4430-b52f-6072deb141d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:46.874372 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5b8f3a65-2bcd-4430-b52f-6072deb141d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:46.879400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-233ffcb2-ed57-4385-9637-5ebfdfae1128 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:46.879883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-233ffcb2-ed57-4385-9637-5ebfdfae1128 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:46.880361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-233ffcb2-ed57-4385-9637-5ebfdfae1128 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:46.881018 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b8f3a65-2bcd-4430-b52f-6072deb141d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:46.881196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-233ffcb2-ed57-4385-9637-5ebfdfae1128 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:46.881490 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b8f3a65-2bcd-4430-b52f-6072deb141d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:46.881656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-233ffcb2-ed57-4385-9637-5ebfdfae1128 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:46.881899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b8f3a65-2bcd-4430-b52f-6072deb141d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:46.882036 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-233ffcb2-ed57-4385-9637-5ebfdfae1128 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:46.882590 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b8f3a65-2bcd-4430-b52f-6072deb141d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:46.883030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b8f3a65-2bcd-4430-b52f-6072deb141d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:46.883800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5b8f3a65-2bcd-4430-b52f-6072deb141d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:47.078234 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5b8f3a65-2bcd-4430-b52f-6072deb141d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:47.081839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-233ffcb2-ed57-4385-9637-5ebfdfae1128 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:47.086909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5b8f3a65-2bcd-4430-b52f-6072deb141d0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.219813 Sep 05 17:26:47.087484 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 981/2118] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:46 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:47.091145 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-233ffcb2-ed57-4385-9637-5ebfdfae1128 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.226655 Sep 05 17:26:47.092269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1138/2119] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:46 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:48.110576 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-40681323-4412-4175-ad88-16acad1c3da3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:48.111212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-40681323-4412-4175-ad88-16acad1c3da3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:48.118100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b6b5ae52-773e-4da3-b855-7d24ae502cf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:48.118637 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-40681323-4412-4175-ad88-16acad1c3da3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:48.118763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b6b5ae52-773e-4da3-b855-7d24ae502cf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:48.118891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-40681323-4412-4175-ad88-16acad1c3da3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:48.119202 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-40681323-4412-4175-ad88-16acad1c3da3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:48.119891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-40681323-4412-4175-ad88-16acad1c3da3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:48.120375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-40681323-4412-4175-ad88-16acad1c3da3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:48.120793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-40681323-4412-4175-ad88-16acad1c3da3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:48.125362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b5ae52-773e-4da3-b855-7d24ae502cf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:48.126006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b5ae52-773e-4da3-b855-7d24ae502cf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:48.126516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b5ae52-773e-4da3-b855-7d24ae502cf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:48.127207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b5ae52-773e-4da3-b855-7d24ae502cf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:48.127667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b5ae52-773e-4da3-b855-7d24ae502cf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:48.128083 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b5ae52-773e-4da3-b855-7d24ae502cf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:48.313659 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-40681323-4412-4175-ad88-16acad1c3da3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:48.316648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b6b5ae52-773e-4da3-b855-7d24ae502cf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:48.322031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-40681323-4412-4175-ad88-16acad1c3da3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.215658 Sep 05 17:26:48.322957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 982/2120] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:48 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:48.325265 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b6b5ae52-773e-4da3-b855-7d24ae502cf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.211289 Sep 05 17:26:48.325846 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1139/2121] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:48 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:49.350620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b96f8bd2-e410-442b-a972-79be75aca685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:49.351565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b96f8bd2-e410-442b-a972-79be75aca685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:49.353395 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-254d27a4-3adf-4aba-a677-1bbdc7cbbdd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:49.354394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-254d27a4-3adf-4aba-a677-1bbdc7cbbdd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:49.361402 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b96f8bd2-e410-442b-a972-79be75aca685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:49.361890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b96f8bd2-e410-442b-a972-79be75aca685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:49.362324 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b96f8bd2-e410-442b-a972-79be75aca685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:49.362493 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-254d27a4-3adf-4aba-a677-1bbdc7cbbdd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:49.363011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-254d27a4-3adf-4aba-a677-1bbdc7cbbdd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:49.363175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b96f8bd2-e410-442b-a972-79be75aca685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:49.363435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-254d27a4-3adf-4aba-a677-1bbdc7cbbdd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:49.363600 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b96f8bd2-e410-442b-a972-79be75aca685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:49.363864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b96f8bd2-e410-442b-a972-79be75aca685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:49.364114 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-254d27a4-3adf-4aba-a677-1bbdc7cbbdd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:49.364599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-254d27a4-3adf-4aba-a677-1bbdc7cbbdd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:49.365020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-254d27a4-3adf-4aba-a677-1bbdc7cbbdd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:49.556991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-254d27a4-3adf-4aba-a677-1bbdc7cbbdd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:49.560131 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b96f8bd2-e410-442b-a972-79be75aca685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:49.565505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-254d27a4-3adf-4aba-a677-1bbdc7cbbdd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.218590 Sep 05 17:26:49.566079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1140/2122] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:49 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:49.569004 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b96f8bd2-e410-442b-a972-79be75aca685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.225243 Sep 05 17:26:49.570252 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 983/2123] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:49 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:50.593620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-966c4057-6df9-4bbf-a9c0-d6eb75468b05 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:50.594241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-966c4057-6df9-4bbf-a9c0-d6eb75468b05 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:50.596115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b59a9d24-05f0-4651-91c9-40a32199ac01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:50.596763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b59a9d24-05f0-4651-91c9-40a32199ac01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:50.601189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-966c4057-6df9-4bbf-a9c0-d6eb75468b05 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:50.601675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-966c4057-6df9-4bbf-a9c0-d6eb75468b05 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:50.602111 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-966c4057-6df9-4bbf-a9c0-d6eb75468b05 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:50.602810 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-966c4057-6df9-4bbf-a9c0-d6eb75468b05 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:50.603258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-966c4057-6df9-4bbf-a9c0-d6eb75468b05 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:50.603566 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b59a9d24-05f0-4651-91c9-40a32199ac01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:50.603729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-966c4057-6df9-4bbf-a9c0-d6eb75468b05 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:50.604047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b59a9d24-05f0-4651-91c9-40a32199ac01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:50.604529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b59a9d24-05f0-4651-91c9-40a32199ac01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:50.605203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b59a9d24-05f0-4651-91c9-40a32199ac01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:50.605649 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b59a9d24-05f0-4651-91c9-40a32199ac01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:50.606063 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b59a9d24-05f0-4651-91c9-40a32199ac01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:50.798822 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-966c4057-6df9-4bbf-a9c0-d6eb75468b05 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:50.802135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b59a9d24-05f0-4651-91c9-40a32199ac01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:50.807352 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-966c4057-6df9-4bbf-a9c0-d6eb75468b05 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.220870 Sep 05 17:26:50.808161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1141/2124] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:50 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:50.812123 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b59a9d24-05f0-4651-91c9-40a32199ac01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.221072 Sep 05 17:26:50.812715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 984/2125] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:50 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:51.836709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f4d0dc05-4c71-411f-b1cd-eeed8874d488 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:51.837668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f4d0dc05-4c71-411f-b1cd-eeed8874d488 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:51.839135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-56a9804a-d531-4233-bede-a24e6f7ed4e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:51.840492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-56a9804a-d531-4233-bede-a24e6f7ed4e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:51.849442 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4d0dc05-4c71-411f-b1cd-eeed8874d488 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:51.850246 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4d0dc05-4c71-411f-b1cd-eeed8874d488 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:51.850925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4d0dc05-4c71-411f-b1cd-eeed8874d488 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:51.852103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4d0dc05-4c71-411f-b1cd-eeed8874d488 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:51.852378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56a9804a-d531-4233-bede-a24e6f7ed4e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:51.852900 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4d0dc05-4c71-411f-b1cd-eeed8874d488 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:51.853172 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56a9804a-d531-4233-bede-a24e6f7ed4e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:51.853605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4d0dc05-4c71-411f-b1cd-eeed8874d488 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:51.853951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56a9804a-d531-4233-bede-a24e6f7ed4e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:51.854943 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56a9804a-d531-4233-bede-a24e6f7ed4e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:51.855686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56a9804a-d531-4233-bede-a24e6f7ed4e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:51.856604 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-56a9804a-d531-4233-bede-a24e6f7ed4e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:51.873008 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:26:52.052376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f4d0dc05-4c71-411f-b1cd-eeed8874d488 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:52.055476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-56a9804a-d531-4233-bede-a24e6f7ed4e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:52.061524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f4d0dc05-4c71-411f-b1cd-eeed8874d488 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.231270 Sep 05 17:26:52.062213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1142/2126] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:51 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:52.065061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-56a9804a-d531-4233-bede-a24e6f7ed4e9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.232263 Sep 05 17:26:52.065615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 985/2127] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:51 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:53.089225 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ba9462b0-77d5-47f6-92ad-c454cd50c81f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:53.090344 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ba9462b0-77d5-47f6-92ad-c454cd50c81f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:53.092496 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-05f1e0bc-0b8f-4696-8408-7d1ce0293d0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:53.093476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-05f1e0bc-0b8f-4696-8408-7d1ce0293d0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:53.101960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba9462b0-77d5-47f6-92ad-c454cd50c81f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:53.102757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba9462b0-77d5-47f6-92ad-c454cd50c81f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:53.103467 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba9462b0-77d5-47f6-92ad-c454cd50c81f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:53.104198 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05f1e0bc-0b8f-4696-8408-7d1ce0293d0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:53.104623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba9462b0-77d5-47f6-92ad-c454cd50c81f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:53.105100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05f1e0bc-0b8f-4696-8408-7d1ce0293d0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:53.105317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba9462b0-77d5-47f6-92ad-c454cd50c81f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:53.105830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05f1e0bc-0b8f-4696-8408-7d1ce0293d0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:53.106074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba9462b0-77d5-47f6-92ad-c454cd50c81f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:53.107176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05f1e0bc-0b8f-4696-8408-7d1ce0293d0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:53.107930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05f1e0bc-0b8f-4696-8408-7d1ce0293d0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:53.108962 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-05f1e0bc-0b8f-4696-8408-7d1ce0293d0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:53.122071 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:26:53.305217 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-05f1e0bc-0b8f-4696-8408-7d1ce0293d0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:53.309339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ba9462b0-77d5-47f6-92ad-c454cd50c81f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:53.314772 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-05f1e0bc-0b8f-4696-8408-7d1ce0293d0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.229031 Sep 05 17:26:53.315349 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 986/2128] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:53 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:53.318020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ba9462b0-77d5-47f6-92ad-c454cd50c81f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.235401 Sep 05 17:26:53.318704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1143/2129] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:53 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:54.342970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8c0a55c9-2fa2-486e-bb5d-183731a39969 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:54.343671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8c0a55c9-2fa2-486e-bb5d-183731a39969 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:54.344826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-99328011-7366-4670-9887-91fa59d7d14b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:54.345452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-99328011-7366-4670-9887-91fa59d7d14b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:54.350544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c0a55c9-2fa2-486e-bb5d-183731a39969 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:54.351025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c0a55c9-2fa2-486e-bb5d-183731a39969 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:54.351450 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c0a55c9-2fa2-486e-bb5d-183731a39969 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:54.352142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c0a55c9-2fa2-486e-bb5d-183731a39969 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:54.352320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99328011-7366-4670-9887-91fa59d7d14b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:54.352641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c0a55c9-2fa2-486e-bb5d-183731a39969 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:54.352815 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99328011-7366-4670-9887-91fa59d7d14b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:54.353057 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c0a55c9-2fa2-486e-bb5d-183731a39969 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:54.353212 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99328011-7366-4670-9887-91fa59d7d14b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:54.353900 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99328011-7366-4670-9887-91fa59d7d14b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:54.354342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99328011-7366-4670-9887-91fa59d7d14b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:54.354757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99328011-7366-4670-9887-91fa59d7d14b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:54.546858 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8c0a55c9-2fa2-486e-bb5d-183731a39969 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:54.551080 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-99328011-7366-4670-9887-91fa59d7d14b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:54.555483 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8c0a55c9-2fa2-486e-bb5d-183731a39969 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.219402 Sep 05 17:26:54.556082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 987/2130] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:54 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:54.559921 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-99328011-7366-4670-9887-91fa59d7d14b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.221114 Sep 05 17:26:54.560531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1144/2131] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:54 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:55.579119 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e5516551-3875-491b-b6b1-8cd75f4d4a03 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:55.579756 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e5516551-3875-491b-b6b1-8cd75f4d4a03 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:55.583610 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-413726f4-dabd-40af-ab00-c9887ef4fe01 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:55.584245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-413726f4-dabd-40af-ab00-c9887ef4fe01 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:55.586460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:26:55.586625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:26:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 (ip 10.222.0.23) !!! Sep 05 17:26:55.586719 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e5516551-3875-491b-b6b1-8cd75f4d4a03 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:55.587188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e5516551-3875-491b-b6b1-8cd75f4d4a03 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:55.588291 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e5516551-3875-491b-b6b1-8cd75f4d4a03 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:55.589072 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e5516551-3875-491b-b6b1-8cd75f4d4a03 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:55.589520 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e5516551-3875-491b-b6b1-8cd75f4d4a03 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:55.590033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e5516551-3875-491b-b6b1-8cd75f4d4a03 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:55.593363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-413726f4-dabd-40af-ab00-c9887ef4fe01 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:55.593847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-413726f4-dabd-40af-ab00-c9887ef4fe01 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:55.595000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-413726f4-dabd-40af-ab00-c9887ef4fe01 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:55.595679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-413726f4-dabd-40af-ab00-c9887ef4fe01 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:55.596128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-413726f4-dabd-40af-ab00-c9887ef4fe01 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:55.596575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-413726f4-dabd-40af-ab00-c9887ef4fe01 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:55.790919 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e5516551-3875-491b-b6b1-8cd75f4d4a03 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:55.794155 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-413726f4-dabd-40af-ab00-c9887ef4fe01 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:55.799599 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e5516551-3875-491b-b6b1-8cd75f4d4a03 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.224634 Sep 05 17:26:55.800255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 988/2132] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:55 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:55.803391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-413726f4-dabd-40af-ab00-c9887ef4fe01 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.223677 Sep 05 17:26:55.803959 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1145/2133] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:55 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:56.824087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f62972dc-e00b-47c4-b390-e92bd066cfbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:56.824728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f62972dc-e00b-47c4-b390-e92bd066cfbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:56.827050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3a4d226d-d116-419c-8ced-da83fb741d64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:56.827522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=50 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:26:56.827632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3a4d226d-d116-419c-8ced-da83fb741d64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:56.831032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=56 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:26:56.833250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f62972dc-e00b-47c4-b390-e92bd066cfbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:56.833769 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f62972dc-e00b-47c4-b390-e92bd066cfbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:56.834199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f62972dc-e00b-47c4-b390-e92bd066cfbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:56.834924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f62972dc-e00b-47c4-b390-e92bd066cfbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:56.835364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f62972dc-e00b-47c4-b390-e92bd066cfbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:56.835785 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f62972dc-e00b-47c4-b390-e92bd066cfbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:56.836607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a4d226d-d116-419c-8ced-da83fb741d64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:56.837085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a4d226d-d116-419c-8ced-da83fb741d64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:56.837518 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a4d226d-d116-419c-8ced-da83fb741d64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:56.838206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a4d226d-d116-419c-8ced-da83fb741d64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:56.838651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a4d226d-d116-419c-8ced-da83fb741d64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:56.839071 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a4d226d-d116-419c-8ced-da83fb741d64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:57.030447 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f62972dc-e00b-47c4-b390-e92bd066cfbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:57.033544 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3a4d226d-d116-419c-8ced-da83fb741d64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:57.038900 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f62972dc-e00b-47c4-b390-e92bd066cfbb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.219240 Sep 05 17:26:57.039462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 989/2134] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:56 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:57.041906 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3a4d226d-d116-419c-8ced-da83fb741d64 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.218868 Sep 05 17:26:57.042473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1146/2135] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:56 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:58.065470 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c81cba0f-7ae6-4fa1-ae5f-395d002d8dc6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:58.066108 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c81cba0f-7ae6-4fa1-ae5f-395d002d8dc6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:58.068189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c15213fc-09e9-4522-b58f-06bdad154caf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:58.068836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c15213fc-09e9-4522-b58f-06bdad154caf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:58.073358 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c81cba0f-7ae6-4fa1-ae5f-395d002d8dc6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:58.073839 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c81cba0f-7ae6-4fa1-ae5f-395d002d8dc6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:58.074276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c81cba0f-7ae6-4fa1-ae5f-395d002d8dc6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:58.074945 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c81cba0f-7ae6-4fa1-ae5f-395d002d8dc6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:58.075223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c15213fc-09e9-4522-b58f-06bdad154caf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:58.075384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c81cba0f-7ae6-4fa1-ae5f-395d002d8dc6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:58.075701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c15213fc-09e9-4522-b58f-06bdad154caf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:58.075846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c81cba0f-7ae6-4fa1-ae5f-395d002d8dc6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:58.076122 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c15213fc-09e9-4522-b58f-06bdad154caf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:58.076838 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c15213fc-09e9-4522-b58f-06bdad154caf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:58.077273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c15213fc-09e9-4522-b58f-06bdad154caf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:58.077701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c15213fc-09e9-4522-b58f-06bdad154caf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:58.504589 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c81cba0f-7ae6-4fa1-ae5f-395d002d8dc6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:58.507594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c15213fc-09e9-4522-b58f-06bdad154caf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:58.514038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c81cba0f-7ae6-4fa1-ae5f-395d002d8dc6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.454591 Sep 05 17:26:58.514622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 990/2136] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:58 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:58.516186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c15213fc-09e9-4522-b58f-06bdad154caf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.454121 Sep 05 17:26:58.516777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1147/2137] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:58 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:59.542262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-54c21cbc-0de7-4702-b8ae-cd59a6ce2e78 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:59.543205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-54c21cbc-0de7-4702-b8ae-cd59a6ce2e78 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:59.543880 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ee5ee3fd-9f0f-4741-abe8-0a6d18f4f12d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:26:59.544909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ee5ee3fd-9f0f-4741-abe8-0a6d18f4f12d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:26:59.552644 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54c21cbc-0de7-4702-b8ae-cd59a6ce2e78 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:59.553120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54c21cbc-0de7-4702-b8ae-cd59a6ce2e78 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:59.553542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54c21cbc-0de7-4702-b8ae-cd59a6ce2e78 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:59.553710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee5ee3fd-9f0f-4741-abe8-0a6d18f4f12d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:59.554128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee5ee3fd-9f0f-4741-abe8-0a6d18f4f12d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:59.554292 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54c21cbc-0de7-4702-b8ae-cd59a6ce2e78 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:59.554556 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee5ee3fd-9f0f-4741-abe8-0a6d18f4f12d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:59.554720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54c21cbc-0de7-4702-b8ae-cd59a6ce2e78 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:59.555057 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54c21cbc-0de7-4702-b8ae-cd59a6ce2e78 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:59.555202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee5ee3fd-9f0f-4741-abe8-0a6d18f4f12d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:26:59.555658 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee5ee3fd-9f0f-4741-abe8-0a6d18f4f12d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:26:59.556075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee5ee3fd-9f0f-4741-abe8-0a6d18f4f12d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:26:59.750033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-54c21cbc-0de7-4702-b8ae-cd59a6ce2e78 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:59.753546 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ee5ee3fd-9f0f-4741-abe8-0a6d18f4f12d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:26:59.759247 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-54c21cbc-0de7-4702-b8ae-cd59a6ce2e78 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.223691 Sep 05 17:26:59.760060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 991/2138] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:59 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:26:59.762195 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ee5ee3fd-9f0f-4741-abe8-0a6d18f4f12d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.224831 Sep 05 17:26:59.762789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1148/2139] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:26:59 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:00.786303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-18493d8d-52d9-4bcf-9b5b-450e8e476817 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:00.786886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-18493d8d-52d9-4bcf-9b5b-450e8e476817 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:00.787530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-143128d4-dd76-45d0-85e9-689ed900c754 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:00.788245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-143128d4-dd76-45d0-85e9-689ed900c754 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:00.793712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18493d8d-52d9-4bcf-9b5b-450e8e476817 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:00.794195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18493d8d-52d9-4bcf-9b5b-450e8e476817 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:00.794612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18493d8d-52d9-4bcf-9b5b-450e8e476817 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:00.794752 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-143128d4-dd76-45d0-85e9-689ed900c754 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:00.795108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-143128d4-dd76-45d0-85e9-689ed900c754 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:00.795314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18493d8d-52d9-4bcf-9b5b-450e8e476817 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:00.795534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-143128d4-dd76-45d0-85e9-689ed900c754 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:00.795758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18493d8d-52d9-4bcf-9b5b-450e8e476817 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:00.796186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18493d8d-52d9-4bcf-9b5b-450e8e476817 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:00.796342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-143128d4-dd76-45d0-85e9-689ed900c754 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:00.796718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-143128d4-dd76-45d0-85e9-689ed900c754 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:00.797134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-143128d4-dd76-45d0-85e9-689ed900c754 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:01.000805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-18493d8d-52d9-4bcf-9b5b-450e8e476817 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:01.004312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-143128d4-dd76-45d0-85e9-689ed900c754 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:01.009377 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-18493d8d-52d9-4bcf-9b5b-450e8e476817 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.229715 Sep 05 17:27:01.009922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 992/2140] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:00 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:01.012885 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-143128d4-dd76-45d0-85e9-689ed900c754 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.230093 Sep 05 17:27:01.013452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1149/2141] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:00 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:02.036123 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-695a9156-5c7a-4223-880d-df2c61dac412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:02.037086 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-695a9156-5c7a-4223-880d-df2c61dac412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:02.038573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6a35dc87-2b02-419f-a0d9-76ba5b95ac70 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:02.039274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6a35dc87-2b02-419f-a0d9-76ba5b95ac70 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:02.045395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-695a9156-5c7a-4223-880d-df2c61dac412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:02.045585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a35dc87-2b02-419f-a0d9-76ba5b95ac70 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:02.045881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-695a9156-5c7a-4223-880d-df2c61dac412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:02.046139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a35dc87-2b02-419f-a0d9-76ba5b95ac70 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:02.046304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-695a9156-5c7a-4223-880d-df2c61dac412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:02.046511 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a35dc87-2b02-419f-a0d9-76ba5b95ac70 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:02.047010 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-695a9156-5c7a-4223-880d-df2c61dac412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:02.047208 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a35dc87-2b02-419f-a0d9-76ba5b95ac70 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:02.047462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-695a9156-5c7a-4223-880d-df2c61dac412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:02.047659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a35dc87-2b02-419f-a0d9-76ba5b95ac70 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:02.047886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-695a9156-5c7a-4223-880d-df2c61dac412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:02.048087 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a35dc87-2b02-419f-a0d9-76ba5b95ac70 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:02.238512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-695a9156-5c7a-4223-880d-df2c61dac412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:02.245602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6a35dc87-2b02-419f-a0d9-76ba5b95ac70 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:02.247045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-695a9156-5c7a-4223-880d-df2c61dac412 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.216833 Sep 05 17:27:02.247601 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 993/2142] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:02 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:02.254783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6a35dc87-2b02-419f-a0d9-76ba5b95ac70 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.221483 Sep 05 17:27:02.255324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1150/2143] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:02 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:03.270794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-df775d2d-12ec-4f9d-a3ec-15e780edf68f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:03.271364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-df775d2d-12ec-4f9d-a3ec-15e780edf68f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:03.277949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c38b5e09-dbd3-4374-bf98-a18c94d4b66b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:03.278418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df775d2d-12ec-4f9d-a3ec-15e780edf68f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:03.278526 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c38b5e09-dbd3-4374-bf98-a18c94d4b66b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:03.278819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df775d2d-12ec-4f9d-a3ec-15e780edf68f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:03.279242 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df775d2d-12ec-4f9d-a3ec-15e780edf68f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:03.279926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df775d2d-12ec-4f9d-a3ec-15e780edf68f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:03.280406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df775d2d-12ec-4f9d-a3ec-15e780edf68f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:03.280824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df775d2d-12ec-4f9d-a3ec-15e780edf68f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:03.285654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c38b5e09-dbd3-4374-bf98-a18c94d4b66b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:03.286135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c38b5e09-dbd3-4374-bf98-a18c94d4b66b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:03.286567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c38b5e09-dbd3-4374-bf98-a18c94d4b66b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:03.287249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c38b5e09-dbd3-4374-bf98-a18c94d4b66b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:03.287696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c38b5e09-dbd3-4374-bf98-a18c94d4b66b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:03.288114 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c38b5e09-dbd3-4374-bf98-a18c94d4b66b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:03.476465 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-df775d2d-12ec-4f9d-a3ec-15e780edf68f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:03.479827 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c38b5e09-dbd3-4374-bf98-a18c94d4b66b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:03.488009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-df775d2d-12ec-4f9d-a3ec-15e780edf68f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.221324 Sep 05 17:27:03.488616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 994/2144] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:03 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:03.490805 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c38b5e09-dbd3-4374-bf98-a18c94d4b66b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.216743 Sep 05 17:27:03.491379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1151/2145] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:03 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:04.516404 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c40c5dcf-9ce7-4915-9217-a7d0fc12006c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:04.517355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c40c5dcf-9ce7-4915-9217-a7d0fc12006c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:04.518594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3f10ebf8-6d23-4330-95b8-c3a392eadad7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:04.519987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3f10ebf8-6d23-4330-95b8-c3a392eadad7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:04.527845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c40c5dcf-9ce7-4915-9217-a7d0fc12006c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:04.528718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c40c5dcf-9ce7-4915-9217-a7d0fc12006c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:04.529430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c40c5dcf-9ce7-4915-9217-a7d0fc12006c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:04.530550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c40c5dcf-9ce7-4915-9217-a7d0fc12006c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:04.531293 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c40c5dcf-9ce7-4915-9217-a7d0fc12006c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:04.531843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f10ebf8-6d23-4330-95b8-c3a392eadad7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:04.532119 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c40c5dcf-9ce7-4915-9217-a7d0fc12006c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:04.532710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f10ebf8-6d23-4330-95b8-c3a392eadad7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:04.533444 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f10ebf8-6d23-4330-95b8-c3a392eadad7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:04.534448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f10ebf8-6d23-4330-95b8-c3a392eadad7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:04.534784 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f10ebf8-6d23-4330-95b8-c3a392eadad7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:04.535205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f10ebf8-6d23-4330-95b8-c3a392eadad7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:04.709894 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3f10ebf8-6d23-4330-95b8-c3a392eadad7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:04.718547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3f10ebf8-6d23-4330-95b8-c3a392eadad7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.206306 Sep 05 17:27:04.719128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1152/2146] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:04 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:27:04.928530 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c40c5dcf-9ce7-4915-9217-a7d0fc12006c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:04.940962 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c40c5dcf-9ce7-4915-9217-a7d0fc12006c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.431814 Sep 05 17:27:04.941886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 995/2147] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:04 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:05.746417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ad7ddcbb-1b98-474c-a0a1-a89d87f49ad5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:05.750268 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ad7ddcbb-1b98-474c-a0a1-a89d87f49ad5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:05.758003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad7ddcbb-1b98-474c-a0a1-a89d87f49ad5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:05.758483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad7ddcbb-1b98-474c-a0a1-a89d87f49ad5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:05.758940 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad7ddcbb-1b98-474c-a0a1-a89d87f49ad5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:05.759633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad7ddcbb-1b98-474c-a0a1-a89d87f49ad5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:05.760087 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad7ddcbb-1b98-474c-a0a1-a89d87f49ad5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:05.760552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ad7ddcbb-1b98-474c-a0a1-a89d87f49ad5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:05.953485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ad7ddcbb-1b98-474c-a0a1-a89d87f49ad5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:05.965900 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ad7ddcbb-1b98-474c-a0a1-a89d87f49ad5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.226490 Sep 05 17:27:05.966825 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1153/2148] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:05 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:05.970957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a2181e2e-5d6e-47f3-b46c-a956b358b681 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:05.971560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a2181e2e-5d6e-47f3-b46c-a956b358b681 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:05.978368 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2181e2e-5d6e-47f3-b46c-a956b358b681 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:05.978855 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2181e2e-5d6e-47f3-b46c-a956b358b681 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:05.979277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2181e2e-5d6e-47f3-b46c-a956b358b681 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:05.979947 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2181e2e-5d6e-47f3-b46c-a956b358b681 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:05.980415 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2181e2e-5d6e-47f3-b46c-a956b358b681 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:05.980827 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a2181e2e-5d6e-47f3-b46c-a956b358b681 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:06.124079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a2181e2e-5d6e-47f3-b46c-a956b358b681 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:06.132666 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a2181e2e-5d6e-47f3-b46c-a956b358b681 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.165976 Sep 05 17:27:06.133241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 996/2149] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:05 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:27:06.993840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1a12a473-5196-40f4-929d-6147efbac785 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:06.994841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1a12a473-5196-40f4-929d-6147efbac785 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:07.006350 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a12a473-5196-40f4-929d-6147efbac785 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:07.007149 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a12a473-5196-40f4-929d-6147efbac785 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:07.007900 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a12a473-5196-40f4-929d-6147efbac785 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:07.009134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a12a473-5196-40f4-929d-6147efbac785 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:07.009878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a12a473-5196-40f4-929d-6147efbac785 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:07.010568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a12a473-5196-40f4-929d-6147efbac785 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:07.154206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1a12a473-5196-40f4-929d-6147efbac785 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:07.156857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b3558836-3262-4638-989f-34a544b54b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:07.157287 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b3558836-3262-4638-989f-34a544b54b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:07.163086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1a12a473-5196-40f4-929d-6147efbac785 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.175819 Sep 05 17:27:07.163671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1154/2150] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:06 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:07.164395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3558836-3262-4638-989f-34a544b54b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:07.164913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3558836-3262-4638-989f-34a544b54b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:07.165355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3558836-3262-4638-989f-34a544b54b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:07.166058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3558836-3262-4638-989f-34a544b54b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:07.166506 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3558836-3262-4638-989f-34a544b54b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:07.166917 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3558836-3262-4638-989f-34a544b54b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:07.299410 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b3558836-3262-4638-989f-34a544b54b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:07.308968 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b3558836-3262-4638-989f-34a544b54b0f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.156353 Sep 05 17:27:07.309545 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 997/2151] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:07 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:08.191697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-627cd3f9-d004-4009-b627-9a162f4dea78 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:08.192361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-627cd3f9-d004-4009-b627-9a162f4dea78 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:08.198933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-627cd3f9-d004-4009-b627-9a162f4dea78 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:08.199422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-627cd3f9-d004-4009-b627-9a162f4dea78 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:08.199848 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-627cd3f9-d004-4009-b627-9a162f4dea78 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:08.200582 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-627cd3f9-d004-4009-b627-9a162f4dea78 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:08.201014 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-627cd3f9-d004-4009-b627-9a162f4dea78 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:08.201435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-627cd3f9-d004-4009-b627-9a162f4dea78 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:08.334743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-627cd3f9-d004-4009-b627-9a162f4dea78 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:08.335117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0c2a890b-92ca-435e-91b0-94af19a5dbe2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:08.335757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0c2a890b-92ca-435e-91b0-94af19a5dbe2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:08.342917 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c2a890b-92ca-435e-91b0-94af19a5dbe2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:08.343401 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c2a890b-92ca-435e-91b0-94af19a5dbe2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:08.343556 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-627cd3f9-d004-4009-b627-9a162f4dea78 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.159007 Sep 05 17:27:08.343829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c2a890b-92ca-435e-91b0-94af19a5dbe2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:08.348703 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1155/2152] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:08 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:08.348879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c2a890b-92ca-435e-91b0-94af19a5dbe2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:08.348879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c2a890b-92ca-435e-91b0-94af19a5dbe2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:08.348879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c2a890b-92ca-435e-91b0-94af19a5dbe2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:08.477327 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0c2a890b-92ca-435e-91b0-94af19a5dbe2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:08.486030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0c2a890b-92ca-435e-91b0-94af19a5dbe2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.155352 Sep 05 17:27:08.486606 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 998/2153] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:08 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:09.370995 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fa1360d2-2654-42c5-856d-ebe203cbe633 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:09.372125 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fa1360d2-2654-42c5-856d-ebe203cbe633 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:09.382934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa1360d2-2654-42c5-856d-ebe203cbe633 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:09.383706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa1360d2-2654-42c5-856d-ebe203cbe633 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:09.384496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa1360d2-2654-42c5-856d-ebe203cbe633 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:09.385697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa1360d2-2654-42c5-856d-ebe203cbe633 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:09.386452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa1360d2-2654-42c5-856d-ebe203cbe633 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:09.387156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa1360d2-2654-42c5-856d-ebe203cbe633 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:09.509519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-79cb0868-fa9f-4f04-93fa-c02d4436d3d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:09.510347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-79cb0868-fa9f-4f04-93fa-c02d4436d3d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:09.517032 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79cb0868-fa9f-4f04-93fa-c02d4436d3d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:09.517509 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79cb0868-fa9f-4f04-93fa-c02d4436d3d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:09.517934 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79cb0868-fa9f-4f04-93fa-c02d4436d3d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:09.518655 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79cb0868-fa9f-4f04-93fa-c02d4436d3d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:09.519156 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79cb0868-fa9f-4f04-93fa-c02d4436d3d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:09.519763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79cb0868-fa9f-4f04-93fa-c02d4436d3d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:09.529679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fa1360d2-2654-42c5-856d-ebe203cbe633 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:09.538834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fa1360d2-2654-42c5-856d-ebe203cbe633 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.174463 Sep 05 17:27:09.539600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1156/2154] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:09 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:09.658477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-79cb0868-fa9f-4f04-93fa-c02d4436d3d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:09.666921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-79cb0868-fa9f-4f04-93fa-c02d4436d3d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.161397 Sep 05 17:27:09.667490 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 999/2155] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:09 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:27:10.563497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-41c93feb-da21-4fae-92c5-5d603bf5ef08 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:10.564181 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-41c93feb-da21-4fae-92c5-5d603bf5ef08 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:10.571354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41c93feb-da21-4fae-92c5-5d603bf5ef08 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:10.571832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41c93feb-da21-4fae-92c5-5d603bf5ef08 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:10.572290 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41c93feb-da21-4fae-92c5-5d603bf5ef08 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:10.572969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41c93feb-da21-4fae-92c5-5d603bf5ef08 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:10.573417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41c93feb-da21-4fae-92c5-5d603bf5ef08 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:10.573831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41c93feb-da21-4fae-92c5-5d603bf5ef08 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:10.690441 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e6928673-1a81-4dbc-89a8-a2558713e8ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:10.691051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e6928673-1a81-4dbc-89a8-a2558713e8ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:10.697752 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6928673-1a81-4dbc-89a8-a2558713e8ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:10.698271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6928673-1a81-4dbc-89a8-a2558713e8ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:10.698700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6928673-1a81-4dbc-89a8-a2558713e8ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:10.699397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6928673-1a81-4dbc-89a8-a2558713e8ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:10.699850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6928673-1a81-4dbc-89a8-a2558713e8ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:10.700294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6928673-1a81-4dbc-89a8-a2558713e8ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:10.722924 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-41c93feb-da21-4fae-92c5-5d603bf5ef08 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:10.731966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-41c93feb-da21-4fae-92c5-5d603bf5ef08 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.172903 Sep 05 17:27:10.732613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1157/2156] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:10 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:10.844502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e6928673-1a81-4dbc-89a8-a2558713e8ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:10.857254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e6928673-1a81-4dbc-89a8-a2558713e8ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.170516 Sep 05 17:27:10.858061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1000/2157] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:10 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:11.759636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bad9f070-9d92-44ae-a5c1-3527bbe9694f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:11.761129 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bad9f070-9d92-44ae-a5c1-3527bbe9694f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:11.772009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bad9f070-9d92-44ae-a5c1-3527bbe9694f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:11.772860 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bad9f070-9d92-44ae-a5c1-3527bbe9694f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:11.773619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bad9f070-9d92-44ae-a5c1-3527bbe9694f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:11.774743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bad9f070-9d92-44ae-a5c1-3527bbe9694f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:11.775520 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bad9f070-9d92-44ae-a5c1-3527bbe9694f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:11.776227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bad9f070-9d92-44ae-a5c1-3527bbe9694f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:11.880713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ef8530ed-164d-4b65-87f4-7099990dc838 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:11.881314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ef8530ed-164d-4b65-87f4-7099990dc838 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:11.888241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef8530ed-164d-4b65-87f4-7099990dc838 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:11.888722 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef8530ed-164d-4b65-87f4-7099990dc838 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:11.889160 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef8530ed-164d-4b65-87f4-7099990dc838 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:11.889867 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef8530ed-164d-4b65-87f4-7099990dc838 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:11.890309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef8530ed-164d-4b65-87f4-7099990dc838 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:11.890718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef8530ed-164d-4b65-87f4-7099990dc838 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:11.918176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bad9f070-9d92-44ae-a5c1-3527bbe9694f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:11.927082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bad9f070-9d92-44ae-a5c1-3527bbe9694f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.174134 Sep 05 17:27:11.927761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1158/2158] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:11 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:12.020363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ef8530ed-164d-4b65-87f4-7099990dc838 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:12.029260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ef8530ed-164d-4b65-87f4-7099990dc838 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.152502 Sep 05 17:27:12.029818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1001/2159] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:11 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:12.960909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a2ba86f3-f575-40ba-933d-60550449151d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:12.962073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a2ba86f3-f575-40ba-933d-60550449151d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:12.973766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2ba86f3-f575-40ba-933d-60550449151d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:12.974564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2ba86f3-f575-40ba-933d-60550449151d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:12.975435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2ba86f3-f575-40ba-933d-60550449151d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:12.976614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2ba86f3-f575-40ba-933d-60550449151d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:12.977356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2ba86f3-f575-40ba-933d-60550449151d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:12.978046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2ba86f3-f575-40ba-933d-60550449151d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:13.123015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a2ba86f3-f575-40ba-933d-60550449151d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:13.131763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a2ba86f3-f575-40ba-933d-60550449151d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.183158 Sep 05 17:27:13.132364 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1159/2160] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:12 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:13.195086 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1e716619-9cae-4be0-85a5-72786e7b29d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:13.195734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1e716619-9cae-4be0-85a5-72786e7b29d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:13.201813 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e716619-9cae-4be0-85a5-72786e7b29d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:13.202268 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e716619-9cae-4be0-85a5-72786e7b29d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:13.202695 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e716619-9cae-4be0-85a5-72786e7b29d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:13.203382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e716619-9cae-4be0-85a5-72786e7b29d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:13.203824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e716619-9cae-4be0-85a5-72786e7b29d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:13.204269 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1e716619-9cae-4be0-85a5-72786e7b29d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:13.208248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:27:13.339997 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1e716619-9cae-4be0-85a5-72786e7b29d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:13.349796 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1e716619-9cae-4be0-85a5-72786e7b29d2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.298468 Sep 05 17:27:13.350384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1002/2161] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:13 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:27:14.159260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a34a14ac-743e-4dae-a8ff-2d4b05fd0589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:14.160307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a34a14ac-743e-4dae-a8ff-2d4b05fd0589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:14.167626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a34a14ac-743e-4dae-a8ff-2d4b05fd0589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:14.168105 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a34a14ac-743e-4dae-a8ff-2d4b05fd0589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:14.168568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a34a14ac-743e-4dae-a8ff-2d4b05fd0589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:14.169249 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a34a14ac-743e-4dae-a8ff-2d4b05fd0589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:14.169694 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a34a14ac-743e-4dae-a8ff-2d4b05fd0589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:14.170107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a34a14ac-743e-4dae-a8ff-2d4b05fd0589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:14.172683 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:27:14.318058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a34a14ac-743e-4dae-a8ff-2d4b05fd0589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:14.326989 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a34a14ac-743e-4dae-a8ff-2d4b05fd0589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.174236 Sep 05 17:27:14.327571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1160/2162] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:14 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:14.375087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4c3f3da7-79ee-4684-a02c-b0504bb16711 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:14.375813 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4c3f3da7-79ee-4684-a02c-b0504bb16711 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:14.383996 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c3f3da7-79ee-4684-a02c-b0504bb16711 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:14.384540 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c3f3da7-79ee-4684-a02c-b0504bb16711 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:14.385123 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c3f3da7-79ee-4684-a02c-b0504bb16711 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:14.386120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c3f3da7-79ee-4684-a02c-b0504bb16711 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:14.386733 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c3f3da7-79ee-4684-a02c-b0504bb16711 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:14.387282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4c3f3da7-79ee-4684-a02c-b0504bb16711 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:14.528717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4c3f3da7-79ee-4684-a02c-b0504bb16711 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:14.541657 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4c3f3da7-79ee-4684-a02c-b0504bb16711 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.172466 Sep 05 17:27:14.542458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1003/2163] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:14 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:15.355124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d667d6b0-f244-4029-8fe4-a05e9f431a8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:15.356054 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d667d6b0-f244-4029-8fe4-a05e9f431a8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:15.366291 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d667d6b0-f244-4029-8fe4-a05e9f431a8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:15.366775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d667d6b0-f244-4029-8fe4-a05e9f431a8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:15.367210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d667d6b0-f244-4029-8fe4-a05e9f431a8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:15.367900 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d667d6b0-f244-4029-8fe4-a05e9f431a8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:15.368814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d667d6b0-f244-4029-8fe4-a05e9f431a8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:15.369248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d667d6b0-f244-4029-8fe4-a05e9f431a8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:15.504090 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d667d6b0-f244-4029-8fe4-a05e9f431a8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:15.514035 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d667d6b0-f244-4029-8fe4-a05e9f431a8b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.165478 Sep 05 17:27:15.514615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1161/2164] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:15 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:15.567919 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-91fe06c2-92d9-4485-a653-b8567e59cbf5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:15.568587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-91fe06c2-92d9-4485-a653-b8567e59cbf5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:15.575432 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91fe06c2-92d9-4485-a653-b8567e59cbf5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:15.575911 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91fe06c2-92d9-4485-a653-b8567e59cbf5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:15.576346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91fe06c2-92d9-4485-a653-b8567e59cbf5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:15.577082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91fe06c2-92d9-4485-a653-b8567e59cbf5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:15.577644 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91fe06c2-92d9-4485-a653-b8567e59cbf5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:15.578064 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-91fe06c2-92d9-4485-a653-b8567e59cbf5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:15.729692 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-91fe06c2-92d9-4485-a653-b8567e59cbf5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:15.735674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-91fe06c2-92d9-4485-a653-b8567e59cbf5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.174119 Sep 05 17:27:15.736276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1004/2165] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:15 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:16.544009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-80d368b4-a442-41c9-8dab-309ad7f611dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:16.544708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-80d368b4-a442-41c9-8dab-309ad7f611dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:16.560775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d368b4-a442-41c9-8dab-309ad7f611dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:16.561278 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d368b4-a442-41c9-8dab-309ad7f611dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:16.561716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d368b4-a442-41c9-8dab-309ad7f611dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:16.562425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d368b4-a442-41c9-8dab-309ad7f611dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:16.562893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d368b4-a442-41c9-8dab-309ad7f611dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:16.563295 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80d368b4-a442-41c9-8dab-309ad7f611dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:16.710974 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-80d368b4-a442-41c9-8dab-309ad7f611dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:16.720426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-80d368b4-a442-41c9-8dab-309ad7f611dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.181114 Sep 05 17:27:16.720996 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1162/2166] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:16 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:16.767834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-18fd8238-c0b8-4595-bbcc-ebc31a3ad5b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:16.768514 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-18fd8238-c0b8-4595-bbcc-ebc31a3ad5b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:16.776217 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18fd8238-c0b8-4595-bbcc-ebc31a3ad5b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:16.776705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18fd8238-c0b8-4595-bbcc-ebc31a3ad5b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:16.777132 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18fd8238-c0b8-4595-bbcc-ebc31a3ad5b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:16.777818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18fd8238-c0b8-4595-bbcc-ebc31a3ad5b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:16.778273 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18fd8238-c0b8-4595-bbcc-ebc31a3ad5b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:16.778695 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-18fd8238-c0b8-4595-bbcc-ebc31a3ad5b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:16.917681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-18fd8238-c0b8-4595-bbcc-ebc31a3ad5b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:16.930954 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-18fd8238-c0b8-4595-bbcc-ebc31a3ad5b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.166808 Sep 05 17:27:16.931731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1005/2167] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:16 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:17.747960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a5e59402-fd57-446b-aafa-5956764d83d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:17.748944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a5e59402-fd57-446b-aafa-5956764d83d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:17.759564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5e59402-fd57-446b-aafa-5956764d83d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:17.760359 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5e59402-fd57-446b-aafa-5956764d83d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:17.761057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5e59402-fd57-446b-aafa-5956764d83d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:17.762077 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5e59402-fd57-446b-aafa-5956764d83d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:17.762814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5e59402-fd57-446b-aafa-5956764d83d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:17.763459 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5e59402-fd57-446b-aafa-5956764d83d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:17.909390 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a5e59402-fd57-446b-aafa-5956764d83d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:17.922397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a5e59402-fd57-446b-aafa-5956764d83d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.180211 Sep 05 17:27:17.923264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1163/2168] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:17 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:17.960938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0dd35cd7-d41c-432c-9c2c-bf7ce8ef86d1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:17.961511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0dd35cd7-d41c-432c-9c2c-bf7ce8ef86d1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:17.968926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0dd35cd7-d41c-432c-9c2c-bf7ce8ef86d1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:17.969416 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0dd35cd7-d41c-432c-9c2c-bf7ce8ef86d1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:17.969843 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0dd35cd7-d41c-432c-9c2c-bf7ce8ef86d1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:17.970533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0dd35cd7-d41c-432c-9c2c-bf7ce8ef86d1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:17.970980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0dd35cd7-d41c-432c-9c2c-bf7ce8ef86d1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:17.971403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0dd35cd7-d41c-432c-9c2c-bf7ce8ef86d1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:18.103769 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0dd35cd7-d41c-432c-9c2c-bf7ce8ef86d1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:18.117473 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0dd35cd7-d41c-432c-9c2c-bf7ce8ef86d1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.161319 Sep 05 17:27:18.118333 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1006/2169] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:17 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:18.948756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-944d2d32-2176-4e83-8f4d-bec07027fe00 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:18.949391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-944d2d32-2176-4e83-8f4d-bec07027fe00 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:18.959506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-944d2d32-2176-4e83-8f4d-bec07027fe00 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:18.961051 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-944d2d32-2176-4e83-8f4d-bec07027fe00 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:18.961699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-944d2d32-2176-4e83-8f4d-bec07027fe00 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:18.962668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-944d2d32-2176-4e83-8f4d-bec07027fe00 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:18.963476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-944d2d32-2176-4e83-8f4d-bec07027fe00 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:18.964114 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-944d2d32-2176-4e83-8f4d-bec07027fe00 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:19.108523 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-944d2d32-2176-4e83-8f4d-bec07027fe00 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:19.118234 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-944d2d32-2176-4e83-8f4d-bec07027fe00 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.173732 Sep 05 17:27:19.118808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1164/2170] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:18 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:19.144714 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8b2509d5-b5bd-43f4-94d6-cdb084bf6444 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:19.145274 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8b2509d5-b5bd-43f4-94d6-cdb084bf6444 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:19.155449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b2509d5-b5bd-43f4-94d6-cdb084bf6444 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:19.156046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b2509d5-b5bd-43f4-94d6-cdb084bf6444 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:19.156621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b2509d5-b5bd-43f4-94d6-cdb084bf6444 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:19.157576 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b2509d5-b5bd-43f4-94d6-cdb084bf6444 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:19.158168 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b2509d5-b5bd-43f4-94d6-cdb084bf6444 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:19.158751 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8b2509d5-b5bd-43f4-94d6-cdb084bf6444 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:19.295891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8b2509d5-b5bd-43f4-94d6-cdb084bf6444 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:19.304697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8b2509d5-b5bd-43f4-94d6-cdb084bf6444 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.166489 Sep 05 17:27:19.305277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1007/2171] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:19 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:20.146807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-abc084b7-0223-46cb-aea4-cacd3a029ea6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:20.147568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-abc084b7-0223-46cb-aea4-cacd3a029ea6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:20.155503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abc084b7-0223-46cb-aea4-cacd3a029ea6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:20.156069 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abc084b7-0223-46cb-aea4-cacd3a029ea6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:20.157476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abc084b7-0223-46cb-aea4-cacd3a029ea6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:20.158334 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abc084b7-0223-46cb-aea4-cacd3a029ea6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:20.158849 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abc084b7-0223-46cb-aea4-cacd3a029ea6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:20.159379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abc084b7-0223-46cb-aea4-cacd3a029ea6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:20.296712 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-abc084b7-0223-46cb-aea4-cacd3a029ea6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:20.306210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-abc084b7-0223-46cb-aea4-cacd3a029ea6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.165847 Sep 05 17:27:20.306761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1165/2172] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:20 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:20.331056 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-49ff7ae9-aaff-4afe-90ef-016c33ef6ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:20.331656 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-49ff7ae9-aaff-4afe-90ef-016c33ef6ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:20.341692 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49ff7ae9-aaff-4afe-90ef-016c33ef6ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:20.342338 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49ff7ae9-aaff-4afe-90ef-016c33ef6ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:20.342908 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49ff7ae9-aaff-4afe-90ef-016c33ef6ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:20.343844 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49ff7ae9-aaff-4afe-90ef-016c33ef6ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:20.344526 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49ff7ae9-aaff-4afe-90ef-016c33ef6ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:20.345083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-49ff7ae9-aaff-4afe-90ef-016c33ef6ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:20.485388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-49ff7ae9-aaff-4afe-90ef-016c33ef6ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:20.497321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-49ff7ae9-aaff-4afe-90ef-016c33ef6ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.172439 Sep 05 17:27:20.498206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1008/2173] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:20 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:21.334053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ba59d20b-78a9-4c4e-8586-ce3c964c0070 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:21.335070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ba59d20b-78a9-4c4e-8586-ce3c964c0070 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:21.346272 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba59d20b-78a9-4c4e-8586-ce3c964c0070 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:21.347071 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba59d20b-78a9-4c4e-8586-ce3c964c0070 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:21.347782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba59d20b-78a9-4c4e-8586-ce3c964c0070 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:21.348970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba59d20b-78a9-4c4e-8586-ce3c964c0070 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:21.349588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba59d20b-78a9-4c4e-8586-ce3c964c0070 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:21.350008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba59d20b-78a9-4c4e-8586-ce3c964c0070 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:21.484818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ba59d20b-78a9-4c4e-8586-ce3c964c0070 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:21.494275 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ba59d20b-78a9-4c4e-8586-ce3c964c0070 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.167110 Sep 05 17:27:21.494819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1166/2174] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:21 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:21.523993 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3ff274bb-3391-40cc-bd4e-a5b04d0d4ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:21.524623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3ff274bb-3391-40cc-bd4e-a5b04d0d4ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:21.531374 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ff274bb-3391-40cc-bd4e-a5b04d0d4ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:21.531853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ff274bb-3391-40cc-bd4e-a5b04d0d4ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:21.532313 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ff274bb-3391-40cc-bd4e-a5b04d0d4ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:21.533025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ff274bb-3391-40cc-bd4e-a5b04d0d4ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:21.533474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ff274bb-3391-40cc-bd4e-a5b04d0d4ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:21.533885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3ff274bb-3391-40cc-bd4e-a5b04d0d4ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:21.678474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3ff274bb-3391-40cc-bd4e-a5b04d0d4ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:21.687058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3ff274bb-3391-40cc-bd4e-a5b04d0d4ea1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.167115 Sep 05 17:27:21.687555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1009/2175] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:21 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:22.522705 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f753545d-68c9-4ac9-a0d1-d4416055a05c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:22.523344 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f753545d-68c9-4ac9-a0d1-d4416055a05c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:22.530495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f753545d-68c9-4ac9-a0d1-d4416055a05c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:22.530992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f753545d-68c9-4ac9-a0d1-d4416055a05c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:22.531439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f753545d-68c9-4ac9-a0d1-d4416055a05c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:22.532178 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f753545d-68c9-4ac9-a0d1-d4416055a05c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:22.532655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f753545d-68c9-4ac9-a0d1-d4416055a05c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:22.533093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f753545d-68c9-4ac9-a0d1-d4416055a05c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:22.666750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f753545d-68c9-4ac9-a0d1-d4416055a05c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:22.675643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f753545d-68c9-4ac9-a0d1-d4416055a05c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.159247 Sep 05 17:27:22.676217 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1167/2176] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:22 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:22.710257 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f8d08e0a-c334-4412-a28a-512d09d39d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:22.710820 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f8d08e0a-c334-4412-a28a-512d09d39d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:22.717963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d08e0a-c334-4412-a28a-512d09d39d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:22.718431 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d08e0a-c334-4412-a28a-512d09d39d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:22.718864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d08e0a-c334-4412-a28a-512d09d39d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:22.719549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d08e0a-c334-4412-a28a-512d09d39d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:22.719990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d08e0a-c334-4412-a28a-512d09d39d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:22.720438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d08e0a-c334-4412-a28a-512d09d39d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:22.855421 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f8d08e0a-c334-4412-a28a-512d09d39d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:22.863907 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f8d08e0a-c334-4412-a28a-512d09d39d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.157691 Sep 05 17:27:22.864511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1010/2177] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:22 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:23.702976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3e7c8251-e810-430c-98f0-19511956e3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:23.703950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3e7c8251-e810-430c-98f0-19511956e3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:23.713248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e7c8251-e810-430c-98f0-19511956e3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:23.713725 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e7c8251-e810-430c-98f0-19511956e3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:23.714151 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e7c8251-e810-430c-98f0-19511956e3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:23.714860 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e7c8251-e810-430c-98f0-19511956e3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:23.715299 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e7c8251-e810-430c-98f0-19511956e3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:23.715717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e7c8251-e810-430c-98f0-19511956e3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:23.851064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3e7c8251-e810-430c-98f0-19511956e3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:23.859584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3e7c8251-e810-430c-98f0-19511956e3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.163286 Sep 05 17:27:23.860174 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1168/2178] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:23 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:23.887462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9a106952-7b87-4d39-a48f-ba8213099056 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:23.888018 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9a106952-7b87-4d39-a48f-ba8213099056 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:23.895520 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a106952-7b87-4d39-a48f-ba8213099056 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:23.895990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a106952-7b87-4d39-a48f-ba8213099056 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:23.896523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a106952-7b87-4d39-a48f-ba8213099056 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:23.897372 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a106952-7b87-4d39-a48f-ba8213099056 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:23.897830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a106952-7b87-4d39-a48f-ba8213099056 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:23.898244 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9a106952-7b87-4d39-a48f-ba8213099056 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:24.038881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9a106952-7b87-4d39-a48f-ba8213099056 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:24.051358 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9a106952-7b87-4d39-a48f-ba8213099056 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.167525 Sep 05 17:27:24.052100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1011/2179] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:23 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:24.884754 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cee79ed3-131a-41d4-a91d-78b70175b196 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:24.885512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cee79ed3-131a-41d4-a91d-78b70175b196 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:24.894156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cee79ed3-131a-41d4-a91d-78b70175b196 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:24.894751 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cee79ed3-131a-41d4-a91d-78b70175b196 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:24.895283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cee79ed3-131a-41d4-a91d-78b70175b196 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:24.896141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cee79ed3-131a-41d4-a91d-78b70175b196 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:24.897326 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cee79ed3-131a-41d4-a91d-78b70175b196 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:24.897862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cee79ed3-131a-41d4-a91d-78b70175b196 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:25.043226 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cee79ed3-131a-41d4-a91d-78b70175b196 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:25.051767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cee79ed3-131a-41d4-a91d-78b70175b196 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.172353 Sep 05 17:27:25.052366 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1169/2180] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:24 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:25.075239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-54669299-5d0c-4f17-b555-892f040fae04 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:25.075841 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-54669299-5d0c-4f17-b555-892f040fae04 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:25.083103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54669299-5d0c-4f17-b555-892f040fae04 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:25.083587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54669299-5d0c-4f17-b555-892f040fae04 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:25.084027 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54669299-5d0c-4f17-b555-892f040fae04 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:25.084779 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54669299-5d0c-4f17-b555-892f040fae04 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:25.085235 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54669299-5d0c-4f17-b555-892f040fae04 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:25.085658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54669299-5d0c-4f17-b555-892f040fae04 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:25.223367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-54669299-5d0c-4f17-b555-892f040fae04 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:25.235281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-54669299-5d0c-4f17-b555-892f040fae04 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.163677 Sep 05 17:27:25.236045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1012/2181] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:25 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:26.081668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4226e6c2-8888-4010-ab51-5e8df98640a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:26.082649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4226e6c2-8888-4010-ab51-5e8df98640a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:26.090218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4226e6c2-8888-4010-ab51-5e8df98640a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:26.090709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4226e6c2-8888-4010-ab51-5e8df98640a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:26.091516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4226e6c2-8888-4010-ab51-5e8df98640a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:26.092211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4226e6c2-8888-4010-ab51-5e8df98640a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:26.092727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4226e6c2-8888-4010-ab51-5e8df98640a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:26.093132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4226e6c2-8888-4010-ab51-5e8df98640a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:26.229316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4226e6c2-8888-4010-ab51-5e8df98640a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:26.237667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4226e6c2-8888-4010-ab51-5e8df98640a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.162613 Sep 05 17:27:26.238241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1170/2182] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:26 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:26.261097 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7854ea54-49bb-4896-86dc-821f856ff9bc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:26.261685 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7854ea54-49bb-4896-86dc-821f856ff9bc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:26.270458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7854ea54-49bb-4896-86dc-821f856ff9bc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:26.271009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7854ea54-49bb-4896-86dc-821f856ff9bc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:26.271744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7854ea54-49bb-4896-86dc-821f856ff9bc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:26.272535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7854ea54-49bb-4896-86dc-821f856ff9bc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:26.272995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7854ea54-49bb-4896-86dc-821f856ff9bc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:26.273420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7854ea54-49bb-4896-86dc-821f856ff9bc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:26.421159 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7854ea54-49bb-4896-86dc-821f856ff9bc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:26.429869 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7854ea54-49bb-4896-86dc-821f856ff9bc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.174454 Sep 05 17:27:26.430449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1013/2183] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:26 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:27.261198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-66657208-5200-435d-8ecd-3f3f17465abf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:27.261834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-66657208-5200-435d-8ecd-3f3f17465abf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:27.264270 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=50 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:27:27.269364 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66657208-5200-435d-8ecd-3f3f17465abf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:27.269843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66657208-5200-435d-8ecd-3f3f17465abf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:27.270266 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66657208-5200-435d-8ecd-3f3f17465abf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:27.270952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66657208-5200-435d-8ecd-3f3f17465abf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:27.271423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66657208-5200-435d-8ecd-3f3f17465abf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:27.272052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66657208-5200-435d-8ecd-3f3f17465abf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:27.408473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-66657208-5200-435d-8ecd-3f3f17465abf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:27.417953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-66657208-5200-435d-8ecd-3f3f17465abf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.160670 Sep 05 17:27:27.418530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1171/2184] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:27 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:27.456228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-846858b1-6ee8-40c6-ab12-7886d22d43ff tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:27.456971 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-846858b1-6ee8-40c6-ab12-7886d22d43ff tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:27.460445 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=50 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:27:27.465990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-846858b1-6ee8-40c6-ab12-7886d22d43ff tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:27.466819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-846858b1-6ee8-40c6-ab12-7886d22d43ff tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:27.467272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-846858b1-6ee8-40c6-ab12-7886d22d43ff tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:27.467954 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-846858b1-6ee8-40c6-ab12-7886d22d43ff tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:27.468424 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-846858b1-6ee8-40c6-ab12-7886d22d43ff tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:27.468832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-846858b1-6ee8-40c6-ab12-7886d22d43ff tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:27.605793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-846858b1-6ee8-40c6-ab12-7886d22d43ff tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:27.617835 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-846858b1-6ee8-40c6-ab12-7886d22d43ff tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.167411 Sep 05 17:27:27.618416 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1014/2185] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:27 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:28.446940 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2d11084d-53a2-4bb6-aaf2-d0bc0ba925dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:28.448030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2d11084d-53a2-4bb6-aaf2-d0bc0ba925dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:28.458245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d11084d-53a2-4bb6-aaf2-d0bc0ba925dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:28.459203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d11084d-53a2-4bb6-aaf2-d0bc0ba925dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:28.459680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d11084d-53a2-4bb6-aaf2-d0bc0ba925dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:28.460492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d11084d-53a2-4bb6-aaf2-d0bc0ba925dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:28.460946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d11084d-53a2-4bb6-aaf2-d0bc0ba925dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:28.461364 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d11084d-53a2-4bb6-aaf2-d0bc0ba925dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:28.605722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2d11084d-53a2-4bb6-aaf2-d0bc0ba925dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:28.614547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2d11084d-53a2-4bb6-aaf2-d0bc0ba925dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.175164 Sep 05 17:27:28.615094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1172/2186] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:28 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:28.641224 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d6dc1676-528a-4dbb-ad05-ec1679a6e34c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:28.641778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d6dc1676-528a-4dbb-ad05-ec1679a6e34c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:28.648678 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d6dc1676-528a-4dbb-ad05-ec1679a6e34c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:28.649158 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d6dc1676-528a-4dbb-ad05-ec1679a6e34c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:28.649582 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d6dc1676-528a-4dbb-ad05-ec1679a6e34c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:28.650270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d6dc1676-528a-4dbb-ad05-ec1679a6e34c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:28.650715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d6dc1676-528a-4dbb-ad05-ec1679a6e34c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:28.651127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d6dc1676-528a-4dbb-ad05-ec1679a6e34c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:28.797480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d6dc1676-528a-4dbb-ad05-ec1679a6e34c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:28.806337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d6dc1676-528a-4dbb-ad05-ec1679a6e34c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.169095 Sep 05 17:27:28.806906 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1015/2187] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:28 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:29.643481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f10c03db-30f1-4ffa-9c69-85775b62b588 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:29.644505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f10c03db-30f1-4ffa-9c69-85775b62b588 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:29.655684 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10c03db-30f1-4ffa-9c69-85775b62b588 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:29.656561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10c03db-30f1-4ffa-9c69-85775b62b588 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:29.657288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10c03db-30f1-4ffa-9c69-85775b62b588 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:29.658429 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10c03db-30f1-4ffa-9c69-85775b62b588 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:29.659183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10c03db-30f1-4ffa-9c69-85775b62b588 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:29.659895 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10c03db-30f1-4ffa-9c69-85775b62b588 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:29.798628 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f10c03db-30f1-4ffa-9c69-85775b62b588 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:29.807843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f10c03db-30f1-4ffa-9c69-85775b62b588 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.171207 Sep 05 17:27:29.808458 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1173/2188] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:29 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:29.830771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9d11b216-0f91-4259-a0c4-de367e7c45c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:29.831356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9d11b216-0f91-4259-a0c4-de367e7c45c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:29.838534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9d11b216-0f91-4259-a0c4-de367e7c45c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:29.839016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9d11b216-0f91-4259-a0c4-de367e7c45c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:29.839535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9d11b216-0f91-4259-a0c4-de367e7c45c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:29.840256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9d11b216-0f91-4259-a0c4-de367e7c45c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:29.840723 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9d11b216-0f91-4259-a0c4-de367e7c45c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:29.841489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9d11b216-0f91-4259-a0c4-de367e7c45c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:29.979774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9d11b216-0f91-4259-a0c4-de367e7c45c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:29.988427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9d11b216-0f91-4259-a0c4-de367e7c45c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.161546 Sep 05 17:27:29.989216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1016/2189] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:29 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:30.835321 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8b096ca4-6584-4c14-a634-c4fabce04142 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:30.836509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8b096ca4-6584-4c14-a634-c4fabce04142 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:30.847641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b096ca4-6584-4c14-a634-c4fabce04142 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:30.848508 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b096ca4-6584-4c14-a634-c4fabce04142 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:30.849223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b096ca4-6584-4c14-a634-c4fabce04142 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:30.850463 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b096ca4-6584-4c14-a634-c4fabce04142 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:30.850943 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b096ca4-6584-4c14-a634-c4fabce04142 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:30.851367 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b096ca4-6584-4c14-a634-c4fabce04142 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:30.992224 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8b096ca4-6584-4c14-a634-c4fabce04142 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:31.000884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8b096ca4-6584-4c14-a634-c4fabce04142 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.172307 Sep 05 17:27:31.001453 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1174/2190] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:30 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:31.020449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-417390c7-7bfa-4663-b322-608ac3b50330 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:31.021031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-417390c7-7bfa-4663-b322-608ac3b50330 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:31.031046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-417390c7-7bfa-4663-b322-608ac3b50330 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:31.031708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-417390c7-7bfa-4663-b322-608ac3b50330 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:31.032321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-417390c7-7bfa-4663-b322-608ac3b50330 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:31.033367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-417390c7-7bfa-4663-b322-608ac3b50330 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:31.033995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-417390c7-7bfa-4663-b322-608ac3b50330 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:31.034612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-417390c7-7bfa-4663-b322-608ac3b50330 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:31.177069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-417390c7-7bfa-4663-b322-608ac3b50330 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:31.186212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-417390c7-7bfa-4663-b322-608ac3b50330 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.171156 Sep 05 17:27:31.186804 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1017/2191] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:31 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:32.026976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-42206902-a477-4a00-ada8-4f70796ec52d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:32.027768 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-42206902-a477-4a00-ada8-4f70796ec52d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:32.036108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42206902-a477-4a00-ada8-4f70796ec52d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:32.036758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42206902-a477-4a00-ada8-4f70796ec52d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:32.037277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42206902-a477-4a00-ada8-4f70796ec52d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:32.038284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42206902-a477-4a00-ada8-4f70796ec52d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:32.038859 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42206902-a477-4a00-ada8-4f70796ec52d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:32.039389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42206902-a477-4a00-ada8-4f70796ec52d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:32.184230 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-42206902-a477-4a00-ada8-4f70796ec52d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:32.193691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-42206902-a477-4a00-ada8-4f70796ec52d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.171799 Sep 05 17:27:32.194265 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1175/2192] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:32 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:32.210338 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cc7b3786-c6c5-4f8f-b3a8-6aff4ef7bff9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:32.210989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cc7b3786-c6c5-4f8f-b3a8-6aff4ef7bff9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:32.218120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc7b3786-c6c5-4f8f-b3a8-6aff4ef7bff9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:32.218603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc7b3786-c6c5-4f8f-b3a8-6aff4ef7bff9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:32.219036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc7b3786-c6c5-4f8f-b3a8-6aff4ef7bff9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:32.219729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc7b3786-c6c5-4f8f-b3a8-6aff4ef7bff9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:32.220187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc7b3786-c6c5-4f8f-b3a8-6aff4ef7bff9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:32.220658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cc7b3786-c6c5-4f8f-b3a8-6aff4ef7bff9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:32.361281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cc7b3786-c6c5-4f8f-b3a8-6aff4ef7bff9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:32.363498 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:27:32.371019 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cc7b3786-c6c5-4f8f-b3a8-6aff4ef7bff9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.164806 Sep 05 17:27:32.371576 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1018/2193] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:32 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:33.217942 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-82513b3b-06a7-4280-a19d-1fd0b5e0026a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:33.218577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-82513b3b-06a7-4280-a19d-1fd0b5e0026a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:33.225246 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82513b3b-06a7-4280-a19d-1fd0b5e0026a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:33.225699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82513b3b-06a7-4280-a19d-1fd0b5e0026a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:33.226122 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82513b3b-06a7-4280-a19d-1fd0b5e0026a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:33.226789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82513b3b-06a7-4280-a19d-1fd0b5e0026a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:33.227227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82513b3b-06a7-4280-a19d-1fd0b5e0026a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:33.227638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82513b3b-06a7-4280-a19d-1fd0b5e0026a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:33.371661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-82513b3b-06a7-4280-a19d-1fd0b5e0026a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:33.373940 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:27:33.381788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-82513b3b-06a7-4280-a19d-1fd0b5e0026a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.168237 Sep 05 17:27:33.382370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1176/2194] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:33 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:33.394580 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9bc04422-09e8-41ce-b7a6-c5fa402f6db5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:33.395201 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9bc04422-09e8-41ce-b7a6-c5fa402f6db5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:33.401871 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9bc04422-09e8-41ce-b7a6-c5fa402f6db5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:33.402386 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9bc04422-09e8-41ce-b7a6-c5fa402f6db5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:33.402809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9bc04422-09e8-41ce-b7a6-c5fa402f6db5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:33.403484 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9bc04422-09e8-41ce-b7a6-c5fa402f6db5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:33.403926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9bc04422-09e8-41ce-b7a6-c5fa402f6db5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:33.404373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9bc04422-09e8-41ce-b7a6-c5fa402f6db5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:33.538807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9bc04422-09e8-41ce-b7a6-c5fa402f6db5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:33.547582 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9bc04422-09e8-41ce-b7a6-c5fa402f6db5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.157176 Sep 05 17:27:33.548177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1019/2195] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:33 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:34.405128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f3334dec-ece2-4c77-b5a4-db00341c23a6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:34.405740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f3334dec-ece2-4c77-b5a4-db00341c23a6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:34.412489 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3334dec-ece2-4c77-b5a4-db00341c23a6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:34.412949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3334dec-ece2-4c77-b5a4-db00341c23a6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:34.413373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3334dec-ece2-4c77-b5a4-db00341c23a6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:34.414055 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3334dec-ece2-4c77-b5a4-db00341c23a6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:34.414716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3334dec-ece2-4c77-b5a4-db00341c23a6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:34.415224 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3334dec-ece2-4c77-b5a4-db00341c23a6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:34.548108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f3334dec-ece2-4c77-b5a4-db00341c23a6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:34.556866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f3334dec-ece2-4c77-b5a4-db00341c23a6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.155741 Sep 05 17:27:34.557445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1177/2196] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:34 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:34.570710 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-16f47013-7260-4ff3-b6a5-7aeaaa4cd803 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:34.571286 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-16f47013-7260-4ff3-b6a5-7aeaaa4cd803 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:34.578236 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-16f47013-7260-4ff3-b6a5-7aeaaa4cd803 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:34.578718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-16f47013-7260-4ff3-b6a5-7aeaaa4cd803 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:34.579146 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-16f47013-7260-4ff3-b6a5-7aeaaa4cd803 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:34.579838 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-16f47013-7260-4ff3-b6a5-7aeaaa4cd803 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:34.580328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-16f47013-7260-4ff3-b6a5-7aeaaa4cd803 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:34.580749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-16f47013-7260-4ff3-b6a5-7aeaaa4cd803 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:34.722074 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-16f47013-7260-4ff3-b6a5-7aeaaa4cd803 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:34.731057 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-16f47013-7260-4ff3-b6a5-7aeaaa4cd803 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.164512 Sep 05 17:27:34.731632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1020/2197] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:34 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:35.584403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9d9d658b-0a56-427f-8199-94130870506a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:35.585341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9d9d658b-0a56-427f-8199-94130870506a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:35.597350 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9d658b-0a56-427f-8199-94130870506a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:35.598150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9d658b-0a56-427f-8199-94130870506a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:35.598855 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9d658b-0a56-427f-8199-94130870506a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:35.599927 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9d658b-0a56-427f-8199-94130870506a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:35.600394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9d658b-0a56-427f-8199-94130870506a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:35.600812 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9d658b-0a56-427f-8199-94130870506a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:35.750402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9d9d658b-0a56-427f-8199-94130870506a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:35.756192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ec410c03-a458-48b1-b725-2b13756dd55d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:35.757028 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ec410c03-a458-48b1-b725-2b13756dd55d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:35.762774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9d9d658b-0a56-427f-8199-94130870506a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.184753 Sep 05 17:27:35.763598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1178/2198] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:35 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:35.766425 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec410c03-a458-48b1-b725-2b13756dd55d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:35.767025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec410c03-a458-48b1-b725-2b13756dd55d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:35.767604 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec410c03-a458-48b1-b725-2b13756dd55d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:35.768727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec410c03-a458-48b1-b725-2b13756dd55d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:35.769390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec410c03-a458-48b1-b725-2b13756dd55d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:35.769998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec410c03-a458-48b1-b725-2b13756dd55d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:35.906342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ec410c03-a458-48b1-b725-2b13756dd55d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:35.915599 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ec410c03-a458-48b1-b725-2b13756dd55d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.164962 Sep 05 17:27:35.916173 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1021/2199] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:35 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:36.852603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b16be4c6-fe95-4419-924a-b69672fbbd32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:36.853391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b16be4c6-fe95-4419-924a-b69672fbbd32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:36.862001 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b16be4c6-fe95-4419-924a-b69672fbbd32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:36.862629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b16be4c6-fe95-4419-924a-b69672fbbd32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:36.863217 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b16be4c6-fe95-4419-924a-b69672fbbd32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:36.864095 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b16be4c6-fe95-4419-924a-b69672fbbd32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:36.864726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b16be4c6-fe95-4419-924a-b69672fbbd32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:36.865603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b16be4c6-fe95-4419-924a-b69672fbbd32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:36.945251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a1a340a3-21aa-4a26-bd5f-83c65cb5ccfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:36.946002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a1a340a3-21aa-4a26-bd5f-83c65cb5ccfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:36.952805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1a340a3-21aa-4a26-bd5f-83c65cb5ccfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:36.953283 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1a340a3-21aa-4a26-bd5f-83c65cb5ccfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:36.953702 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1a340a3-21aa-4a26-bd5f-83c65cb5ccfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:36.954422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1a340a3-21aa-4a26-bd5f-83c65cb5ccfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:36.954862 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1a340a3-21aa-4a26-bd5f-83c65cb5ccfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:36.955256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1a340a3-21aa-4a26-bd5f-83c65cb5ccfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:37.039647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b16be4c6-fe95-4419-924a-b69672fbbd32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:37.048203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b16be4c6-fe95-4419-924a-b69672fbbd32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.201004 Sep 05 17:27:37.048817 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1179/2200] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:36 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:37.099625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a1a340a3-21aa-4a26-bd5f-83c65cb5ccfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:37.108097 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a1a340a3-21aa-4a26-bd5f-83c65cb5ccfd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.167947 Sep 05 17:27:37.108589 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1022/2201] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:36 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:38.075460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-62e3f7c3-7cf1-40cb-a95f-2cea21dea268 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:38.076451 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-62e3f7c3-7cf1-40cb-a95f-2cea21dea268 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:38.086144 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62e3f7c3-7cf1-40cb-a95f-2cea21dea268 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:38.086619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62e3f7c3-7cf1-40cb-a95f-2cea21dea268 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:38.087049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62e3f7c3-7cf1-40cb-a95f-2cea21dea268 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:38.087729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62e3f7c3-7cf1-40cb-a95f-2cea21dea268 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:38.088186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62e3f7c3-7cf1-40cb-a95f-2cea21dea268 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:38.088624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62e3f7c3-7cf1-40cb-a95f-2cea21dea268 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:38.133589 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-976383d7-ca92-471e-9477-1a1a09095677 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:38.134308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-976383d7-ca92-471e-9477-1a1a09095677 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:38.141096 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-976383d7-ca92-471e-9477-1a1a09095677 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:38.141575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-976383d7-ca92-471e-9477-1a1a09095677 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:38.141996 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-976383d7-ca92-471e-9477-1a1a09095677 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:38.142691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-976383d7-ca92-471e-9477-1a1a09095677 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:38.143135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-976383d7-ca92-471e-9477-1a1a09095677 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:38.143549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-976383d7-ca92-471e-9477-1a1a09095677 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:38.278325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-62e3f7c3-7cf1-40cb-a95f-2cea21dea268 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:38.287573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-62e3f7c3-7cf1-40cb-a95f-2cea21dea268 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.218299 Sep 05 17:27:38.288288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1180/2202] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:38 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:38.305165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-976383d7-ca92-471e-9477-1a1a09095677 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:38.313858 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-976383d7-ca92-471e-9477-1a1a09095677 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.186174 Sep 05 17:27:38.314407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1023/2203] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:38 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:39.315492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-edaf8f4b-581f-437f-887a-f80dc568cbf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:39.316538 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-edaf8f4b-581f-437f-887a-f80dc568cbf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:39.324608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edaf8f4b-581f-437f-887a-f80dc568cbf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:39.325111 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edaf8f4b-581f-437f-887a-f80dc568cbf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:39.325547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edaf8f4b-581f-437f-887a-f80dc568cbf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:39.326240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edaf8f4b-581f-437f-887a-f80dc568cbf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:39.326691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edaf8f4b-581f-437f-887a-f80dc568cbf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:39.327111 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edaf8f4b-581f-437f-887a-f80dc568cbf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:39.337235 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-68ce2c82-94ba-4ee5-a30d-094cfe6b922e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:39.337793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-68ce2c82-94ba-4ee5-a30d-094cfe6b922e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:39.345126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68ce2c82-94ba-4ee5-a30d-094cfe6b922e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:39.345603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68ce2c82-94ba-4ee5-a30d-094cfe6b922e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:39.346027 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68ce2c82-94ba-4ee5-a30d-094cfe6b922e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:39.346717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68ce2c82-94ba-4ee5-a30d-094cfe6b922e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:39.347159 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68ce2c82-94ba-4ee5-a30d-094cfe6b922e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:39.347574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-68ce2c82-94ba-4ee5-a30d-094cfe6b922e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:39.523323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-edaf8f4b-581f-437f-887a-f80dc568cbf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:39.530353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-68ce2c82-94ba-4ee5-a30d-094cfe6b922e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:39.532132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-edaf8f4b-581f-437f-887a-f80dc568cbf5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.223548 Sep 05 17:27:39.532758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1181/2204] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:39 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:39.539640 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-68ce2c82-94ba-4ee5-a30d-094cfe6b922e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.206494 Sep 05 17:27:39.540354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1024/2205] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:39 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:40.558153 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6e68427e-331b-4616-aa73-004a042dcc7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:40.559058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6e68427e-331b-4616-aa73-004a042dcc7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:40.563286 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d22036e6-2668-4afb-941d-aa6017989b62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:40.563933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d22036e6-2668-4afb-941d-aa6017989b62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:40.565893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e68427e-331b-4616-aa73-004a042dcc7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:40.566378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e68427e-331b-4616-aa73-004a042dcc7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:40.566772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e68427e-331b-4616-aa73-004a042dcc7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:40.567495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e68427e-331b-4616-aa73-004a042dcc7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:40.567936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e68427e-331b-4616-aa73-004a042dcc7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:40.568391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e68427e-331b-4616-aa73-004a042dcc7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:40.571431 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d22036e6-2668-4afb-941d-aa6017989b62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:40.571908 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d22036e6-2668-4afb-941d-aa6017989b62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:40.572373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d22036e6-2668-4afb-941d-aa6017989b62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:40.573063 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d22036e6-2668-4afb-941d-aa6017989b62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:40.573508 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d22036e6-2668-4afb-941d-aa6017989b62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:40.573922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d22036e6-2668-4afb-941d-aa6017989b62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:40.759540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6e68427e-331b-4616-aa73-004a042dcc7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:40.763656 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d22036e6-2668-4afb-941d-aa6017989b62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:40.768404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6e68427e-331b-4616-aa73-004a042dcc7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.215634 Sep 05 17:27:40.768989 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1182/2206] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:40 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:40.772817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d22036e6-2668-4afb-941d-aa6017989b62 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.213332 Sep 05 17:27:40.773386 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1025/2207] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:40 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:41.796712 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-99a05eb6-1741-4b36-9a59-8e4ae9a1f4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:41.797960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-99a05eb6-1741-4b36-9a59-8e4ae9a1f4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:41.802281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-96de9dd5-c50e-42e9-85d3-0deb2c65dceb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:41.803283 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-96de9dd5-c50e-42e9-85d3-0deb2c65dceb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:41.807575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99a05eb6-1741-4b36-9a59-8e4ae9a1f4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:41.808142 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99a05eb6-1741-4b36-9a59-8e4ae9a1f4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:41.808673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99a05eb6-1741-4b36-9a59-8e4ae9a1f4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:41.809351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99a05eb6-1741-4b36-9a59-8e4ae9a1f4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:41.809807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99a05eb6-1741-4b36-9a59-8e4ae9a1f4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:41.810225 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99a05eb6-1741-4b36-9a59-8e4ae9a1f4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:41.810352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96de9dd5-c50e-42e9-85d3-0deb2c65dceb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:41.810766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96de9dd5-c50e-42e9-85d3-0deb2c65dceb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:41.811190 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96de9dd5-c50e-42e9-85d3-0deb2c65dceb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:41.811928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96de9dd5-c50e-42e9-85d3-0deb2c65dceb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:41.812522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96de9dd5-c50e-42e9-85d3-0deb2c65dceb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:41.812932 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96de9dd5-c50e-42e9-85d3-0deb2c65dceb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:42.001325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-99a05eb6-1741-4b36-9a59-8e4ae9a1f4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:42.009800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-96de9dd5-c50e-42e9-85d3-0deb2c65dceb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:42.013064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-99a05eb6-1741-4b36-9a59-8e4ae9a1f4f7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.222900 Sep 05 17:27:42.013978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1183/2208] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:41 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:42.022601 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-96de9dd5-c50e-42e9-85d3-0deb2c65dceb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.227011 Sep 05 17:27:42.023196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1026/2209] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:41 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:43.044800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a2814ed5-898c-4824-9808-cc8c807d1030 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:43.045753 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a2814ed5-898c-4824-9808-cc8c807d1030 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:43.054488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-420923e2-fb00-4f3c-8be3-ded9d45dc8d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:43.055441 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-420923e2-fb00-4f3c-8be3-ded9d45dc8d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:43.056798 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2814ed5-898c-4824-9808-cc8c807d1030 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:43.057598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2814ed5-898c-4824-9808-cc8c807d1030 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:43.058317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2814ed5-898c-4824-9808-cc8c807d1030 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:43.059449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2814ed5-898c-4824-9808-cc8c807d1030 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:43.060231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2814ed5-898c-4824-9808-cc8c807d1030 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:43.060933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2814ed5-898c-4824-9808-cc8c807d1030 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:43.065187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-420923e2-fb00-4f3c-8be3-ded9d45dc8d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:43.065963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-420923e2-fb00-4f3c-8be3-ded9d45dc8d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:43.066666 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-420923e2-fb00-4f3c-8be3-ded9d45dc8d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:43.067791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-420923e2-fb00-4f3c-8be3-ded9d45dc8d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:43.068571 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-420923e2-fb00-4f3c-8be3-ded9d45dc8d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:43.069464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-420923e2-fb00-4f3c-8be3-ded9d45dc8d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:43.482629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a2814ed5-898c-4824-9808-cc8c807d1030 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:43.487406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-420923e2-fb00-4f3c-8be3-ded9d45dc8d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:43.491647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a2814ed5-898c-4824-9808-cc8c807d1030 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.453088 Sep 05 17:27:43.492229 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1184/2210] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:43 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:43.496586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-420923e2-fb00-4f3c-8be3-ded9d45dc8d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.448775 Sep 05 17:27:43.497265 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1027/2211] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:43 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:44.519360 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bd413f10-4337-4864-a2ff-dc8d905518e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:44.520552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bd413f10-4337-4864-a2ff-dc8d905518e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:44.524229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2b2a0746-01e2-4c10-b450-860ddc0202f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:44.525217 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2b2a0746-01e2-4c10-b450-860ddc0202f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:44.531632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd413f10-4337-4864-a2ff-dc8d905518e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:44.532506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd413f10-4337-4864-a2ff-dc8d905518e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:44.533217 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd413f10-4337-4864-a2ff-dc8d905518e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:44.534355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd413f10-4337-4864-a2ff-dc8d905518e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:44.535105 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd413f10-4337-4864-a2ff-dc8d905518e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:44.535778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd413f10-4337-4864-a2ff-dc8d905518e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:44.535980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b2a0746-01e2-4c10-b450-860ddc0202f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:44.536749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b2a0746-01e2-4c10-b450-860ddc0202f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:44.537440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b2a0746-01e2-4c10-b450-860ddc0202f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:44.538525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b2a0746-01e2-4c10-b450-860ddc0202f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:44.538992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b2a0746-01e2-4c10-b450-860ddc0202f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:44.539404 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b2a0746-01e2-4c10-b450-860ddc0202f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:44.726511 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bd413f10-4337-4864-a2ff-dc8d905518e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:44.731409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2b2a0746-01e2-4c10-b450-860ddc0202f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:44.737703 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bd413f10-4337-4864-a2ff-dc8d905518e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.224765 Sep 05 17:27:44.738519 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1185/2212] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:44 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:44.742544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2b2a0746-01e2-4c10-b450-860ddc0202f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.224880 Sep 05 17:27:44.743071 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1028/2213] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:44 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:44.893785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-44fc8d80-19c9-48db-9052-4684b938fd10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:44.894321 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-44fc8d80-19c9-48db-9052-4684b938fd10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:44.901688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44fc8d80-19c9-48db-9052-4684b938fd10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:44.902149 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44fc8d80-19c9-48db-9052-4684b938fd10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:44.902603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44fc8d80-19c9-48db-9052-4684b938fd10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:44.903288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44fc8d80-19c9-48db-9052-4684b938fd10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:44.903736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44fc8d80-19c9-48db-9052-4684b938fd10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:44.904184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44fc8d80-19c9-48db-9052-4684b938fd10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:44.927640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-44fc8d80-19c9-48db-9052-4684b938fd10 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38/ips" status: 200 len: 151 microversion: 2.20 time: 0.040461 Sep 05 17:27:44.928208 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1186/2214] 10.222.0.23 () {60 vars in 1289 bytes} [Mon Sep 5 17:27:44 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 17:27:45.766933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6683bd43-80a1-4941-952b-da2c77ca10f5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:45.767924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6683bd43-80a1-4941-952b-da2c77ca10f5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:45.769708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e1c50153-e673-45ab-b2de-a7f92b6e4c92 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:45.770723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e1c50153-e673-45ab-b2de-a7f92b6e4c92 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:45.776973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6683bd43-80a1-4941-952b-da2c77ca10f5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:45.777457 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6683bd43-80a1-4941-952b-da2c77ca10f5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:45.777889 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6683bd43-80a1-4941-952b-da2c77ca10f5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:45.778250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c50153-e673-45ab-b2de-a7f92b6e4c92 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:45.778594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6683bd43-80a1-4941-952b-da2c77ca10f5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:45.778745 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c50153-e673-45ab-b2de-a7f92b6e4c92 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:45.779043 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6683bd43-80a1-4941-952b-da2c77ca10f5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:45.779194 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c50153-e673-45ab-b2de-a7f92b6e4c92 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:45.779467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6683bd43-80a1-4941-952b-da2c77ca10f5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:45.779845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c50153-e673-45ab-b2de-a7f92b6e4c92 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:45.780314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c50153-e673-45ab-b2de-a7f92b6e4c92 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:45.780738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1c50153-e673-45ab-b2de-a7f92b6e4c92 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:45.973401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e1c50153-e673-45ab-b2de-a7f92b6e4c92 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:45.980499 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6683bd43-80a1-4941-952b-da2c77ca10f5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:45.982109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e1c50153-e673-45ab-b2de-a7f92b6e4c92 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.219027 Sep 05 17:27:45.982683 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1187/2215] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:45 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:45.989049 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6683bd43-80a1-4941-952b-da2c77ca10f5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.228872 Sep 05 17:27:45.989582 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1029/2216] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:45 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:47.008396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-19050d71-c4c8-4acb-8b40-04e3b68b5aca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:47.009334 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-19050d71-c4c8-4acb-8b40-04e3b68b5aca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:47.014760 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-aee47748-db21-4fdd-a556-4d942563aa72 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:47.015405 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-aee47748-db21-4fdd-a556-4d942563aa72 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:47.017911 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19050d71-c4c8-4acb-8b40-04e3b68b5aca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:47.018708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19050d71-c4c8-4acb-8b40-04e3b68b5aca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:47.019413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19050d71-c4c8-4acb-8b40-04e3b68b5aca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:47.020589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19050d71-c4c8-4acb-8b40-04e3b68b5aca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:47.021290 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19050d71-c4c8-4acb-8b40-04e3b68b5aca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:47.022009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19050d71-c4c8-4acb-8b40-04e3b68b5aca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:47.025710 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aee47748-db21-4fdd-a556-4d942563aa72 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:47.026195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aee47748-db21-4fdd-a556-4d942563aa72 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:47.026621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aee47748-db21-4fdd-a556-4d942563aa72 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:47.027369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aee47748-db21-4fdd-a556-4d942563aa72 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:47.027858 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aee47748-db21-4fdd-a556-4d942563aa72 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:47.028312 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aee47748-db21-4fdd-a556-4d942563aa72 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:47.214886 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-19050d71-c4c8-4acb-8b40-04e3b68b5aca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:47.218289 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-aee47748-db21-4fdd-a556-4d942563aa72 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:47.223686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-19050d71-c4c8-4acb-8b40-04e3b68b5aca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.220740 Sep 05 17:27:47.224298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1188/2217] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:47 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:47.227265 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-aee47748-db21-4fdd-a556-4d942563aa72 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.217748 Sep 05 17:27:47.227827 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1030/2218] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:47 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:48.255282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7b38e990-eb4e-433e-a43c-df38bd9c61b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:48.256330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1b5d6ba3-ac7e-4942-9d3a-55e0cca83df1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:48.256330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1b5d6ba3-ac7e-4942-9d3a-55e0cca83df1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:48.257353 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7b38e990-eb4e-433e-a43c-df38bd9c61b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:48.263562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b38e990-eb4e-433e-a43c-df38bd9c61b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:48.263751 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b5d6ba3-ac7e-4942-9d3a-55e0cca83df1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:48.264045 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b38e990-eb4e-433e-a43c-df38bd9c61b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:48.264243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b5d6ba3-ac7e-4942-9d3a-55e0cca83df1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:48.264522 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b38e990-eb4e-433e-a43c-df38bd9c61b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:48.264713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b5d6ba3-ac7e-4942-9d3a-55e0cca83df1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:48.265207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b38e990-eb4e-433e-a43c-df38bd9c61b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:48.265360 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b5d6ba3-ac7e-4942-9d3a-55e0cca83df1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:48.265632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b38e990-eb4e-433e-a43c-df38bd9c61b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:48.265778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b5d6ba3-ac7e-4942-9d3a-55e0cca83df1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:48.266068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b38e990-eb4e-433e-a43c-df38bd9c61b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:48.266222 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b5d6ba3-ac7e-4942-9d3a-55e0cca83df1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:48.457342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1b5d6ba3-ac7e-4942-9d3a-55e0cca83df1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:48.461554 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7b38e990-eb4e-433e-a43c-df38bd9c61b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:48.466771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1b5d6ba3-ac7e-4942-9d3a-55e0cca83df1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.217505 Sep 05 17:27:48.467378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1031/2219] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:48 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:48.470306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7b38e990-eb4e-433e-a43c-df38bd9c61b8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.221495 Sep 05 17:27:48.471046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1189/2220] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:48 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:27:49.493408 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e4794b54-abe4-410f-9957-6d9c45c6c5be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:49.494009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e4794b54-abe4-410f-9957-6d9c45c6c5be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:49.496437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-66d001dc-023a-42db-bc56-66efc147c25b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:49.497085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-66d001dc-023a-42db-bc56-66efc147c25b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:49.500985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4794b54-abe4-410f-9957-6d9c45c6c5be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:49.501481 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4794b54-abe4-410f-9957-6d9c45c6c5be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:49.501924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4794b54-abe4-410f-9957-6d9c45c6c5be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:49.502644 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4794b54-abe4-410f-9957-6d9c45c6c5be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:49.503103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4794b54-abe4-410f-9957-6d9c45c6c5be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:49.503536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4794b54-abe4-410f-9957-6d9c45c6c5be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:49.503839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66d001dc-023a-42db-bc56-66efc147c25b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:49.504389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66d001dc-023a-42db-bc56-66efc147c25b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:49.504851 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66d001dc-023a-42db-bc56-66efc147c25b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:49.505569 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66d001dc-023a-42db-bc56-66efc147c25b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:49.506030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66d001dc-023a-42db-bc56-66efc147c25b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:49.506611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66d001dc-023a-42db-bc56-66efc147c25b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:49.694844 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e4794b54-abe4-410f-9957-6d9c45c6c5be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:49.697744 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-66d001dc-023a-42db-bc56-66efc147c25b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:49.703450 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e4794b54-abe4-410f-9957-6d9c45c6c5be tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.216091 Sep 05 17:27:49.704000 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1032/2221] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:49 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:49.705952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-66d001dc-023a-42db-bc56-66efc147c25b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.213705 Sep 05 17:27:49.706518 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1190/2222] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:49 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:50.727860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7a23a33d-1a5b-4c9b-8fd2-2d2d7177e0b6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:50.728481 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7a23a33d-1a5b-4c9b-8fd2-2d2d7177e0b6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:50.729334 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6b3378c5-48c0-4b5e-acb4-e4f0df4a8928 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:50.729946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6b3378c5-48c0-4b5e-acb4-e4f0df4a8928 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:50.735126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a23a33d-1a5b-4c9b-8fd2-2d2d7177e0b6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:50.735643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a23a33d-1a5b-4c9b-8fd2-2d2d7177e0b6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:50.736107 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a23a33d-1a5b-4c9b-8fd2-2d2d7177e0b6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:50.736717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b3378c5-48c0-4b5e-acb4-e4f0df4a8928 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:50.736890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a23a33d-1a5b-4c9b-8fd2-2d2d7177e0b6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:50.737201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b3378c5-48c0-4b5e-acb4-e4f0df4a8928 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:50.737364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a23a33d-1a5b-4c9b-8fd2-2d2d7177e0b6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:50.737629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b3378c5-48c0-4b5e-acb4-e4f0df4a8928 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:50.737791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7a23a33d-1a5b-4c9b-8fd2-2d2d7177e0b6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:50.738315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b3378c5-48c0-4b5e-acb4-e4f0df4a8928 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:50.738761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b3378c5-48c0-4b5e-acb4-e4f0df4a8928 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:50.739183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b3378c5-48c0-4b5e-acb4-e4f0df4a8928 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:50.929330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7a23a33d-1a5b-4c9b-8fd2-2d2d7177e0b6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:50.932298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6b3378c5-48c0-4b5e-acb4-e4f0df4a8928 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:50.937917 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7a23a33d-1a5b-4c9b-8fd2-2d2d7177e0b6 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.214322 Sep 05 17:27:50.938536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1033/2223] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:50 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:50.940817 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6b3378c5-48c0-4b5e-acb4-e4f0df4a8928 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.215310 Sep 05 17:27:50.941369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1191/2224] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:50 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:51.967140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c2c8d6a6-2ce6-436f-8334-2f26d919667f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:51.968061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5968b313-9d72-4e27-988d-35976d17f3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:51.968761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c2c8d6a6-2ce6-436f-8334-2f26d919667f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:51.969010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5968b313-9d72-4e27-988d-35976d17f3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:51.977337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c2c8d6a6-2ce6-436f-8334-2f26d919667f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:51.977845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c2c8d6a6-2ce6-436f-8334-2f26d919667f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:51.978262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c2c8d6a6-2ce6-436f-8334-2f26d919667f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:51.978479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5968b313-9d72-4e27-988d-35976d17f3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:51.978971 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c2c8d6a6-2ce6-436f-8334-2f26d919667f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:51.979102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5968b313-9d72-4e27-988d-35976d17f3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:51.979400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5968b313-9d72-4e27-988d-35976d17f3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:51.979520 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c2c8d6a6-2ce6-436f-8334-2f26d919667f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:51.979817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c2c8d6a6-2ce6-436f-8334-2f26d919667f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:51.980092 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5968b313-9d72-4e27-988d-35976d17f3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:51.980570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5968b313-9d72-4e27-988d-35976d17f3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:51.980989 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5968b313-9d72-4e27-988d-35976d17f3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:52.173303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c2c8d6a6-2ce6-436f-8334-2f26d919667f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:52.177696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5968b313-9d72-4e27-988d-35976d17f3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:52.182568 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c2c8d6a6-2ce6-436f-8334-2f26d919667f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.223353 Sep 05 17:27:52.183258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1034/2225] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:51 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:27:52.186283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5968b313-9d72-4e27-988d-35976d17f3cd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.225036 Sep 05 17:27:52.186941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1192/2226] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:51 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:53.211459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1a4c876b-aaff-4d8a-891d-017ffbdce678 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:53.212417 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cba1150c-0f1e-434c-83fb-7de3f9e61227 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:53.213034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cba1150c-0f1e-434c-83fb-7de3f9e61227 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:53.213834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1a4c876b-aaff-4d8a-891d-017ffbdce678 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:53.220907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba1150c-0f1e-434c-83fb-7de3f9e61227 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:53.221337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba1150c-0f1e-434c-83fb-7de3f9e61227 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:53.221847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba1150c-0f1e-434c-83fb-7de3f9e61227 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:53.222134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a4c876b-aaff-4d8a-891d-017ffbdce678 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:53.222561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba1150c-0f1e-434c-83fb-7de3f9e61227 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:53.222712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a4c876b-aaff-4d8a-891d-017ffbdce678 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:53.222977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a4c876b-aaff-4d8a-891d-017ffbdce678 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:53.223165 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba1150c-0f1e-434c-83fb-7de3f9e61227 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:53.223491 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba1150c-0f1e-434c-83fb-7de3f9e61227 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:53.223662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a4c876b-aaff-4d8a-891d-017ffbdce678 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:53.224226 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a4c876b-aaff-4d8a-891d-017ffbdce678 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:53.224647 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1a4c876b-aaff-4d8a-891d-017ffbdce678 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:53.242705 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:27:53.427842 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cba1150c-0f1e-434c-83fb-7de3f9e61227 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:53.430186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:27:53.432135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1a4c876b-aaff-4d8a-891d-017ffbdce678 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:53.437688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cba1150c-0f1e-434c-83fb-7de3f9e61227 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.230180 Sep 05 17:27:53.443413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1193/2227] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:53 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:53.443605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1a4c876b-aaff-4d8a-891d-017ffbdce678 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.236696 Sep 05 17:27:53.443605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1035/2228] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:53 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:54.464582 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-54e310c1-ab69-4aea-a455-084369d3972f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:54.465292 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-54e310c1-ab69-4aea-a455-084369d3972f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:54.467204 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-00da586b-e8d9-433c-8059-a68ebfd6c50f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:54.467980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-00da586b-e8d9-433c-8059-a68ebfd6c50f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:54.474507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54e310c1-ab69-4aea-a455-084369d3972f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:54.475306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54e310c1-ab69-4aea-a455-084369d3972f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:54.475867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54e310c1-ab69-4aea-a455-084369d3972f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:54.476500 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00da586b-e8d9-433c-8059-a68ebfd6c50f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:54.476827 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54e310c1-ab69-4aea-a455-084369d3972f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:54.477105 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00da586b-e8d9-433c-8059-a68ebfd6c50f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:54.477545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54e310c1-ab69-4aea-a455-084369d3972f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:54.477734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00da586b-e8d9-433c-8059-a68ebfd6c50f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:54.478084 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54e310c1-ab69-4aea-a455-084369d3972f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:54.478444 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00da586b-e8d9-433c-8059-a68ebfd6c50f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:54.479001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00da586b-e8d9-433c-8059-a68ebfd6c50f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:54.479515 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00da586b-e8d9-433c-8059-a68ebfd6c50f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:54.673005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-54e310c1-ab69-4aea-a455-084369d3972f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:54.677091 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-00da586b-e8d9-433c-8059-a68ebfd6c50f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:54.682909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-54e310c1-ab69-4aea-a455-084369d3972f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.223528 Sep 05 17:27:54.683732 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1194/2229] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:54 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:54.686284 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-00da586b-e8d9-433c-8059-a68ebfd6c50f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.224196 Sep 05 17:27:54.686850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1036/2230] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:54 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:55.711246 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9b2e138b-ae5c-4e40-8947-4374b87fbbd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:55.712247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9b2e138b-ae5c-4e40-8947-4374b87fbbd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:55.713811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-74a3031e-2da0-4a26-968d-4535821d321b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:55.715002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-74a3031e-2da0-4a26-968d-4535821d321b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:55.723446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b2e138b-ae5c-4e40-8947-4374b87fbbd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:55.724337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b2e138b-ae5c-4e40-8947-4374b87fbbd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:55.725362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b2e138b-ae5c-4e40-8947-4374b87fbbd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:55.726003 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74a3031e-2da0-4a26-968d-4535821d321b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:55.726157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b2e138b-ae5c-4e40-8947-4374b87fbbd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:55.726515 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74a3031e-2da0-4a26-968d-4535821d321b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:55.726682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b2e138b-ae5c-4e40-8947-4374b87fbbd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:55.726946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74a3031e-2da0-4a26-968d-4535821d321b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:55.727102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b2e138b-ae5c-4e40-8947-4374b87fbbd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:55.727642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74a3031e-2da0-4a26-968d-4535821d321b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:55.728091 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74a3031e-2da0-4a26-968d-4535821d321b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:55.728528 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74a3031e-2da0-4a26-968d-4535821d321b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:55.919855 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-74a3031e-2da0-4a26-968d-4535821d321b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:55.924317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9b2e138b-ae5c-4e40-8947-4374b87fbbd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:55.931363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-74a3031e-2da0-4a26-968d-4535821d321b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.223904 Sep 05 17:27:55.931925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1037/2231] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:55 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:55.934103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9b2e138b-ae5c-4e40-8947-4374b87fbbd2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.230020 Sep 05 17:27:55.934681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1195/2232] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:55 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:56.959049 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c68389e5-06b1-4705-8f0e-8c1240551ac2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:56.960229 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c68389e5-06b1-4705-8f0e-8c1240551ac2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:56.960987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-110d91a4-6617-4399-aa41-229d0dc25176 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:56.961601 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-110d91a4-6617-4399-aa41-229d0dc25176 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:56.967438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c68389e5-06b1-4705-8f0e-8c1240551ac2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:56.967910 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c68389e5-06b1-4705-8f0e-8c1240551ac2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:56.968367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c68389e5-06b1-4705-8f0e-8c1240551ac2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:56.968656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-110d91a4-6617-4399-aa41-229d0dc25176 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:56.969053 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c68389e5-06b1-4705-8f0e-8c1240551ac2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:56.969215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-110d91a4-6617-4399-aa41-229d0dc25176 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:56.969497 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c68389e5-06b1-4705-8f0e-8c1240551ac2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:56.969663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-110d91a4-6617-4399-aa41-229d0dc25176 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:56.969901 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c68389e5-06b1-4705-8f0e-8c1240551ac2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:56.970233 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-110d91a4-6617-4399-aa41-229d0dc25176 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:56.970681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-110d91a4-6617-4399-aa41-229d0dc25176 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:56.971099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-110d91a4-6617-4399-aa41-229d0dc25176 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:57.170583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c68389e5-06b1-4705-8f0e-8c1240551ac2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:57.173526 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-110d91a4-6617-4399-aa41-229d0dc25176 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:57.179068 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c68389e5-06b1-4705-8f0e-8c1240551ac2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.226610 Sep 05 17:27:57.179869 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1038/2233] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:56 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:57.182294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-110d91a4-6617-4399-aa41-229d0dc25176 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.227647 Sep 05 17:27:57.182841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1196/2234] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:56 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:58.202992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-60473bb4-42c7-4a23-b8d3-874270bed250 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:58.203865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-60473bb4-42c7-4a23-b8d3-874270bed250 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:58.206282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-55325c69-9829-453f-85ae-93a3aa01dcbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:58.206710 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=50 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:27:58.206927 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-55325c69-9829-453f-85ae-93a3aa01dcbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:58.209465 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=52 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:27:58.213548 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60473bb4-42c7-4a23-b8d3-874270bed250 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:58.214270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60473bb4-42c7-4a23-b8d3-874270bed250 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:58.214735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60473bb4-42c7-4a23-b8d3-874270bed250 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:58.215612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60473bb4-42c7-4a23-b8d3-874270bed250 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:58.216687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60473bb4-42c7-4a23-b8d3-874270bed250 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:58.216818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55325c69-9829-453f-85ae-93a3aa01dcbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:58.217349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55325c69-9829-453f-85ae-93a3aa01dcbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:58.217637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55325c69-9829-453f-85ae-93a3aa01dcbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:58.217761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-60473bb4-42c7-4a23-b8d3-874270bed250 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:58.218537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55325c69-9829-453f-85ae-93a3aa01dcbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:58.218987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55325c69-9829-453f-85ae-93a3aa01dcbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:58.219459 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55325c69-9829-453f-85ae-93a3aa01dcbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:58.414600 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-60473bb4-42c7-4a23-b8d3-874270bed250 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:58.418038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-55325c69-9829-453f-85ae-93a3aa01dcbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:58.423801 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-60473bb4-42c7-4a23-b8d3-874270bed250 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.225211 Sep 05 17:27:58.424425 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1039/2235] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:58 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:58.426776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-55325c69-9829-453f-85ae-93a3aa01dcbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.224350 Sep 05 17:27:58.427595 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1197/2236] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:58 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:27:59.451533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0f87ca81-e8ca-4a38-9f69-17b82fced780 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:59.452552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0f87ca81-e8ca-4a38-9f69-17b82fced780 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:59.452993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-935b9e18-f28c-42d2-b2b4-8596a111f6fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:27:59.453932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-935b9e18-f28c-42d2-b2b4-8596a111f6fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:27:59.462341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f87ca81-e8ca-4a38-9f69-17b82fced780 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:59.463071 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f87ca81-e8ca-4a38-9f69-17b82fced780 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:59.463724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f87ca81-e8ca-4a38-9f69-17b82fced780 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:59.464247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-935b9e18-f28c-42d2-b2b4-8596a111f6fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:59.464887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f87ca81-e8ca-4a38-9f69-17b82fced780 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:59.465187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-935b9e18-f28c-42d2-b2b4-8596a111f6fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:59.465493 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f87ca81-e8ca-4a38-9f69-17b82fced780 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:59.466463 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-935b9e18-f28c-42d2-b2b4-8596a111f6fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:59.466653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f87ca81-e8ca-4a38-9f69-17b82fced780 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:59.467700 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-935b9e18-f28c-42d2-b2b4-8596a111f6fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:27:59.468520 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-935b9e18-f28c-42d2-b2b4-8596a111f6fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:27:59.469261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-935b9e18-f28c-42d2-b2b4-8596a111f6fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:27:59.661838 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0f87ca81-e8ca-4a38-9f69-17b82fced780 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:59.665931 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-935b9e18-f28c-42d2-b2b4-8596a111f6fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:27:59.670476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0f87ca81-e8ca-4a38-9f69-17b82fced780 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.225225 Sep 05 17:27:59.671151 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1040/2237] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:59 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:27:59.674505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-935b9e18-f28c-42d2-b2b4-8596a111f6fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.227375 Sep 05 17:27:59.675348 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1198/2238] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:27:59 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:00.695325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a1ececa8-b522-407a-8c05-dcffd07a9eee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:00.695921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a1ececa8-b522-407a-8c05-dcffd07a9eee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:00.697455 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c20eeb98-1f6c-44bb-a96b-7e5831afdedb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:00.698084 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c20eeb98-1f6c-44bb-a96b-7e5831afdedb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:00.703529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1ececa8-b522-407a-8c05-dcffd07a9eee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:00.704014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1ececa8-b522-407a-8c05-dcffd07a9eee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:00.704481 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1ececa8-b522-407a-8c05-dcffd07a9eee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:00.705167 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1ececa8-b522-407a-8c05-dcffd07a9eee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:00.705525 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c20eeb98-1f6c-44bb-a96b-7e5831afdedb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:00.705695 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1ececa8-b522-407a-8c05-dcffd07a9eee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:00.706002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c20eeb98-1f6c-44bb-a96b-7e5831afdedb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:00.706168 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a1ececa8-b522-407a-8c05-dcffd07a9eee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:00.706431 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c20eeb98-1f6c-44bb-a96b-7e5831afdedb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:00.707099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c20eeb98-1f6c-44bb-a96b-7e5831afdedb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:00.707543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c20eeb98-1f6c-44bb-a96b-7e5831afdedb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:00.707960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c20eeb98-1f6c-44bb-a96b-7e5831afdedb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:01.132947 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a1ececa8-b522-407a-8c05-dcffd07a9eee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:01.137073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c20eeb98-1f6c-44bb-a96b-7e5831afdedb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:01.144823 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a1ececa8-b522-407a-8c05-dcffd07a9eee tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.453629 Sep 05 17:28:01.145439 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1041/2239] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:00 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:01.147731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c20eeb98-1f6c-44bb-a96b-7e5831afdedb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.454702 Sep 05 17:28:01.148318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1199/2240] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:00 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:02.171474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d866c5e7-13ad-4119-905d-b9641ce1839e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:02.172117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d866c5e7-13ad-4119-905d-b9641ce1839e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:02.173064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ce1004d8-f3d3-4f01-8ddd-fddc405352be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:02.173807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ce1004d8-f3d3-4f01-8ddd-fddc405352be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:02.178551 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d866c5e7-13ad-4119-905d-b9641ce1839e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:02.179040 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d866c5e7-13ad-4119-905d-b9641ce1839e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:02.179466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d866c5e7-13ad-4119-905d-b9641ce1839e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:02.180180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d866c5e7-13ad-4119-905d-b9641ce1839e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:02.180330 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce1004d8-f3d3-4f01-8ddd-fddc405352be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:02.180650 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d866c5e7-13ad-4119-905d-b9641ce1839e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:02.180802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce1004d8-f3d3-4f01-8ddd-fddc405352be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:02.181068 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d866c5e7-13ad-4119-905d-b9641ce1839e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:02.181220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce1004d8-f3d3-4f01-8ddd-fddc405352be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:02.181820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce1004d8-f3d3-4f01-8ddd-fddc405352be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:02.182288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce1004d8-f3d3-4f01-8ddd-fddc405352be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:02.182681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce1004d8-f3d3-4f01-8ddd-fddc405352be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:02.371927 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d866c5e7-13ad-4119-905d-b9641ce1839e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:02.376692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ce1004d8-f3d3-4f01-8ddd-fddc405352be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:02.381170 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d866c5e7-13ad-4119-905d-b9641ce1839e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.215765 Sep 05 17:28:02.381761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1042/2241] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:02 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:02.385221 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ce1004d8-f3d3-4f01-8ddd-fddc405352be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.216931 Sep 05 17:28:02.385790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1200/2242] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:02 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:03.406892 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d5f20eef-d9b6-4480-96b3-0a9189a5fc31 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:03.407507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d5f20eef-d9b6-4480-96b3-0a9189a5fc31 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:03.409163 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0a708e53-e76b-4cf5-9f0f-9f57b90aa0dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:03.409801 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0a708e53-e76b-4cf5-9f0f-9f57b90aa0dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:03.414744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5f20eef-d9b6-4480-96b3-0a9189a5fc31 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:03.415228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5f20eef-d9b6-4480-96b3-0a9189a5fc31 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:03.415651 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5f20eef-d9b6-4480-96b3-0a9189a5fc31 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:03.416380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5f20eef-d9b6-4480-96b3-0a9189a5fc31 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:03.416506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a708e53-e76b-4cf5-9f0f-9f57b90aa0dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:03.416830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5f20eef-d9b6-4480-96b3-0a9189a5fc31 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:03.416949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a708e53-e76b-4cf5-9f0f-9f57b90aa0dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:03.417244 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5f20eef-d9b6-4480-96b3-0a9189a5fc31 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:03.417361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a708e53-e76b-4cf5-9f0f-9f57b90aa0dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:03.418052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a708e53-e76b-4cf5-9f0f-9f57b90aa0dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:03.418499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a708e53-e76b-4cf5-9f0f-9f57b90aa0dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:03.418923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a708e53-e76b-4cf5-9f0f-9f57b90aa0dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:03.610653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d5f20eef-d9b6-4480-96b3-0a9189a5fc31 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:03.615085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0a708e53-e76b-4cf5-9f0f-9f57b90aa0dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:03.622671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d5f20eef-d9b6-4480-96b3-0a9189a5fc31 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.221870 Sep 05 17:28:03.623844 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1043/2243] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:03 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:03.626952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0a708e53-e76b-4cf5-9f0f-9f57b90aa0dd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.222100 Sep 05 17:28:03.627566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1201/2244] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:03 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:04.653084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6f794a55-8c78-407c-9975-9d49ca9f0a50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:04.654017 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6f794a55-8c78-407c-9975-9d49ca9f0a50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:04.654821 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a5b8e0bf-7b23-4eae-8618-37550729842c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:04.655749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a5b8e0bf-7b23-4eae-8618-37550729842c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:04.661228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f794a55-8c78-407c-9975-9d49ca9f0a50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:04.661708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f794a55-8c78-407c-9975-9d49ca9f0a50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:04.662119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5b8e0bf-7b23-4eae-8618-37550729842c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:04.662276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f794a55-8c78-407c-9975-9d49ca9f0a50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:04.662582 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5b8e0bf-7b23-4eae-8618-37550729842c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:04.662774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f794a55-8c78-407c-9975-9d49ca9f0a50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:04.663007 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5b8e0bf-7b23-4eae-8618-37550729842c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:04.663254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f794a55-8c78-407c-9975-9d49ca9f0a50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:04.663663 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f794a55-8c78-407c-9975-9d49ca9f0a50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:04.663822 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5b8e0bf-7b23-4eae-8618-37550729842c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:04.664134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5b8e0bf-7b23-4eae-8618-37550729842c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:04.664595 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5b8e0bf-7b23-4eae-8618-37550729842c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:04.858023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6f794a55-8c78-407c-9975-9d49ca9f0a50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:04.861341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a5b8e0bf-7b23-4eae-8618-37550729842c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:04.867336 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6f794a55-8c78-407c-9975-9d49ca9f0a50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.221071 Sep 05 17:28:04.867949 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1044/2245] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:04 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:04.869818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a5b8e0bf-7b23-4eae-8618-37550729842c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.221763 Sep 05 17:28:04.870376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1202/2246] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:04 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:05.894549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-769be290-a68d-43f9-ad12-0bb743d2c517 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:05.895580 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-769be290-a68d-43f9-ad12-0bb743d2c517 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:05.898664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b677d6a7-5464-40d9-bf25-1290874bf1b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:05.899540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b677d6a7-5464-40d9-bf25-1290874bf1b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:05.906284 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-769be290-a68d-43f9-ad12-0bb743d2c517 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:05.906780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-769be290-a68d-43f9-ad12-0bb743d2c517 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:05.907188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-769be290-a68d-43f9-ad12-0bb743d2c517 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:05.908187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-769be290-a68d-43f9-ad12-0bb743d2c517 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:05.908318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b677d6a7-5464-40d9-bf25-1290874bf1b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:05.908630 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-769be290-a68d-43f9-ad12-0bb743d2c517 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:05.908771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b677d6a7-5464-40d9-bf25-1290874bf1b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:05.909034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-769be290-a68d-43f9-ad12-0bb743d2c517 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:05.909152 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b677d6a7-5464-40d9-bf25-1290874bf1b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:05.909737 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b677d6a7-5464-40d9-bf25-1290874bf1b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:05.910177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b677d6a7-5464-40d9-bf25-1290874bf1b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:05.910594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b677d6a7-5464-40d9-bf25-1290874bf1b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:06.104553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-769be290-a68d-43f9-ad12-0bb743d2c517 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:06.108519 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b677d6a7-5464-40d9-bf25-1290874bf1b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:06.117410 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-769be290-a68d-43f9-ad12-0bb743d2c517 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.229217 Sep 05 17:28:06.118394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1045/2247] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:05 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:06.121014 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b677d6a7-5464-40d9-bf25-1290874bf1b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.228768 Sep 05 17:28:06.121843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1203/2248] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:05 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:07.143175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-21297163-5ddb-410a-ba47-f7e82c823aba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:07.143773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-21297163-5ddb-410a-ba47-f7e82c823aba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:07.144229 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-48a00125-404b-427e-b8ae-0460c36b28bc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:07.144842 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-48a00125-404b-427e-b8ae-0460c36b28bc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:07.151086 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-21297163-5ddb-410a-ba47-f7e82c823aba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:07.151489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-21297163-5ddb-410a-ba47-f7e82c823aba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:07.151610 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48a00125-404b-427e-b8ae-0460c36b28bc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:07.151912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-21297163-5ddb-410a-ba47-f7e82c823aba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:07.152040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48a00125-404b-427e-b8ae-0460c36b28bc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:07.152433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48a00125-404b-427e-b8ae-0460c36b28bc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:07.152628 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-21297163-5ddb-410a-ba47-f7e82c823aba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:07.153101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-21297163-5ddb-410a-ba47-f7e82c823aba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:07.153231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48a00125-404b-427e-b8ae-0460c36b28bc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:07.153516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-21297163-5ddb-410a-ba47-f7e82c823aba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:07.153630 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48a00125-404b-427e-b8ae-0460c36b28bc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:07.153949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48a00125-404b-427e-b8ae-0460c36b28bc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:07.351990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-21297163-5ddb-410a-ba47-f7e82c823aba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:07.355036 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-48a00125-404b-427e-b8ae-0460c36b28bc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:07.361089 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-21297163-5ddb-410a-ba47-f7e82c823aba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.221897 Sep 05 17:28:07.361706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1046/2249] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:07 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:07.364003 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-48a00125-404b-427e-b8ae-0460c36b28bc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.223633 Sep 05 17:28:07.364598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1204/2250] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:07 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:08.387286 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d1569ae9-b8fe-4ed5-913b-38036f7b5c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:08.388060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d1569ae9-b8fe-4ed5-913b-38036f7b5c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:08.391066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2be7d1d5-e8ef-43b9-9c39-f347942c7e7a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:08.391667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2be7d1d5-e8ef-43b9-9c39-f347942c7e7a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:08.396632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1569ae9-b8fe-4ed5-913b-38036f7b5c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:08.397227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1569ae9-b8fe-4ed5-913b-38036f7b5c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:08.397739 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1569ae9-b8fe-4ed5-913b-38036f7b5c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:08.398615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1569ae9-b8fe-4ed5-913b-38036f7b5c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:08.399168 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1569ae9-b8fe-4ed5-913b-38036f7b5c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:08.399686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d1569ae9-b8fe-4ed5-913b-38036f7b5c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:08.399868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2be7d1d5-e8ef-43b9-9c39-f347942c7e7a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:08.400495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2be7d1d5-e8ef-43b9-9c39-f347942c7e7a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:08.401028 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2be7d1d5-e8ef-43b9-9c39-f347942c7e7a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:08.401876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2be7d1d5-e8ef-43b9-9c39-f347942c7e7a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:08.402439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2be7d1d5-e8ef-43b9-9c39-f347942c7e7a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:08.402941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2be7d1d5-e8ef-43b9-9c39-f347942c7e7a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:08.600730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d1569ae9-b8fe-4ed5-913b-38036f7b5c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:08.604724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2be7d1d5-e8ef-43b9-9c39-f347942c7e7a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:08.609402 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d1569ae9-b8fe-4ed5-913b-38036f7b5c08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.226995 Sep 05 17:28:08.610205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1047/2251] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:08 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:08.613689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2be7d1d5-e8ef-43b9-9c39-f347942c7e7a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.228798 Sep 05 17:28:08.614258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1205/2252] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:08 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:09.636883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5a81da6c-4a7c-4bfd-859a-767c86db1eba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:09.637972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5a81da6c-4a7c-4bfd-859a-767c86db1eba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:09.641167 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-eb24847b-b097-4757-a398-c478c0486663 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:09.643177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-eb24847b-b097-4757-a398-c478c0486663 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:09.648560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a81da6c-4a7c-4bfd-859a-767c86db1eba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:09.649373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a81da6c-4a7c-4bfd-859a-767c86db1eba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:09.650135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a81da6c-4a7c-4bfd-859a-767c86db1eba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:09.651603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a81da6c-4a7c-4bfd-859a-767c86db1eba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:09.652395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a81da6c-4a7c-4bfd-859a-767c86db1eba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:09.653129 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5a81da6c-4a7c-4bfd-859a-767c86db1eba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:09.653866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb24847b-b097-4757-a398-c478c0486663 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:09.654624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb24847b-b097-4757-a398-c478c0486663 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:09.655375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb24847b-b097-4757-a398-c478c0486663 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:09.657024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb24847b-b097-4757-a398-c478c0486663 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:09.657845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb24847b-b097-4757-a398-c478c0486663 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:09.658340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb24847b-b097-4757-a398-c478c0486663 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:09.845697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5a81da6c-4a7c-4bfd-859a-767c86db1eba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:09.848863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eb24847b-b097-4757-a398-c478c0486663 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:09.854110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5a81da6c-4a7c-4bfd-859a-767c86db1eba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.223719 Sep 05 17:28:09.854761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1048/2253] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:09 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:09.857311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-eb24847b-b097-4757-a398-c478c0486663 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.222993 Sep 05 17:28:09.857874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1206/2254] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:09 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:10.882133 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3cb4c682-f060-4a39-9b8a-a8db4f6fbcf7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:10.883079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3cb4c682-f060-4a39-9b8a-a8db4f6fbcf7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:10.886108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-256bbbfa-3774-4fed-8a69-522494ba8ed7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:10.887129 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-256bbbfa-3774-4fed-8a69-522494ba8ed7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:10.893492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cb4c682-f060-4a39-9b8a-a8db4f6fbcf7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:10.893982 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cb4c682-f060-4a39-9b8a-a8db4f6fbcf7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:10.894420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cb4c682-f060-4a39-9b8a-a8db4f6fbcf7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:10.895121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cb4c682-f060-4a39-9b8a-a8db4f6fbcf7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:10.895580 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cb4c682-f060-4a39-9b8a-a8db4f6fbcf7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:10.895894 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-256bbbfa-3774-4fed-8a69-522494ba8ed7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:10.896044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cb4c682-f060-4a39-9b8a-a8db4f6fbcf7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:10.896436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-256bbbfa-3774-4fed-8a69-522494ba8ed7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:10.896986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-256bbbfa-3774-4fed-8a69-522494ba8ed7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:10.897661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-256bbbfa-3774-4fed-8a69-522494ba8ed7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:10.898117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-256bbbfa-3774-4fed-8a69-522494ba8ed7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:10.898529 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-256bbbfa-3774-4fed-8a69-522494ba8ed7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:11.087546 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3cb4c682-f060-4a39-9b8a-a8db4f6fbcf7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:11.090438 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-256bbbfa-3774-4fed-8a69-522494ba8ed7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:11.096667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3cb4c682-f060-4a39-9b8a-a8db4f6fbcf7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.221437 Sep 05 17:28:11.097563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1049/2255] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:10 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:11.099759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-256bbbfa-3774-4fed-8a69-522494ba8ed7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.220383 Sep 05 17:28:11.100356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1207/2256] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:10 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:12.123616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d0ddd40d-ba89-4b6a-b087-2d11ae970e59 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:12.124704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d0ddd40d-ba89-4b6a-b087-2d11ae970e59 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:12.126407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ba359d18-a745-4560-bff6-4fc89fc22124 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:12.127009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ba359d18-a745-4560-bff6-4fc89fc22124 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:12.131976 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d0ddd40d-ba89-4b6a-b087-2d11ae970e59 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:12.132500 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d0ddd40d-ba89-4b6a-b087-2d11ae970e59 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:12.132931 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d0ddd40d-ba89-4b6a-b087-2d11ae970e59 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:12.133587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba359d18-a745-4560-bff6-4fc89fc22124 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:12.133752 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d0ddd40d-ba89-4b6a-b087-2d11ae970e59 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:12.134055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d0ddd40d-ba89-4b6a-b087-2d11ae970e59 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:12.134250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba359d18-a745-4560-bff6-4fc89fc22124 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:12.134448 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d0ddd40d-ba89-4b6a-b087-2d11ae970e59 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:12.134572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba359d18-a745-4560-bff6-4fc89fc22124 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:12.135151 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba359d18-a745-4560-bff6-4fc89fc22124 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:12.135588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba359d18-a745-4560-bff6-4fc89fc22124 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:12.135998 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba359d18-a745-4560-bff6-4fc89fc22124 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:12.331213 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d0ddd40d-ba89-4b6a-b087-2d11ae970e59 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:12.334326 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ba359d18-a745-4560-bff6-4fc89fc22124 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:12.339560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d0ddd40d-ba89-4b6a-b087-2d11ae970e59 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.222817 Sep 05 17:28:12.340450 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1050/2257] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:12 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:12.343016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ba359d18-a745-4560-bff6-4fc89fc22124 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.222695 Sep 05 17:28:12.343578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1208/2258] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:12 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:13.367491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-03e8a271-ef3c-420a-b06c-e85c83c7274f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:13.368471 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-03e8a271-ef3c-420a-b06c-e85c83c7274f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:13.369942 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-03e2f5d6-426d-4dc6-99c8-7383bf1a5369 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:13.370964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-03e2f5d6-426d-4dc6-99c8-7383bf1a5369 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:13.379028 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-03e8a271-ef3c-420a-b06c-e85c83c7274f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:13.379283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03e2f5d6-426d-4dc6-99c8-7383bf1a5369 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:13.379455 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-03e8a271-ef3c-420a-b06c-e85c83c7274f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:13.379781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03e2f5d6-426d-4dc6-99c8-7383bf1a5369 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:13.379954 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-03e8a271-ef3c-420a-b06c-e85c83c7274f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:13.380250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03e2f5d6-426d-4dc6-99c8-7383bf1a5369 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:13.380601 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-03e8a271-ef3c-420a-b06c-e85c83c7274f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:13.381014 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03e2f5d6-426d-4dc6-99c8-7383bf1a5369 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:13.381162 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-03e8a271-ef3c-420a-b06c-e85c83c7274f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:13.381468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03e2f5d6-426d-4dc6-99c8-7383bf1a5369 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:13.381616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-03e8a271-ef3c-420a-b06c-e85c83c7274f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:13.381876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-03e2f5d6-426d-4dc6-99c8-7383bf1a5369 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:13.579388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-03e8a271-ef3c-420a-b06c-e85c83c7274f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:13.582233 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-03e2f5d6-426d-4dc6-99c8-7383bf1a5369 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:13.588260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-03e8a271-ef3c-420a-b06c-e85c83c7274f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.227501 Sep 05 17:28:13.588839 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1051/2259] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:13 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:13.591297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-03e2f5d6-426d-4dc6-99c8-7383bf1a5369 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.227788 Sep 05 17:28:13.591982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1209/2260] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:13 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:14.615623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5d1fbcfe-2534-49fa-8a60-bd7e08a87376 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:14.616311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5d1fbcfe-2534-49fa-8a60-bd7e08a87376 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:14.616703 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-199bdfe5-f6f4-4f4e-ae42-32c3e3b96d2c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:14.617348 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-199bdfe5-f6f4-4f4e-ae42-32c3e3b96d2c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:14.623452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d1fbcfe-2534-49fa-8a60-bd7e08a87376 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:14.623959 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d1fbcfe-2534-49fa-8a60-bd7e08a87376 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:14.624444 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d1fbcfe-2534-49fa-8a60-bd7e08a87376 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:14.624623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-199bdfe5-f6f4-4f4e-ae42-32c3e3b96d2c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:14.625032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-199bdfe5-f6f4-4f4e-ae42-32c3e3b96d2c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:14.625169 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d1fbcfe-2534-49fa-8a60-bd7e08a87376 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:14.625476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-199bdfe5-f6f4-4f4e-ae42-32c3e3b96d2c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:14.625602 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d1fbcfe-2534-49fa-8a60-bd7e08a87376 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:14.626038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d1fbcfe-2534-49fa-8a60-bd7e08a87376 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:14.626157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-199bdfe5-f6f4-4f4e-ae42-32c3e3b96d2c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:14.626647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-199bdfe5-f6f4-4f4e-ae42-32c3e3b96d2c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:14.627063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-199bdfe5-f6f4-4f4e-ae42-32c3e3b96d2c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:14.629125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:28:14.643327 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:28:14.822552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5d1fbcfe-2534-49fa-8a60-bd7e08a87376 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:14.825786 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-199bdfe5-f6f4-4f4e-ae42-32c3e3b96d2c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:14.833884 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5d1fbcfe-2534-49fa-8a60-bd7e08a87376 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.224136 Sep 05 17:28:14.834322 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-199bdfe5-f6f4-4f4e-ae42-32c3e3b96d2c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.222564 Sep 05 17:28:14.834481 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1052/2261] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:14 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:14.834868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1210/2262] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:14 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:15.467037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-79ec3459-7ef1-4fdd-99fe-45dde94d6ac6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:15.467532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-79ec3459-7ef1-4fdd-99fe-45dde94d6ac6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:15.473951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79ec3459-7ef1-4fdd-99fe-45dde94d6ac6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:15.474445 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79ec3459-7ef1-4fdd-99fe-45dde94d6ac6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:15.474883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79ec3459-7ef1-4fdd-99fe-45dde94d6ac6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:15.475576 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79ec3459-7ef1-4fdd-99fe-45dde94d6ac6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:15.476033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79ec3459-7ef1-4fdd-99fe-45dde94d6ac6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:15.476491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-79ec3459-7ef1-4fdd-99fe-45dde94d6ac6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:15.503529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-79ec3459-7ef1-4fdd-99fe-45dde94d6ac6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Going to try to terminate instance {{(pid=120733) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:28:15.587549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-79ec3459-7ef1-4fdd-99fe-45dde94d6ac6 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 204 len: 0 microversion: 2.1 time: 0.124459 Sep 05 17:28:15.588245 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1053/2263] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:28:15 2022] DELETE /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:28:15.598040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2bbb59ed-866e-4149-8062-874b46435882 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:15.598669 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2bbb59ed-866e-4149-8062-874b46435882 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:15.604653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bbb59ed-866e-4149-8062-874b46435882 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:15.605142 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bbb59ed-866e-4149-8062-874b46435882 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:15.605580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bbb59ed-866e-4149-8062-874b46435882 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:15.606276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bbb59ed-866e-4149-8062-874b46435882 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:15.606728 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bbb59ed-866e-4149-8062-874b46435882 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:15.607153 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bbb59ed-866e-4149-8062-874b46435882 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:15.739154 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2bbb59ed-866e-4149-8062-874b46435882 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:15.747324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2bbb59ed-866e-4149-8062-874b46435882 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1508 microversion: 2.1 time: 0.154252 Sep 05 17:28:15.747884 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1211/2264] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:15 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:15.858868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2f5e3c54-949e-4bdc-9252-54bfe19c80cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:15.859739 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2f5e3c54-949e-4bdc-9252-54bfe19c80cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:15.860093 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-498801a4-2bba-4302-8d35-ecadc886cffb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:15.861000 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-498801a4-2bba-4302-8d35-ecadc886cffb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:15.869017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f5e3c54-949e-4bdc-9252-54bfe19c80cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:15.869649 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-498801a4-2bba-4302-8d35-ecadc886cffb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:15.870187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-498801a4-2bba-4302-8d35-ecadc886cffb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:15.870400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f5e3c54-949e-4bdc-9252-54bfe19c80cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:15.870625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-498801a4-2bba-4302-8d35-ecadc886cffb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:15.871382 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f5e3c54-949e-4bdc-9252-54bfe19c80cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:15.871588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-498801a4-2bba-4302-8d35-ecadc886cffb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:15.871960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-498801a4-2bba-4302-8d35-ecadc886cffb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:15.872521 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f5e3c54-949e-4bdc-9252-54bfe19c80cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:15.872696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-498801a4-2bba-4302-8d35-ecadc886cffb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:15.873141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f5e3c54-949e-4bdc-9252-54bfe19c80cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:15.873867 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f5e3c54-949e-4bdc-9252-54bfe19c80cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:16.077673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2f5e3c54-949e-4bdc-9252-54bfe19c80cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:16.081030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-498801a4-2bba-4302-8d35-ecadc886cffb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:16.086466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2f5e3c54-949e-4bdc-9252-54bfe19c80cd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.231428 Sep 05 17:28:16.087059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1212/2265] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:15 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:16.089379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-498801a4-2bba-4302-8d35-ecadc886cffb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.233981 Sep 05 17:28:16.089934 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1054/2266] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:15 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:16.771413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-42ce6fff-7c5d-4f48-ada6-47dd54b13bd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:16.772622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-42ce6fff-7c5d-4f48-ada6-47dd54b13bd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:16.779273 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42ce6fff-7c5d-4f48-ada6-47dd54b13bd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:16.779772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42ce6fff-7c5d-4f48-ada6-47dd54b13bd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:16.780216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42ce6fff-7c5d-4f48-ada6-47dd54b13bd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:16.780948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42ce6fff-7c5d-4f48-ada6-47dd54b13bd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:16.781405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42ce6fff-7c5d-4f48-ada6-47dd54b13bd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:16.781833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42ce6fff-7c5d-4f48-ada6-47dd54b13bd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:16.934720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-42ce6fff-7c5d-4f48-ada6-47dd54b13bd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:16.943700 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-42ce6fff-7c5d-4f48-ada6-47dd54b13bd1 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1508 microversion: 2.1 time: 0.176868 Sep 05 17:28:16.944283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1213/2267] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:16 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:17.113068 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ca691f49-d70a-4042-86a4-d104e3030851 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:17.114966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b731cd8d-54ff-43f4-892d-9762e9364bbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:17.115459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ca691f49-d70a-4042-86a4-d104e3030851 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:17.115873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b731cd8d-54ff-43f4-892d-9762e9364bbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:17.124788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b731cd8d-54ff-43f4-892d-9762e9364bbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:17.125389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b731cd8d-54ff-43f4-892d-9762e9364bbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:17.126380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca691f49-d70a-4042-86a4-d104e3030851 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:17.127682 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca691f49-d70a-4042-86a4-d104e3030851 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:17.129034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b731cd8d-54ff-43f4-892d-9762e9364bbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:17.129375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca691f49-d70a-4042-86a4-d104e3030851 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:17.130483 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca691f49-d70a-4042-86a4-d104e3030851 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:17.130613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b731cd8d-54ff-43f4-892d-9762e9364bbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:17.131164 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b731cd8d-54ff-43f4-892d-9762e9364bbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:17.131660 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca691f49-d70a-4042-86a4-d104e3030851 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:17.131814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b731cd8d-54ff-43f4-892d-9762e9364bbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:17.132649 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ca691f49-d70a-4042-86a4-d104e3030851 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:17.353042 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ca691f49-d70a-4042-86a4-d104e3030851 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:17.363712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ca691f49-d70a-4042-86a4-d104e3030851 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.256409 Sep 05 17:28:17.364316 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1055/2268] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:17 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:17.369935 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-933f117f-00f7-4743-9fbe-ad6bd43dd043 req-03275857-8d13-4b26-a7e4-7ea4b43954d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfe215ba-4dff-48b0-a561-60ab7593b6d7", "name": "network-vif-deleted", "tag": "5dfa4258-3985-4da8-9bdc-73fa86de300a"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:28:17.380354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b731cd8d-54ff-43f4-892d-9762e9364bbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:17.387860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-933f117f-00f7-4743-9fbe-ad6bd43dd043 req-03275857-8d13-4b26-a7e4-7ea4b43954d0 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:17.388384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-933f117f-00f7-4743-9fbe-ad6bd43dd043 req-03275857-8d13-4b26-a7e4-7ea4b43954d0 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:17.388784 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-933f117f-00f7-4743-9fbe-ad6bd43dd043 req-03275857-8d13-4b26-a7e4-7ea4b43954d0 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:17.397339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b731cd8d-54ff-43f4-892d-9762e9364bbd tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.287813 Sep 05 17:28:17.398666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1214/2269] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:17 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:28:17.402376 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-933f117f-00f7-4743-9fbe-ad6bd43dd043 req-03275857-8d13-4b26-a7e4-7ea4b43954d0 service nova] Creating event network-vif-deleted:5dfa4258-3985-4da8-9bdc-73fa86de300a for instance bfe215ba-4dff-48b0-a561-60ab7593b6d7 on hv-cinder-85596 Sep 05 17:28:17.408716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-933f117f-00f7-4743-9fbe-ad6bd43dd043 req-03275857-8d13-4b26-a7e4-7ea4b43954d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042567 Sep 05 17:28:17.409522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1056/2270] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:28:17.968509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f7dcfa83-9914-406b-9a0e-ad7e2c2359dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:17.969228 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f7dcfa83-9914-406b-9a0e-ad7e2c2359dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:17.976054 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7dcfa83-9914-406b-9a0e-ad7e2c2359dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:17.976578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7dcfa83-9914-406b-9a0e-ad7e2c2359dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:17.977142 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7dcfa83-9914-406b-9a0e-ad7e2c2359dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:17.977874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7dcfa83-9914-406b-9a0e-ad7e2c2359dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:17.978370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7dcfa83-9914-406b-9a0e-ad7e2c2359dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:17.978832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7dcfa83-9914-406b-9a0e-ad7e2c2359dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:18.012308 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7dcfa83-9914-406b-9a0e-ad7e2c2359dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:18.012793 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7dcfa83-9914-406b-9a0e-ad7e2c2359dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:18.013227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7dcfa83-9914-406b-9a0e-ad7e2c2359dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:18.013672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-f7dcfa83-9914-406b-9a0e-ad7e2c2359dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lazy-loading 'fault' on Instance uuid bfe215ba-4dff-48b0-a561-60ab7593b6d7 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:28:18.056373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f7dcfa83-9914-406b-9a0e-ad7e2c2359dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:18.063311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f7dcfa83-9914-406b-9a0e-ad7e2c2359dc tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 200 len: 1312 microversion: 2.1 time: 0.099333 Sep 05 17:28:18.063880 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1215/2271] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:17 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:18.394591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c48c03a9-3eeb-4fda-9c59-85ac77d997d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:18.395281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c48c03a9-3eeb-4fda-9c59-85ac77d997d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:18.402294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c48c03a9-3eeb-4fda-9c59-85ac77d997d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:18.402769 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c48c03a9-3eeb-4fda-9c59-85ac77d997d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:18.403192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c48c03a9-3eeb-4fda-9c59-85ac77d997d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:18.403867 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c48c03a9-3eeb-4fda-9c59-85ac77d997d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:18.404351 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c48c03a9-3eeb-4fda-9c59-85ac77d997d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:18.404761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c48c03a9-3eeb-4fda-9c59-85ac77d997d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:18.422356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-04e40531-2291-4020-ac68-863d665b81e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:18.423090 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-04e40531-2291-4020-ac68-863d665b81e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:18.429751 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04e40531-2291-4020-ac68-863d665b81e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:18.430204 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04e40531-2291-4020-ac68-863d665b81e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:18.430636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04e40531-2291-4020-ac68-863d665b81e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:18.431356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04e40531-2291-4020-ac68-863d665b81e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:18.431807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04e40531-2291-4020-ac68-863d665b81e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:18.432256 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04e40531-2291-4020-ac68-863d665b81e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:18.587658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c48c03a9-3eeb-4fda-9c59-85ac77d997d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:18.597037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c48c03a9-3eeb-4fda-9c59-85ac77d997d9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.209214 Sep 05 17:28:18.597704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1057/2272] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:18 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:18.614220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-04e40531-2291-4020-ac68-863d665b81e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:18.622779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-04e40531-2291-4020-ac68-863d665b81e1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.204474 Sep 05 17:28:18.623348 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1216/2273] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:18 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:19.090532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c7670c62-53af-4924-b915-5028b6d0df3c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:19.091916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c7670c62-53af-4924-b915-5028b6d0df3c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: bfe215ba-4dff-48b0-a561-60ab7593b6d7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:19.102463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7670c62-53af-4924-b915-5028b6d0df3c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:19.103272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7670c62-53af-4924-b915-5028b6d0df3c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:19.104002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7670c62-53af-4924-b915-5028b6d0df3c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:19.105256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7670c62-53af-4924-b915-5028b6d0df3c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:19.106013 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7670c62-53af-4924-b915-5028b6d0df3c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:19.106685 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c7670c62-53af-4924-b915-5028b6d0df3c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:19.122816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-c7670c62-53af-4924-b915-5028b6d0df3c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] HTTP exception thrown: Instance bfe215ba-4dff-48b0-a561-60ab7593b6d7 could not be found. Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c7670c62-53af-4924-b915-5028b6d0df3c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Request method failure captured: Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 HTTP/1.1 Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFitxdGDptMqKaSDcVcmkRm1t48CriV9c0ccA6Z1f3PBhZ4X3VOBQrmrnSwoQJNXHENpQxOK9N_VWBLXzvYEwxkL7F6ZeCtCe8BAOiO0gzsNLKUjsJwSlh16H3BtCRgZARE5xoQqGlZxRzVVM6Hcrsb1HnEo3UGWPn2hD9AA0yp03J-k Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: cdbd9f06f3484da6a6fd14977b82f384 Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1395654055 Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:28:19.124543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:28:19.126512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cdbd9f06f3484da6a6fd14977b82f384"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cdbd9f06f3484da6a6fd14977b82f384"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cdbd9f06f3484da6a6fd14977b82f384"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cdbd9f06f3484da6a6fd14977b82f384"}]}] Sep 05 17:28:19.126512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1395654055 Sep 05 17:28:19.126512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: cdbd9f06f3484da6a6fd14977b82f384 Sep 05 17:28:19.126512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1395654055 Sep 05 17:28:19.126512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-ServerRescueNegativeTestJSON-1395654055-project Sep 05 17:28:19.126512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:28:19.126512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:28:19.126512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: 06e60909a8b04008af659620527e3236 Sep 05 17:28:19.126512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1395654055-project Sep 05 17:28:19.126512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:28:19.126512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance bfe215ba-4dff-48b0-a561-60ab7593b6d7 could not be found. Sep 05 17:28:19.126512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': 'bfe215ba-4dff-48b0-a561-60ab7593b6d7'} Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfe215ba-4dff-48b0-a561-60ab7593b6d7 could not be found. Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:28:19.127464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfe215ba-4dff-48b0-a561-60ab7593b6d7 could not be found. Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfe215ba-4dff-48b0-a561-60ab7593b6d7 could not be found. Sep 05 17:28:19.128955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:28:19.130365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c7670c62-53af-4924-b915-5028b6d0df3c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Returning 404 to user: Instance bfe215ba-4dff-48b0-a561-60ab7593b6d7 could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:28:19.130365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c7670c62-53af-4924-b915-5028b6d0df3c tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7" status: 404 len: 111 microversion: 2.1 time: 0.042013 Sep 05 17:28:19.130365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1058/2274] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:19 2022] GET /compute/v2.1/servers/bfe215ba-4dff-48b0-a561-60ab7593b6d7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:28:19.134739 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-eb19c479-a755-4460-b3b9-97847595713e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:19.135255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-eb19c479-a755-4460-b3b9-97847595713e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:19.141901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb19c479-a755-4460-b3b9-97847595713e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:19.142385 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb19c479-a755-4460-b3b9-97847595713e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:19.142819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb19c479-a755-4460-b3b9-97847595713e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:19.143760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb19c479-a755-4460-b3b9-97847595713e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:19.144231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb19c479-a755-4460-b3b9-97847595713e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:19.144682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb19c479-a755-4460-b3b9-97847595713e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:19.170908 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-eb19c479-a755-4460-b3b9-97847595713e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:28:19.259624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-eb19c479-a755-4460-b3b9-97847595713e tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 204 len: 0 microversion: 2.1 time: 0.128452 Sep 05 17:28:19.260239 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1217/2275] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:28:19 2022] DELETE /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:28:19.268980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-aea4bb09-5978-41f9-b4ce-2867276a22e0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:19.269594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-aea4bb09-5978-41f9-b4ce-2867276a22e0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:19.275636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aea4bb09-5978-41f9-b4ce-2867276a22e0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:19.276117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aea4bb09-5978-41f9-b4ce-2867276a22e0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:19.276596 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aea4bb09-5978-41f9-b4ce-2867276a22e0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:19.277276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aea4bb09-5978-41f9-b4ce-2867276a22e0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:19.277722 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aea4bb09-5978-41f9-b4ce-2867276a22e0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:19.278139 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aea4bb09-5978-41f9-b4ce-2867276a22e0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:19.433593 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-aea4bb09-5978-41f9-b4ce-2867276a22e0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:19.443902 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-aea4bb09-5978-41f9-b4ce-2867276a22e0 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1521 microversion: 2.1 time: 0.179125 Sep 05 17:28:19.444513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1059/2276] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:19 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:19.620778 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f084c156-1807-4c53-84e5-f451a20a707a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:19.621471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f084c156-1807-4c53-84e5-f451a20a707a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:19.628120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f084c156-1807-4c53-84e5-f451a20a707a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:19.628563 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f084c156-1807-4c53-84e5-f451a20a707a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:19.628992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f084c156-1807-4c53-84e5-f451a20a707a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:19.629673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f084c156-1807-4c53-84e5-f451a20a707a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:19.630124 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f084c156-1807-4c53-84e5-f451a20a707a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:19.630542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f084c156-1807-4c53-84e5-f451a20a707a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:19.646353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4062f2fd-2920-4576-a690-ae7ebfd8ef49 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:19.646960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4062f2fd-2920-4576-a690-ae7ebfd8ef49 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:19.653225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4062f2fd-2920-4576-a690-ae7ebfd8ef49 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:19.653687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4062f2fd-2920-4576-a690-ae7ebfd8ef49 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:19.654148 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4062f2fd-2920-4576-a690-ae7ebfd8ef49 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:19.654836 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4062f2fd-2920-4576-a690-ae7ebfd8ef49 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:19.655295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4062f2fd-2920-4576-a690-ae7ebfd8ef49 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:19.655703 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4062f2fd-2920-4576-a690-ae7ebfd8ef49 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:19.839639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f084c156-1807-4c53-84e5-f451a20a707a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:19.843226 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4062f2fd-2920-4576-a690-ae7ebfd8ef49 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:19.848558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f084c156-1807-4c53-84e5-f451a20a707a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.232126 Sep 05 17:28:19.849235 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1218/2277] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:19 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:19.852997 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4062f2fd-2920-4576-a690-ae7ebfd8ef49 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.211211 Sep 05 17:28:19.853558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1060/2278] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:19 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:20.468032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-baf7529d-8060-4a63-9ca0-9cc986365714 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:20.468703 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-baf7529d-8060-4a63-9ca0-9cc986365714 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:20.476487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baf7529d-8060-4a63-9ca0-9cc986365714 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:20.477009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baf7529d-8060-4a63-9ca0-9cc986365714 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:20.477442 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baf7529d-8060-4a63-9ca0-9cc986365714 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:20.478183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baf7529d-8060-4a63-9ca0-9cc986365714 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:20.478856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baf7529d-8060-4a63-9ca0-9cc986365714 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:20.479314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baf7529d-8060-4a63-9ca0-9cc986365714 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:20.622426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-5865180c-6027-46df-bc97-9588134ed85f req-1723181d-aa48-4555-909b-8d8e7a7adcaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb25ed7-1069-41a4-b3d3-25231e7322e7", "name": "network-vif-deleted", "tag": "69dc6b0f-11b6-4dd3-860d-3b29a41d0e34"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:28:20.632584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-baf7529d-8060-4a63-9ca0-9cc986365714 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e60909a8b04008af659620527e3236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd9f06f3484da6a6fd14977b82f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:20.633764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-5865180c-6027-46df-bc97-9588134ed85f req-1723181d-aa48-4555-909b-8d8e7a7adcaf service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:20.634251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-5865180c-6027-46df-bc97-9588134ed85f req-1723181d-aa48-4555-909b-8d8e7a7adcaf service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:20.634678 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-5865180c-6027-46df-bc97-9588134ed85f req-1723181d-aa48-4555-909b-8d8e7a7adcaf service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:20.641759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-baf7529d-8060-4a63-9ca0-9cc986365714 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 200 len: 1521 microversion: 2.1 time: 0.178801 Sep 05 17:28:20.646922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-5865180c-6027-46df-bc97-9588134ed85f req-1723181d-aa48-4555-909b-8d8e7a7adcaf service nova] Creating event network-vif-deleted:69dc6b0f-11b6-4dd3-860d-3b29a41d0e34 for instance 2fb25ed7-1069-41a4-b3d3-25231e7322e7 on hv-cinder-85596 Sep 05 17:28:20.652458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-5865180c-6027-46df-bc97-9588134ed85f req-1723181d-aa48-4555-909b-8d8e7a7adcaf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034250 Sep 05 17:28:20.653177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1061/2279] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:28:20.658255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1219/2280] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:20 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:20.872992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e7c0398b-b7e6-4cf5-a3e1-96ebcd1a485a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:20.873725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e7c0398b-b7e6-4cf5-a3e1-96ebcd1a485a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:20.876115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-45bc25ea-4497-4a04-b23a-ed2c76bd82d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:20.876777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-45bc25ea-4497-4a04-b23a-ed2c76bd82d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:20.880555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e7c0398b-b7e6-4cf5-a3e1-96ebcd1a485a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:20.881047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e7c0398b-b7e6-4cf5-a3e1-96ebcd1a485a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:20.881480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e7c0398b-b7e6-4cf5-a3e1-96ebcd1a485a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:20.882196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e7c0398b-b7e6-4cf5-a3e1-96ebcd1a485a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:20.882858 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e7c0398b-b7e6-4cf5-a3e1-96ebcd1a485a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:20.883286 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e7c0398b-b7e6-4cf5-a3e1-96ebcd1a485a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:20.883579 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45bc25ea-4497-4a04-b23a-ed2c76bd82d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:20.884063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45bc25ea-4497-4a04-b23a-ed2c76bd82d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:20.884520 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45bc25ea-4497-4a04-b23a-ed2c76bd82d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:20.885231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45bc25ea-4497-4a04-b23a-ed2c76bd82d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:20.885673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45bc25ea-4497-4a04-b23a-ed2c76bd82d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:20.886066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45bc25ea-4497-4a04-b23a-ed2c76bd82d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:21.081515 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e7c0398b-b7e6-4cf5-a3e1-96ebcd1a485a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:21.088168 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-45bc25ea-4497-4a04-b23a-ed2c76bd82d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:21.090016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e7c0398b-b7e6-4cf5-a3e1-96ebcd1a485a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.221392 Sep 05 17:28:21.090588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1062/2281] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:20 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:21.097358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-45bc25ea-4497-4a04-b23a-ed2c76bd82d4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.225327 Sep 05 17:28:21.097944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1220/2282] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:20 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:21.666877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a99fb58d-9acd-4b3c-9d5e-d5713df696a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:21.667477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a99fb58d-9acd-4b3c-9d5e-d5713df696a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] [instance: 2fb25ed7-1069-41a4-b3d3-25231e7322e7] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:21.675416 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a99fb58d-9acd-4b3c-9d5e-d5713df696a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:21.675948 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a99fb58d-9acd-4b3c-9d5e-d5713df696a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:21.676476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a99fb58d-9acd-4b3c-9d5e-d5713df696a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:21.677279 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a99fb58d-9acd-4b3c-9d5e-d5713df696a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:21.677792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a99fb58d-9acd-4b3c-9d5e-d5713df696a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:21.678274 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a99fb58d-9acd-4b3c-9d5e-d5713df696a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:21.694715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-a99fb58d-9acd-4b3c-9d5e-d5713df696a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] HTTP exception thrown: Instance 2fb25ed7-1069-41a4-b3d3-25231e7322e7 could not be found. Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a99fb58d-9acd-4b3c-9d5e-d5713df696a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Request method failure captured: Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 HTTP/1.1 Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFitxdGDptMqKaSDcVcmkRm1t48CriV9c0ccA6Z1f3PBhZ4X3VOBQrmrnSwoQJNXHENpQxOK9N_VWBLXzvYEwxkL7F6ZeCtCe8BAOiO0gzsNLKUjsJwSlh16H3BtCRgZARE5xoQqGlZxRzVVM6Hcrsb1HnEo3UGWPn2hD9AA0yp03J-k Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: cdbd9f06f3484da6a6fd14977b82f384 Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1395654055 Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:28:21.696390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:28:21.698111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cdbd9f06f3484da6a6fd14977b82f384"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cdbd9f06f3484da6a6fd14977b82f384"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cdbd9f06f3484da6a6fd14977b82f384"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cdbd9f06f3484da6a6fd14977b82f384"}]}] Sep 05 17:28:21.698111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1395654055 Sep 05 17:28:21.698111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: cdbd9f06f3484da6a6fd14977b82f384 Sep 05 17:28:21.698111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1395654055 Sep 05 17:28:21.698111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-ServerRescueNegativeTestJSON-1395654055-project Sep 05 17:28:21.698111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:28:21.698111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:28:21.698111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: 06e60909a8b04008af659620527e3236 Sep 05 17:28:21.698111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1395654055-project Sep 05 17:28:21.698111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:28:21.698111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance 2fb25ed7-1069-41a4-b3d3-25231e7322e7 could not be found. Sep 05 17:28:21.698111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': '2fb25ed7-1069-41a4-b3d3-25231e7322e7'} Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fb25ed7-1069-41a4-b3d3-25231e7322e7 could not be found. Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:28:21.699007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fb25ed7-1069-41a4-b3d3-25231e7322e7 could not be found. Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fb25ed7-1069-41a4-b3d3-25231e7322e7 could not be found. Sep 05 17:28:21.700482 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:28:21.701935 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a99fb58d-9acd-4b3c-9d5e-d5713df696a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] Returning 404 to user: Instance 2fb25ed7-1069-41a4-b3d3-25231e7322e7 could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:28:21.701935 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a99fb58d-9acd-4b3c-9d5e-d5713df696a4 tempest-ServerRescueNegativeTestJSON-1395654055 tempest-ServerRescueNegativeTestJSON-1395654055-project] 10.222.0.23 "GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7" status: 404 len: 111 microversion: 2.1 time: 0.035871 Sep 05 17:28:21.701935 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1063/2283] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:21 2022] GET /compute/v2.1/servers/2fb25ed7-1069-41a4-b3d3-25231e7322e7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:28:22.113496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-62a71114-8284-458a-ac23-f33062440151 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:22.114126 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-62a71114-8284-458a-ac23-f33062440151 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:22.120429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d275ad1e-cd73-4d61-9c7a-2719d2b89d13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:22.120860 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62a71114-8284-458a-ac23-f33062440151 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:22.121170 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d275ad1e-cd73-4d61-9c7a-2719d2b89d13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:22.121336 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62a71114-8284-458a-ac23-f33062440151 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:22.121763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62a71114-8284-458a-ac23-f33062440151 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:22.122475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62a71114-8284-458a-ac23-f33062440151 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:22.122991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62a71114-8284-458a-ac23-f33062440151 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:22.123328 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62a71114-8284-458a-ac23-f33062440151 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:22.127531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d275ad1e-cd73-4d61-9c7a-2719d2b89d13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:22.128012 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d275ad1e-cd73-4d61-9c7a-2719d2b89d13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:22.128621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d275ad1e-cd73-4d61-9c7a-2719d2b89d13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:22.129320 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d275ad1e-cd73-4d61-9c7a-2719d2b89d13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:22.129766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d275ad1e-cd73-4d61-9c7a-2719d2b89d13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:22.130216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d275ad1e-cd73-4d61-9c7a-2719d2b89d13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:22.662037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d275ad1e-cd73-4d61-9c7a-2719d2b89d13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:22.666264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-62a71114-8284-458a-ac23-f33062440151 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:22.671103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d275ad1e-cd73-4d61-9c7a-2719d2b89d13 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.554451 Sep 05 17:28:22.672699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1064/2284] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:22 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:22.687516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-62a71114-8284-458a-ac23-f33062440151 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.578230 Sep 05 17:28:22.688116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1221/2285] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:22 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:23.695215 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-31a8f96a-9cb1-48e5-8b94-4767aeae3f36 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:23.696513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-31a8f96a-9cb1-48e5-8b94-4767aeae3f36 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:23.703134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-31a8f96a-9cb1-48e5-8b94-4767aeae3f36 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:23.704017 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-31a8f96a-9cb1-48e5-8b94-4767aeae3f36 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:23.706132 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-31a8f96a-9cb1-48e5-8b94-4767aeae3f36 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:23.707249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-31a8f96a-9cb1-48e5-8b94-4767aeae3f36 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:23.707889 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-31a8f96a-9cb1-48e5-8b94-4767aeae3f36 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:23.708512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-31a8f96a-9cb1-48e5-8b94-4767aeae3f36 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:23.715134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4e389a96-bfba-4da0-b663-ec6ebd4bfb55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:23.716925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4e389a96-bfba-4da0-b663-ec6ebd4bfb55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:23.725160 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e389a96-bfba-4da0-b663-ec6ebd4bfb55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:23.725959 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e389a96-bfba-4da0-b663-ec6ebd4bfb55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:23.726807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e389a96-bfba-4da0-b663-ec6ebd4bfb55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:23.727749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e389a96-bfba-4da0-b663-ec6ebd4bfb55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:23.728396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e389a96-bfba-4da0-b663-ec6ebd4bfb55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:23.728982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e389a96-bfba-4da0-b663-ec6ebd4bfb55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:24.031861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-31a8f96a-9cb1-48e5-8b94-4767aeae3f36 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:24.037150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4e389a96-bfba-4da0-b663-ec6ebd4bfb55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:24.041812 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-31a8f96a-9cb1-48e5-8b94-4767aeae3f36 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.350637 Sep 05 17:28:24.049161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4e389a96-bfba-4da0-b663-ec6ebd4bfb55 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.340808 Sep 05 17:28:24.056913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1065/2286] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:23 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:24.064066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1222/2287] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:23 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:25.066346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8e5a5f51-638a-4364-ae63-737ba809a1b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:25.067116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8e5a5f51-638a-4364-ae63-737ba809a1b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:25.074584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e5a5f51-638a-4364-ae63-737ba809a1b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:25.074892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9718a1d9-194a-45d0-be8c-1609f869b744 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:25.075335 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e5a5f51-638a-4364-ae63-737ba809a1b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:25.075504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9718a1d9-194a-45d0-be8c-1609f869b744 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:25.075660 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e5a5f51-638a-4364-ae63-737ba809a1b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:25.077022 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e5a5f51-638a-4364-ae63-737ba809a1b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:25.077022 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e5a5f51-638a-4364-ae63-737ba809a1b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:25.077446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8e5a5f51-638a-4364-ae63-737ba809a1b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:25.083377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9718a1d9-194a-45d0-be8c-1609f869b744 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:25.084267 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9718a1d9-194a-45d0-be8c-1609f869b744 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:25.084741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9718a1d9-194a-45d0-be8c-1609f869b744 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:25.085449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9718a1d9-194a-45d0-be8c-1609f869b744 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:25.085898 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9718a1d9-194a-45d0-be8c-1609f869b744 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:25.086315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9718a1d9-194a-45d0-be8c-1609f869b744 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:25.615796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9718a1d9-194a-45d0-be8c-1609f869b744 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:25.621716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8e5a5f51-638a-4364-ae63-737ba809a1b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:25.624935 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9718a1d9-194a-45d0-be8c-1609f869b744 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.553892 Sep 05 17:28:25.625845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1223/2288] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:25 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:25.642050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8e5a5f51-638a-4364-ae63-737ba809a1b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.579659 Sep 05 17:28:25.642811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1066/2289] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:25 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:26.649103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d7455fe1-1dec-45a0-b592-061a3fc9f35a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:26.649726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d7455fe1-1dec-45a0-b592-061a3fc9f35a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:26.656796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7455fe1-1dec-45a0-b592-061a3fc9f35a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:26.657280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7455fe1-1dec-45a0-b592-061a3fc9f35a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:26.657712 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7455fe1-1dec-45a0-b592-061a3fc9f35a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:26.658642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7455fe1-1dec-45a0-b592-061a3fc9f35a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:26.659109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7455fe1-1dec-45a0-b592-061a3fc9f35a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:26.659613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7455fe1-1dec-45a0-b592-061a3fc9f35a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:26.666002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ef0381ad-abdb-4c47-984c-153305ebf0ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:26.666807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ef0381ad-abdb-4c47-984c-153305ebf0ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:26.673668 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef0381ad-abdb-4c47-984c-153305ebf0ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:26.674348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef0381ad-abdb-4c47-984c-153305ebf0ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:26.674961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef0381ad-abdb-4c47-984c-153305ebf0ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:26.675881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef0381ad-abdb-4c47-984c-153305ebf0ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:26.676542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef0381ad-abdb-4c47-984c-153305ebf0ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:26.677144 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef0381ad-abdb-4c47-984c-153305ebf0ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:26.867828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d7455fe1-1dec-45a0-b592-061a3fc9f35a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:26.876064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d7455fe1-1dec-45a0-b592-061a3fc9f35a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.230723 Sep 05 17:28:26.876584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ef0381ad-abdb-4c47-984c-153305ebf0ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:26.880241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1224/2290] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:26 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:26.886558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ef0381ad-abdb-4c47-984c-153305ebf0ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.224524 Sep 05 17:28:26.887120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1067/2291] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:26 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:27.899658 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-43bbb886-1bd7-43c1-a2cf-eb305b512e18 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:27.900338 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-43bbb886-1bd7-43c1-a2cf-eb305b512e18 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:27.906810 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43bbb886-1bd7-43c1-a2cf-eb305b512e18 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:27.907718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43bbb886-1bd7-43c1-a2cf-eb305b512e18 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:27.908389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43bbb886-1bd7-43c1-a2cf-eb305b512e18 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:27.909269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43bbb886-1bd7-43c1-a2cf-eb305b512e18 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:27.909929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43bbb886-1bd7-43c1-a2cf-eb305b512e18 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:27.910064 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ce43c9f7-bf45-4ef4-8c9e-1d7b05a6ae43 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:27.910640 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ce43c9f7-bf45-4ef4-8c9e-1d7b05a6ae43 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:27.911137 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-43bbb886-1bd7-43c1-a2cf-eb305b512e18 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:27.915823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:28:27.917881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce43c9f7-bf45-4ef4-8c9e-1d7b05a6ae43 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:27.918537 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce43c9f7-bf45-4ef4-8c9e-1d7b05a6ae43 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:27.919180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce43c9f7-bf45-4ef4-8c9e-1d7b05a6ae43 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:27.920067 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce43c9f7-bf45-4ef4-8c9e-1d7b05a6ae43 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:27.920696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce43c9f7-bf45-4ef4-8c9e-1d7b05a6ae43 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:27.921278 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ce43c9f7-bf45-4ef4-8c9e-1d7b05a6ae43 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:28.120966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-43bbb886-1bd7-43c1-a2cf-eb305b512e18 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:28.130536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-43bbb886-1bd7-43c1-a2cf-eb305b512e18 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.234756 Sep 05 17:28:28.131623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1225/2292] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:27 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:28.133681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ce43c9f7-bf45-4ef4-8c9e-1d7b05a6ae43 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:28.145633 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ce43c9f7-bf45-4ef4-8c9e-1d7b05a6ae43 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.239342 Sep 05 17:28:28.146520 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1068/2293] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:27 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:29.153862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a0c3d42d-170a-4d98-82c4-bdc40eee64b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:29.155148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a0c3d42d-170a-4d98-82c4-bdc40eee64b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:29.157713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:28:29.166284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0c3d42d-170a-4d98-82c4-bdc40eee64b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:29.166610 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0c3d42d-170a-4d98-82c4-bdc40eee64b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:29.167047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0c3d42d-170a-4d98-82c4-bdc40eee64b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:29.167766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0c3d42d-170a-4d98-82c4-bdc40eee64b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:29.168923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0c3d42d-170a-4d98-82c4-bdc40eee64b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:29.169309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0c3d42d-170a-4d98-82c4-bdc40eee64b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:29.171409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-47e13748-9bc9-4d7e-8246-4f8f4ca718be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:29.172339 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-47e13748-9bc9-4d7e-8246-4f8f4ca718be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:29.176609 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:28:29.182443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47e13748-9bc9-4d7e-8246-4f8f4ca718be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:29.183116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47e13748-9bc9-4d7e-8246-4f8f4ca718be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:29.183926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47e13748-9bc9-4d7e-8246-4f8f4ca718be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:29.184873 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47e13748-9bc9-4d7e-8246-4f8f4ca718be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:29.185534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47e13748-9bc9-4d7e-8246-4f8f4ca718be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:29.186121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47e13748-9bc9-4d7e-8246-4f8f4ca718be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:29.419278 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-47e13748-9bc9-4d7e-8246-4f8f4ca718be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:29.421743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:28:29.435800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-47e13748-9bc9-4d7e-8246-4f8f4ca718be tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.269727 Sep 05 17:28:29.438648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1069/2294] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:29 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:28:29.487340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a0c3d42d-170a-4d98-82c4-bdc40eee64b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:29.497459 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a0c3d42d-170a-4d98-82c4-bdc40eee64b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.347548 Sep 05 17:28:29.498911 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1226/2295] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:29 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:28:30.463097 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-068259f4-c020-4c7c-b902-a8941a72886a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:30.464858 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-068259f4-c020-4c7c-b902-a8941a72886a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:30.486492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-068259f4-c020-4c7c-b902-a8941a72886a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:30.487270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-068259f4-c020-4c7c-b902-a8941a72886a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:30.487933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-068259f4-c020-4c7c-b902-a8941a72886a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:30.489839 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-068259f4-c020-4c7c-b902-a8941a72886a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:30.489839 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-068259f4-c020-4c7c-b902-a8941a72886a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:30.490300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-068259f4-c020-4c7c-b902-a8941a72886a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:30.525741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-84a8dc7d-7b38-4473-90f5-f9666313a43b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:30.527573 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-84a8dc7d-7b38-4473-90f5-f9666313a43b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:30.535864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a8dc7d-7b38-4473-90f5-f9666313a43b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:30.537866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a8dc7d-7b38-4473-90f5-f9666313a43b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:30.538545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a8dc7d-7b38-4473-90f5-f9666313a43b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:30.539264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a8dc7d-7b38-4473-90f5-f9666313a43b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:30.543527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a8dc7d-7b38-4473-90f5-f9666313a43b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:30.544254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a8dc7d-7b38-4473-90f5-f9666313a43b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:30.781275 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-068259f4-c020-4c7c-b902-a8941a72886a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:30.794318 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-068259f4-c020-4c7c-b902-a8941a72886a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.338007 Sep 05 17:28:30.794921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1070/2296] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:30 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:30.824677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-84a8dc7d-7b38-4473-90f5-f9666313a43b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:30.833600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-84a8dc7d-7b38-4473-90f5-f9666313a43b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.314855 Sep 05 17:28:30.834220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1227/2297] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:30 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:28:31.583131 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-eb147241-16ef-42dd-adb5-7ab702d3caa2 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Action: 'create', calling method: .version_select at 0x7f1d3ac6a8b0>, body: {"keypair": {"name": "tempest-keypair-654426380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZ5X301gSqRdiu6tVc7PK/6cPSuNLBfwMOTdzCFv62FVSfqmVXYZNfWvrEsOXKXbwLUh5PZsByFGfmhYRSm0V1SSk5AyTvmy4r6VLpqgKZfKXEvtdToDs5W8LmUxWmcyQ=="}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:28:31.600570 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-eb147241-16ef-42dd-adb5-7ab702d3caa2 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Getting quotas for project f8dd08c068a5435c8c426d4a9a24b30d. Resources: {'key_pairs'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:28:31.604392 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-eb147241-16ef-42dd-adb5-7ab702d3caa2 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Getting quotas for user bb7767df40d849b8bb870ad090fead83 and project f8dd08c068a5435c8c426d4a9a24b30d. Resources: {'key_pairs'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:28:31.633397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-eb147241-16ef-42dd-adb5-7ab702d3caa2 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.181705 Sep 05 17:28:31.633995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1071/2298] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Sep 5 17:28:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:28:31.818642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aa9c4952-3d2e-4639-8878-6274ca4a9ba0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:31.820247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aa9c4952-3d2e-4639-8878-6274ca4a9ba0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:31.827883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa9c4952-3d2e-4639-8878-6274ca4a9ba0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:31.829916 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa9c4952-3d2e-4639-8878-6274ca4a9ba0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:31.831215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa9c4952-3d2e-4639-8878-6274ca4a9ba0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:31.832934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa9c4952-3d2e-4639-8878-6274ca4a9ba0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:31.833590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa9c4952-3d2e-4639-8878-6274ca4a9ba0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:31.834198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa9c4952-3d2e-4639-8878-6274ca4a9ba0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:31.861437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d75d2eb5-0d1a-4970-aa48-3b19285a7a0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:31.862731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d75d2eb5-0d1a-4970-aa48-3b19285a7a0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:31.873918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d75d2eb5-0d1a-4970-aa48-3b19285a7a0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:31.874945 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d75d2eb5-0d1a-4970-aa48-3b19285a7a0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:31.877212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d75d2eb5-0d1a-4970-aa48-3b19285a7a0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:31.878780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d75d2eb5-0d1a-4970-aa48-3b19285a7a0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:31.879461 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d75d2eb5-0d1a-4970-aa48-3b19285a7a0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:31.880337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d75d2eb5-0d1a-4970-aa48-3b19285a7a0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:32.105504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aa9c4952-3d2e-4639-8878-6274ca4a9ba0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:32.113496 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d75d2eb5-0d1a-4970-aa48-3b19285a7a0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:32.114666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aa9c4952-3d2e-4639-8878-6274ca4a9ba0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.300467 Sep 05 17:28:32.115262 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1228/2299] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:31 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:32.135912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d75d2eb5-0d1a-4970-aa48-3b19285a7a0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.278722 Sep 05 17:28:32.136589 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1072/2300] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:31 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:33.069493 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1591618794", "imageRef": "c1a4f3d3-4d68-489a-a57b-bae7854beb29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "780e697b-2582-4702-b4df-328cf21a430d"}], "security_groups": [{"name": "tempest-securitygroup--1940806282"}], "key_name": "tempest-keypair-654426380", "user_data": "}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:28:33.138886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-42a027cc-1763-4fc4-a0d3-a83f05432ee4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:33.139848 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-42a027cc-1763-4fc4-a0d3-a83f05432ee4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:33.147233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42a027cc-1763-4fc4-a0d3-a83f05432ee4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:33.148014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42a027cc-1763-4fc4-a0d3-a83f05432ee4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:33.148476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42a027cc-1763-4fc4-a0d3-a83f05432ee4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:33.149203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42a027cc-1763-4fc4-a0d3-a83f05432ee4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:33.149787 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42a027cc-1763-4fc4-a0d3-a83f05432ee4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:33.150205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-42a027cc-1763-4fc4-a0d3-a83f05432ee4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:33.197001 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] validate_networks() for [('780e697b-2582-4702-b4df-328cf21a430d', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:28:33.388639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-42a027cc-1763-4fc4-a0d3-a83f05432ee4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:33.398334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-42a027cc-1763-4fc4-a0d3-a83f05432ee4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.264043 Sep 05 17:28:33.398967 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1073/2301] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:33 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:33.404192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ec40a8f8-1904-43e0-8c4f-07efec772f53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:33.405460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ec40a8f8-1904-43e0-8c4f-07efec772f53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:33.420734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec40a8f8-1904-43e0-8c4f-07efec772f53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:33.421232 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec40a8f8-1904-43e0-8c4f-07efec772f53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:33.421660 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec40a8f8-1904-43e0-8c4f-07efec772f53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:33.422360 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec40a8f8-1904-43e0-8c4f-07efec772f53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:33.422986 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec40a8f8-1904-43e0-8c4f-07efec772f53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:33.423876 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ec40a8f8-1904-43e0-8c4f-07efec772f53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:33.637079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ec40a8f8-1904-43e0-8c4f-07efec772f53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:33.646112 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ec40a8f8-1904-43e0-8c4f-07efec772f53 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.245590 Sep 05 17:28:33.646681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1074/2302] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:33 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:33.728108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:28:33.728549 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:28:33.729038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:28:33.729544 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:28:33.730120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:28:33.738840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:33.739293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:33.739720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:33.740456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:33.740904 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:33.741320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:33.759696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Getting quotas for project f8dd08c068a5435c8c426d4a9a24b30d. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:28:33.763636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Getting quotas for user bb7767df40d849b8bb870ad090fead83 and project f8dd08c068a5435c8c426d4a9a24b30d. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:28:33.774527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:28:33.776863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a4f3d3-4d68-489a-a57b-bae7854beb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:28:33.825441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-44f863cc-bced-45d3-8a8b-83eb0d9fd632 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.760963 Sep 05 17:28:33.826107 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1229/2303] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:28:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 17:28:33.837572 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cfe5038e-79a2-4a09-a26b-4aa8d5f4a126 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:33.838208 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cfe5038e-79a2-4a09-a26b-4aa8d5f4a126 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:33.898258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cfe5038e-79a2-4a09-a26b-4aa8d5f4a126 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:33.910340 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cfe5038e-79a2-4a09-a26b-4aa8d5f4a126 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 200 len: 1237 microversion: 2.1 time: 0.075835 Sep 05 17:28:33.911195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1075/2304] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:33 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 1237 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:34.423031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fd1467e0-45a2-45bb-86a0-a91e88bff41d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:34.423652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fd1467e0-45a2-45bb-86a0-a91e88bff41d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:34.431090 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd1467e0-45a2-45bb-86a0-a91e88bff41d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:34.431638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd1467e0-45a2-45bb-86a0-a91e88bff41d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:34.432070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd1467e0-45a2-45bb-86a0-a91e88bff41d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:34.432799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd1467e0-45a2-45bb-86a0-a91e88bff41d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:34.433243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd1467e0-45a2-45bb-86a0-a91e88bff41d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:34.433657 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd1467e0-45a2-45bb-86a0-a91e88bff41d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:34.594877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fd1467e0-45a2-45bb-86a0-a91e88bff41d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:34.604546 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fd1467e0-45a2-45bb-86a0-a91e88bff41d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.186477 Sep 05 17:28:34.605731 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1230/2305] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:34 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:34.671456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-714cbe63-09b0-42bb-8158-d9ec3d796e8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:34.672066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-714cbe63-09b0-42bb-8158-d9ec3d796e8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:34.681290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-714cbe63-09b0-42bb-8158-d9ec3d796e8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:34.682072 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-714cbe63-09b0-42bb-8158-d9ec3d796e8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:34.682870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-714cbe63-09b0-42bb-8158-d9ec3d796e8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:34.683620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-714cbe63-09b0-42bb-8158-d9ec3d796e8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:34.684272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-714cbe63-09b0-42bb-8158-d9ec3d796e8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:34.685130 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-714cbe63-09b0-42bb-8158-d9ec3d796e8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:34.830382 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-714cbe63-09b0-42bb-8158-d9ec3d796e8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:34.839162 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-714cbe63-09b0-42bb-8158-d9ec3d796e8e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.172063 Sep 05 17:28:34.839728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1076/2306] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:34 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:34.935201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bb04bd71-87d4-489a-825e-216753b0e048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:34.935812 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bb04bd71-87d4-489a-825e-216753b0e048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:34.942401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb04bd71-87d4-489a-825e-216753b0e048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:34.942890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb04bd71-87d4-489a-825e-216753b0e048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:34.943317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb04bd71-87d4-489a-825e-216753b0e048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:34.944017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb04bd71-87d4-489a-825e-216753b0e048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:34.944490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb04bd71-87d4-489a-825e-216753b0e048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:34.944906 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb04bd71-87d4-489a-825e-216753b0e048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:35.015913 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bb04bd71-87d4-489a-825e-216753b0e048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:35.025351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bb04bd71-87d4-489a-825e-216753b0e048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 200 len: 1289 microversion: 2.1 time: 0.094019 Sep 05 17:28:35.025992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1231/2307] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:34 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:35.628819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3beba57a-95f6-47ea-a5a1-20a28ee19d88 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:35.629460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3beba57a-95f6-47ea-a5a1-20a28ee19d88 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:35.635949 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3beba57a-95f6-47ea-a5a1-20a28ee19d88 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:35.636467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3beba57a-95f6-47ea-a5a1-20a28ee19d88 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:35.636901 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3beba57a-95f6-47ea-a5a1-20a28ee19d88 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:35.637581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3beba57a-95f6-47ea-a5a1-20a28ee19d88 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:35.638027 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3beba57a-95f6-47ea-a5a1-20a28ee19d88 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:35.638411 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3beba57a-95f6-47ea-a5a1-20a28ee19d88 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:35.774968 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3beba57a-95f6-47ea-a5a1-20a28ee19d88 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:35.783572 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3beba57a-95f6-47ea-a5a1-20a28ee19d88 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.158804 Sep 05 17:28:35.784139 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1077/2308] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:35 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:35.862259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4638bb13-14e6-4b81-88f5-ac1a1b9eb65d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:35.863119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4638bb13-14e6-4b81-88f5-ac1a1b9eb65d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:35.865824 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:28:35.866164 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:28:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca (ip 10.222.0.23) !!! Sep 05 17:28:35.876968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4638bb13-14e6-4b81-88f5-ac1a1b9eb65d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:35.877452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4638bb13-14e6-4b81-88f5-ac1a1b9eb65d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:35.877885 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4638bb13-14e6-4b81-88f5-ac1a1b9eb65d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:35.878663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4638bb13-14e6-4b81-88f5-ac1a1b9eb65d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:35.879429 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4638bb13-14e6-4b81-88f5-ac1a1b9eb65d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:35.879818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4638bb13-14e6-4b81-88f5-ac1a1b9eb65d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:36.037574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4638bb13-14e6-4b81-88f5-ac1a1b9eb65d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:36.046483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4638bb13-14e6-4b81-88f5-ac1a1b9eb65d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.188133 Sep 05 17:28:36.062441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1232/2309] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:35 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:36.062672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a3486398-b25c-4d8e-a727-856a959b464e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:36.062672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a3486398-b25c-4d8e-a727-856a959b464e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:36.062672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a3486398-b25c-4d8e-a727-856a959b464e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:36.062672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a3486398-b25c-4d8e-a727-856a959b464e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:36.063090 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a3486398-b25c-4d8e-a727-856a959b464e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:36.063090 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a3486398-b25c-4d8e-a727-856a959b464e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:36.063090 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a3486398-b25c-4d8e-a727-856a959b464e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:36.063090 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a3486398-b25c-4d8e-a727-856a959b464e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:36.218246 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a3486398-b25c-4d8e-a727-856a959b464e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:36.226977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a3486398-b25c-4d8e-a727-856a959b464e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 200 len: 1363 microversion: 2.1 time: 0.180868 Sep 05 17:28:36.227623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1078/2310] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:36 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:36.653687 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-bfc25920-d430-4baa-bfd4-14503f9baf89 req-e01771c7-7384-4bbf-9ff3-65d01615373b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6615b39c-c510-4c9b-8e33-08a489f85ec5", "tag": "b928ce66-73e6-47fc-9a24-ccb86e20e2a4"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:28:36.663959 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-bfc25920-d430-4baa-bfd4-14503f9baf89 req-e01771c7-7384-4bbf-9ff3-65d01615373b service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:36.664464 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-bfc25920-d430-4baa-bfd4-14503f9baf89 req-e01771c7-7384-4bbf-9ff3-65d01615373b service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:36.664903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-bfc25920-d430-4baa-bfd4-14503f9baf89 req-e01771c7-7384-4bbf-9ff3-65d01615373b service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:36.676523 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-bfc25920-d430-4baa-bfd4-14503f9baf89 req-e01771c7-7384-4bbf-9ff3-65d01615373b service nova] Creating event network-changed:b928ce66-73e6-47fc-9a24-ccb86e20e2a4 for instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 on hv-cinder-85596 Sep 05 17:28:36.682150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-bfc25920-d430-4baa-bfd4-14503f9baf89 req-e01771c7-7384-4bbf-9ff3-65d01615373b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032274 Sep 05 17:28:36.682763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1233/2311] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:28:36.807239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-37934c56-a1e6-4800-b542-209795c7f098 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:36.807861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-37934c56-a1e6-4800-b542-209795c7f098 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:36.814713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37934c56-a1e6-4800-b542-209795c7f098 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:36.815182 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37934c56-a1e6-4800-b542-209795c7f098 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:36.815594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37934c56-a1e6-4800-b542-209795c7f098 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:36.816367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37934c56-a1e6-4800-b542-209795c7f098 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:36.816818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37934c56-a1e6-4800-b542-209795c7f098 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:36.817217 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37934c56-a1e6-4800-b542-209795c7f098 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:36.833038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:28:36.833253 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:28:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 (ip 10.222.0.23) !!! Sep 05 17:28:36.954747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-37934c56-a1e6-4800-b542-209795c7f098 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:36.963535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-37934c56-a1e6-4800-b542-209795c7f098 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.160287 Sep 05 17:28:36.964110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1079/2312] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:36 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:37.071988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-19a61edc-941e-46fc-8f18-a8b01a40a2b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:37.072871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-19a61edc-941e-46fc-8f18-a8b01a40a2b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:37.082135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19a61edc-941e-46fc-8f18-a8b01a40a2b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:37.082622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19a61edc-941e-46fc-8f18-a8b01a40a2b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:37.083058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19a61edc-941e-46fc-8f18-a8b01a40a2b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:37.083756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19a61edc-941e-46fc-8f18-a8b01a40a2b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:37.084232 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19a61edc-941e-46fc-8f18-a8b01a40a2b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:37.084661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19a61edc-941e-46fc-8f18-a8b01a40a2b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:37.228028 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-19a61edc-941e-46fc-8f18-a8b01a40a2b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:37.240551 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-19a61edc-941e-46fc-8f18-a8b01a40a2b8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.173778 Sep 05 17:28:37.241262 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1234/2313] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:37 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:37.252221 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-649ed964-39eb-4e08-bf0b-cd7e1d460d77 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:37.253062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-649ed964-39eb-4e08-bf0b-cd7e1d460d77 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:37.259580 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-649ed964-39eb-4e08-bf0b-cd7e1d460d77 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:37.260072 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-649ed964-39eb-4e08-bf0b-cd7e1d460d77 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:37.260538 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-649ed964-39eb-4e08-bf0b-cd7e1d460d77 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:37.261234 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-649ed964-39eb-4e08-bf0b-cd7e1d460d77 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:37.261687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-649ed964-39eb-4e08-bf0b-cd7e1d460d77 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:37.262109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-649ed964-39eb-4e08-bf0b-cd7e1d460d77 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:37.395400 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-649ed964-39eb-4e08-bf0b-cd7e1d460d77 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:37.403350 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-649ed964-39eb-4e08-bf0b-cd7e1d460d77 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 200 len: 1363 microversion: 2.1 time: 0.157055 Sep 05 17:28:37.403834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1080/2314] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:37 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:37.991992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3038b982-6250-4205-a59f-b2ad7cd1530a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:37.993034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3038b982-6250-4205-a59f-b2ad7cd1530a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:38.003612 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3038b982-6250-4205-a59f-b2ad7cd1530a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:38.004099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3038b982-6250-4205-a59f-b2ad7cd1530a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:38.004567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3038b982-6250-4205-a59f-b2ad7cd1530a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:38.005254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3038b982-6250-4205-a59f-b2ad7cd1530a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:38.005708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3038b982-6250-4205-a59f-b2ad7cd1530a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:38.006134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3038b982-6250-4205-a59f-b2ad7cd1530a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:38.146904 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3038b982-6250-4205-a59f-b2ad7cd1530a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:38.155748 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3038b982-6250-4205-a59f-b2ad7cd1530a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.170685 Sep 05 17:28:38.156361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1235/2315] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:37 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:38.270590 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-17cc291a-efea-4e98-a18b-99f618cd0166 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:38.271575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-17cc291a-efea-4e98-a18b-99f618cd0166 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:38.281822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17cc291a-efea-4e98-a18b-99f618cd0166 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:38.282566 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17cc291a-efea-4e98-a18b-99f618cd0166 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:38.283232 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17cc291a-efea-4e98-a18b-99f618cd0166 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:38.284373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17cc291a-efea-4e98-a18b-99f618cd0166 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:38.284953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17cc291a-efea-4e98-a18b-99f618cd0166 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:38.285468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-17cc291a-efea-4e98-a18b-99f618cd0166 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:38.420793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-17cc291a-efea-4e98-a18b-99f618cd0166 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:38.426642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d4c721ba-85b8-4423-a0ab-096d27c91418 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:38.427258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d4c721ba-85b8-4423-a0ab-096d27c91418 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:38.430218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-17cc291a-efea-4e98-a18b-99f618cd0166 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.165698 Sep 05 17:28:38.430837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1081/2316] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:38 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:38.433430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4c721ba-85b8-4423-a0ab-096d27c91418 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:38.433917 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4c721ba-85b8-4423-a0ab-096d27c91418 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:38.434369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4c721ba-85b8-4423-a0ab-096d27c91418 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:38.435054 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4c721ba-85b8-4423-a0ab-096d27c91418 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:38.435537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4c721ba-85b8-4423-a0ab-096d27c91418 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:38.435957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4c721ba-85b8-4423-a0ab-096d27c91418 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:38.569048 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d4c721ba-85b8-4423-a0ab-096d27c91418 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:38.576889 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d4c721ba-85b8-4423-a0ab-096d27c91418 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 200 len: 1363 microversion: 2.1 time: 0.154293 Sep 05 17:28:38.577441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1236/2317] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:38 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:39.181087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c3c88e12-1a06-4ed9-b5c3-ef595db89401 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:39.182641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c3c88e12-1a06-4ed9-b5c3-ef595db89401 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:39.189463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3c88e12-1a06-4ed9-b5c3-ef595db89401 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:39.189998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3c88e12-1a06-4ed9-b5c3-ef595db89401 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:39.190440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3c88e12-1a06-4ed9-b5c3-ef595db89401 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:39.191511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3c88e12-1a06-4ed9-b5c3-ef595db89401 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:39.192035 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3c88e12-1a06-4ed9-b5c3-ef595db89401 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:39.192533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3c88e12-1a06-4ed9-b5c3-ef595db89401 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:39.329458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c3c88e12-1a06-4ed9-b5c3-ef595db89401 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:39.338049 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c3c88e12-1a06-4ed9-b5c3-ef595db89401 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.161250 Sep 05 17:28:39.338653 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1082/2318] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:39 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:39.453668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d8cb80f1-284c-4a59-b202-15b3a04241a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:39.454575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d8cb80f1-284c-4a59-b202-15b3a04241a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:39.461616 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8cb80f1-284c-4a59-b202-15b3a04241a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:39.462106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8cb80f1-284c-4a59-b202-15b3a04241a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:39.462542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8cb80f1-284c-4a59-b202-15b3a04241a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:39.463240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8cb80f1-284c-4a59-b202-15b3a04241a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:39.463693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8cb80f1-284c-4a59-b202-15b3a04241a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:39.464118 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8cb80f1-284c-4a59-b202-15b3a04241a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:39.593625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d8cb80f1-284c-4a59-b202-15b3a04241a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:39.601093 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-80a1ccc6-2cef-4b41-b98e-2f021ff22f27 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:39.603362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d8cb80f1-284c-4a59-b202-15b3a04241a1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.153599 Sep 05 17:28:39.603576 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-80a1ccc6-2cef-4b41-b98e-2f021ff22f27 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:39.604259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1237/2319] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:39 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:39.621843 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80a1ccc6-2cef-4b41-b98e-2f021ff22f27 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:39.622344 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80a1ccc6-2cef-4b41-b98e-2f021ff22f27 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:39.622765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80a1ccc6-2cef-4b41-b98e-2f021ff22f27 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:39.623453 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80a1ccc6-2cef-4b41-b98e-2f021ff22f27 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:39.623898 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80a1ccc6-2cef-4b41-b98e-2f021ff22f27 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:39.624344 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80a1ccc6-2cef-4b41-b98e-2f021ff22f27 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:39.760679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-80a1ccc6-2cef-4b41-b98e-2f021ff22f27 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:39.772863 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-80a1ccc6-2cef-4b41-b98e-2f021ff22f27 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 200 len: 1363 microversion: 2.1 time: 0.175592 Sep 05 17:28:39.773732 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1083/2320] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:39 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:28:40.365904 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-928fab69-b934-45d9-b9a9-2cd27c511d74 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:40.366763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-928fab69-b934-45d9-b9a9-2cd27c511d74 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:40.374154 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-928fab69-b934-45d9-b9a9-2cd27c511d74 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:40.374705 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-928fab69-b934-45d9-b9a9-2cd27c511d74 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:40.375199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-928fab69-b934-45d9-b9a9-2cd27c511d74 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:40.376071 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-928fab69-b934-45d9-b9a9-2cd27c511d74 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:40.376405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-928fab69-b934-45d9-b9a9-2cd27c511d74 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:40.376849 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-928fab69-b934-45d9-b9a9-2cd27c511d74 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:40.512957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-928fab69-b934-45d9-b9a9-2cd27c511d74 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:40.521374 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-928fab69-b934-45d9-b9a9-2cd27c511d74 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.161746 Sep 05 17:28:40.521941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1238/2321] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:40 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:40.630270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a488e653-5600-42bf-89ba-bead77488e54 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:40.630870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a488e653-5600-42bf-89ba-bead77488e54 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:40.639812 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a488e653-5600-42bf-89ba-bead77488e54 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:40.640417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a488e653-5600-42bf-89ba-bead77488e54 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:40.640922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a488e653-5600-42bf-89ba-bead77488e54 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:40.641728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a488e653-5600-42bf-89ba-bead77488e54 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:40.642261 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a488e653-5600-42bf-89ba-bead77488e54 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:40.642787 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a488e653-5600-42bf-89ba-bead77488e54 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:40.773254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a488e653-5600-42bf-89ba-bead77488e54 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:40.781671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a488e653-5600-42bf-89ba-bead77488e54 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.157712 Sep 05 17:28:40.782665 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1084/2322] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:40 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:40.799596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3b5d80b1-ebd7-4dae-9e52-25a8491ab864 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:40.800368 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3b5d80b1-ebd7-4dae-9e52-25a8491ab864 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:40.806724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b5d80b1-ebd7-4dae-9e52-25a8491ab864 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:40.807336 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b5d80b1-ebd7-4dae-9e52-25a8491ab864 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:40.807768 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b5d80b1-ebd7-4dae-9e52-25a8491ab864 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:40.808504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b5d80b1-ebd7-4dae-9e52-25a8491ab864 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:40.808946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b5d80b1-ebd7-4dae-9e52-25a8491ab864 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:40.809360 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b5d80b1-ebd7-4dae-9e52-25a8491ab864 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:40.953633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3b5d80b1-ebd7-4dae-9e52-25a8491ab864 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:40.961923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3b5d80b1-ebd7-4dae-9e52-25a8491ab864 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 200 len: 1363 microversion: 2.1 time: 0.166261 Sep 05 17:28:40.962492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1239/2323] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:40 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:41.549216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-59f93a38-471d-4682-a2e1-f635b8350f4f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:41.550349 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-59f93a38-471d-4682-a2e1-f635b8350f4f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:41.556896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59f93a38-471d-4682-a2e1-f635b8350f4f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:41.557378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59f93a38-471d-4682-a2e1-f635b8350f4f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:41.557805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59f93a38-471d-4682-a2e1-f635b8350f4f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:41.558491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59f93a38-471d-4682-a2e1-f635b8350f4f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:41.558938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59f93a38-471d-4682-a2e1-f635b8350f4f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:41.559362 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59f93a38-471d-4682-a2e1-f635b8350f4f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:41.691066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-59f93a38-471d-4682-a2e1-f635b8350f4f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:41.699938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-59f93a38-471d-4682-a2e1-f635b8350f4f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.157359 Sep 05 17:28:41.700549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1085/2324] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:41 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:41.810402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9b0a68e3-d9ff-49ca-9ef3-36bfe6dffeed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:41.811345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9b0a68e3-d9ff-49ca-9ef3-36bfe6dffeed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:41.819820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b0a68e3-d9ff-49ca-9ef3-36bfe6dffeed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:41.820328 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b0a68e3-d9ff-49ca-9ef3-36bfe6dffeed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:41.820755 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b0a68e3-d9ff-49ca-9ef3-36bfe6dffeed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:41.821434 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b0a68e3-d9ff-49ca-9ef3-36bfe6dffeed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:41.821877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b0a68e3-d9ff-49ca-9ef3-36bfe6dffeed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:41.822287 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b0a68e3-d9ff-49ca-9ef3-36bfe6dffeed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:41.957675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9b0a68e3-d9ff-49ca-9ef3-36bfe6dffeed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:41.966808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9b0a68e3-d9ff-49ca-9ef3-36bfe6dffeed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.163177 Sep 05 17:28:41.967397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1240/2325] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:41 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:41.985455 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-74c263dd-c4b2-47d9-b3e2-432ea191056e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:41.986152 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-74c263dd-c4b2-47d9-b3e2-432ea191056e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:41.992908 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74c263dd-c4b2-47d9-b3e2-432ea191056e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:41.993511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74c263dd-c4b2-47d9-b3e2-432ea191056e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:41.993996 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74c263dd-c4b2-47d9-b3e2-432ea191056e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:41.994782 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74c263dd-c4b2-47d9-b3e2-432ea191056e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:41.995239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74c263dd-c4b2-47d9-b3e2-432ea191056e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:41.995661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74c263dd-c4b2-47d9-b3e2-432ea191056e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:42.125971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-d510e324-6e95-4c91-b864-e742d96253c2 req-77f7be9c-68dd-491e-9f02-e610c2acbdb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6615b39c-c510-4c9b-8e33-08a489f85ec5", "name": "network-vif-plugged", "status": "completed", "tag": "b928ce66-73e6-47fc-9a24-ccb86e20e2a4"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:28:42.127210 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-74c263dd-c4b2-47d9-b3e2-432ea191056e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:42.136295 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-d510e324-6e95-4c91-b864-e742d96253c2 req-77f7be9c-68dd-491e-9f02-e610c2acbdb9 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:42.136613 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-74c263dd-c4b2-47d9-b3e2-432ea191056e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 200 len: 1363 microversion: 2.1 time: 0.154884 Sep 05 17:28:42.136835 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-d510e324-6e95-4c91-b864-e742d96253c2 req-77f7be9c-68dd-491e-9f02-e610c2acbdb9 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:42.137215 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1086/2326] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:41 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:42.137375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-d510e324-6e95-4c91-b864-e742d96253c2 req-77f7be9c-68dd-491e-9f02-e610c2acbdb9 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:42.152133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-d510e324-6e95-4c91-b864-e742d96253c2 req-77f7be9c-68dd-491e-9f02-e610c2acbdb9 service nova] Creating event network-vif-plugged:b928ce66-73e6-47fc-9a24-ccb86e20e2a4 for instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 on hv-cinder-85596 Sep 05 17:28:42.157486 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-d510e324-6e95-4c91-b864-e742d96253c2 req-77f7be9c-68dd-491e-9f02-e610c2acbdb9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035697 Sep 05 17:28:42.158089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1241/2327] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:28:42.727506 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-45c205fb-c11b-4340-9b05-f610e5916d07 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:42.728284 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-45c205fb-c11b-4340-9b05-f610e5916d07 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:42.737291 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-45c205fb-c11b-4340-9b05-f610e5916d07 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:42.739618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-45c205fb-c11b-4340-9b05-f610e5916d07 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:42.740225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-45c205fb-c11b-4340-9b05-f610e5916d07 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:42.741166 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-45c205fb-c11b-4340-9b05-f610e5916d07 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:42.741768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-45c205fb-c11b-4340-9b05-f610e5916d07 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:42.742330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-45c205fb-c11b-4340-9b05-f610e5916d07 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:42.882242 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-45c205fb-c11b-4340-9b05-f610e5916d07 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:42.891440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-45c205fb-c11b-4340-9b05-f610e5916d07 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.170079 Sep 05 17:28:42.892009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1087/2328] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:42 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:42.991982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4028973e-fe57-4167-b55f-5ffcef9e79da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:42.992722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4028973e-fe57-4167-b55f-5ffcef9e79da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:42.999194 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4028973e-fe57-4167-b55f-5ffcef9e79da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:42.999706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4028973e-fe57-4167-b55f-5ffcef9e79da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:43.000136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4028973e-fe57-4167-b55f-5ffcef9e79da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:43.000857 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4028973e-fe57-4167-b55f-5ffcef9e79da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:43.001310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4028973e-fe57-4167-b55f-5ffcef9e79da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:43.001728 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4028973e-fe57-4167-b55f-5ffcef9e79da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:43.137656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4028973e-fe57-4167-b55f-5ffcef9e79da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:43.146084 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4028973e-fe57-4167-b55f-5ffcef9e79da tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.159259 Sep 05 17:28:43.146702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1242/2329] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:42 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:43.158981 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-88c69f36-6ca8-43c5-a4d2-427b56043fae tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:43.159760 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-88c69f36-6ca8-43c5-a4d2-427b56043fae tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:43.166720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88c69f36-6ca8-43c5-a4d2-427b56043fae tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:43.167206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88c69f36-6ca8-43c5-a4d2-427b56043fae tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:43.167638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88c69f36-6ca8-43c5-a4d2-427b56043fae tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:43.168367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88c69f36-6ca8-43c5-a4d2-427b56043fae tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:43.168819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88c69f36-6ca8-43c5-a4d2-427b56043fae tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:43.169243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-88c69f36-6ca8-43c5-a4d2-427b56043fae tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:43.186328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:28:43.315334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-88c69f36-6ca8-43c5-a4d2-427b56043fae tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:43.323862 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-88c69f36-6ca8-43c5-a4d2-427b56043fae tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 200 len: 1363 microversion: 2.1 time: 0.168805 Sep 05 17:28:43.324480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1088/2330] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:43 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:43.920941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ec94f237-55af-4d5c-9ef4-7f08f67a5cea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:43.921903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ec94f237-55af-4d5c-9ef4-7f08f67a5cea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:43.925173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:28:43.926346 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=6 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:28:43.933404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec94f237-55af-4d5c-9ef4-7f08f67a5cea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:43.933869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec94f237-55af-4d5c-9ef4-7f08f67a5cea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:43.934319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec94f237-55af-4d5c-9ef4-7f08f67a5cea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:43.935096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec94f237-55af-4d5c-9ef4-7f08f67a5cea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:43.935572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec94f237-55af-4d5c-9ef4-7f08f67a5cea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:43.936609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec94f237-55af-4d5c-9ef4-7f08f67a5cea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:44.073550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ec94f237-55af-4d5c-9ef4-7f08f67a5cea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:44.076427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:28:44.086765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ec94f237-55af-4d5c-9ef4-7f08f67a5cea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.173425 Sep 05 17:28:44.087476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1243/2331] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:43 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:44.173698 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-74d7458a-af9f-4cb4-a252-5dec7aba0cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:44.174544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-74d7458a-af9f-4cb4-a252-5dec7aba0cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:44.177757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=6 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:28:44.187892 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74d7458a-af9f-4cb4-a252-5dec7aba0cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:44.188887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74d7458a-af9f-4cb4-a252-5dec7aba0cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:44.189505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74d7458a-af9f-4cb4-a252-5dec7aba0cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:44.190828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74d7458a-af9f-4cb4-a252-5dec7aba0cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:44.191501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74d7458a-af9f-4cb4-a252-5dec7aba0cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:44.191849 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74d7458a-af9f-4cb4-a252-5dec7aba0cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:44.321712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-74d7458a-af9f-4cb4-a252-5dec7aba0cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:44.333849 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-74d7458a-af9f-4cb4-a252-5dec7aba0cfa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.166995 Sep 05 17:28:44.334416 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1089/2332] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:44 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:44.348832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3b2d5344-ea0e-48be-a92f-9e310bc085ce tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:44.350120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3b2d5344-ea0e-48be-a92f-9e310bc085ce tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:44.356754 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b2d5344-ea0e-48be-a92f-9e310bc085ce tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:44.357338 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b2d5344-ea0e-48be-a92f-9e310bc085ce tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:44.357848 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b2d5344-ea0e-48be-a92f-9e310bc085ce tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:44.358594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b2d5344-ea0e-48be-a92f-9e310bc085ce tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:44.359276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b2d5344-ea0e-48be-a92f-9e310bc085ce tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:44.359930 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b2d5344-ea0e-48be-a92f-9e310bc085ce tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:44.491162 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3b2d5344-ea0e-48be-a92f-9e310bc085ce tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:44.499135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3b2d5344-ea0e-48be-a92f-9e310bc085ce tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 200 len: 1548 microversion: 2.1 time: 0.155774 Sep 05 17:28:44.499698 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1244/2333] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:44 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:44.521724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e8b4d85f-dd63-4a15-9f0c-80a7fb69fd5c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:44.522203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e8b4d85f-dd63-4a15-9f0c-80a7fb69fd5c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:44.528426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8b4d85f-dd63-4a15-9f0c-80a7fb69fd5c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:44.528911 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8b4d85f-dd63-4a15-9f0c-80a7fb69fd5c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:44.529326 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8b4d85f-dd63-4a15-9f0c-80a7fb69fd5c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:44.530004 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8b4d85f-dd63-4a15-9f0c-80a7fb69fd5c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:44.530447 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8b4d85f-dd63-4a15-9f0c-80a7fb69fd5c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:44.530861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8b4d85f-dd63-4a15-9f0c-80a7fb69fd5c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:44.610156 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e8b4d85f-dd63-4a15-9f0c-80a7fb69fd5c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092497 Sep 05 17:28:44.610754 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1090/2334] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Sep 5 17:28:44 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:28:45.114842 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-169f617e-d365-4c11-86eb-b077d6ba3848 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:45.115510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-169f617e-d365-4c11-86eb-b077d6ba3848 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:45.122296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-169f617e-d365-4c11-86eb-b077d6ba3848 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:45.122794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-169f617e-d365-4c11-86eb-b077d6ba3848 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:45.123191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-169f617e-d365-4c11-86eb-b077d6ba3848 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:45.123880 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-169f617e-d365-4c11-86eb-b077d6ba3848 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:45.124378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-169f617e-d365-4c11-86eb-b077d6ba3848 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:45.124757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-169f617e-d365-4c11-86eb-b077d6ba3848 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:45.351415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-169f617e-d365-4c11-86eb-b077d6ba3848 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:45.358857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0f316d10-be34-4ed5-a9e1-a0dea73f641b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:45.359555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0f316d10-be34-4ed5-a9e1-a0dea73f641b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:45.360070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-169f617e-d365-4c11-86eb-b077d6ba3848 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.249796 Sep 05 17:28:45.360894 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1245/2335] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:45 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:45.366107 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f316d10-be34-4ed5-a9e1-a0dea73f641b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:45.366592 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f316d10-be34-4ed5-a9e1-a0dea73f641b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:45.367021 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f316d10-be34-4ed5-a9e1-a0dea73f641b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:45.367710 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f316d10-be34-4ed5-a9e1-a0dea73f641b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:45.368185 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f316d10-be34-4ed5-a9e1-a0dea73f641b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:45.368607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0f316d10-be34-4ed5-a9e1-a0dea73f641b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:45.816908 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0f316d10-be34-4ed5-a9e1-a0dea73f641b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:45.825729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0f316d10-be34-4ed5-a9e1-a0dea73f641b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.471465 Sep 05 17:28:45.826330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1091/2336] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:45 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:45.964847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-1f32b9c0-24e2-4bce-b37f-abae4262a4f6 req-50791c70-f3c5-4c12-bc9c-47b88454e64d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6615b39c-c510-4c9b-8e33-08a489f85ec5", "tag": "b928ce66-73e6-47fc-9a24-ccb86e20e2a4"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:28:45.974896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-1f32b9c0-24e2-4bce-b37f-abae4262a4f6 req-50791c70-f3c5-4c12-bc9c-47b88454e64d service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:45.975337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-1f32b9c0-24e2-4bce-b37f-abae4262a4f6 req-50791c70-f3c5-4c12-bc9c-47b88454e64d service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:45.975765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-1f32b9c0-24e2-4bce-b37f-abae4262a4f6 req-50791c70-f3c5-4c12-bc9c-47b88454e64d service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:45.986679 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-1f32b9c0-24e2-4bce-b37f-abae4262a4f6 req-50791c70-f3c5-4c12-bc9c-47b88454e64d service nova] Creating event network-changed:b928ce66-73e6-47fc-9a24-ccb86e20e2a4 for instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 on hv-cinder-85596 Sep 05 17:28:45.992177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-1f32b9c0-24e2-4bce-b37f-abae4262a4f6 req-50791c70-f3c5-4c12-bc9c-47b88454e64d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031026 Sep 05 17:28:45.992958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1246/2337] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:28:46.386077 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3dfe8a23-83ef-422c-9129-144107742c06 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:46.386791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3dfe8a23-83ef-422c-9129-144107742c06 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:46.394160 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dfe8a23-83ef-422c-9129-144107742c06 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:46.394980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dfe8a23-83ef-422c-9129-144107742c06 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:46.395491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dfe8a23-83ef-422c-9129-144107742c06 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:46.396313 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dfe8a23-83ef-422c-9129-144107742c06 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:46.396806 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dfe8a23-83ef-422c-9129-144107742c06 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:46.397464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dfe8a23-83ef-422c-9129-144107742c06 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:46.540073 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3dfe8a23-83ef-422c-9129-144107742c06 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:46.549097 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3dfe8a23-83ef-422c-9129-144107742c06 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.168496 Sep 05 17:28:46.549887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1092/2338] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:46 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:46.850983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-49dfcf4a-f405-4804-9748-ce5ba2170a58 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:46.851693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-49dfcf4a-f405-4804-9748-ce5ba2170a58 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:46.858858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49dfcf4a-f405-4804-9748-ce5ba2170a58 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:46.859349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49dfcf4a-f405-4804-9748-ce5ba2170a58 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:46.859797 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49dfcf4a-f405-4804-9748-ce5ba2170a58 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:46.860545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49dfcf4a-f405-4804-9748-ce5ba2170a58 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:46.860998 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49dfcf4a-f405-4804-9748-ce5ba2170a58 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:46.861426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49dfcf4a-f405-4804-9748-ce5ba2170a58 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:46.997050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-49dfcf4a-f405-4804-9748-ce5ba2170a58 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:47.005809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-49dfcf4a-f405-4804-9748-ce5ba2170a58 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.159100 Sep 05 17:28:47.006400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1247/2339] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:46 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:47.576588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-02c72496-affd-46f3-a4db-f76e56c3b761 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:47.577539 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-02c72496-affd-46f3-a4db-f76e56c3b761 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:47.586579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02c72496-affd-46f3-a4db-f76e56c3b761 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:47.587063 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02c72496-affd-46f3-a4db-f76e56c3b761 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:47.587626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02c72496-affd-46f3-a4db-f76e56c3b761 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:47.588409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02c72496-affd-46f3-a4db-f76e56c3b761 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:47.588811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02c72496-affd-46f3-a4db-f76e56c3b761 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:47.589246 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-02c72496-affd-46f3-a4db-f76e56c3b761 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:47.722025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-02c72496-affd-46f3-a4db-f76e56c3b761 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:47.731836 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-02c72496-affd-46f3-a4db-f76e56c3b761 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.161829 Sep 05 17:28:47.732449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1093/2340] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:47 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:48.029339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8c04f875-654b-4e97-9ab6-655aadd48336 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:48.029958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8c04f875-654b-4e97-9ab6-655aadd48336 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:48.037194 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c04f875-654b-4e97-9ab6-655aadd48336 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:48.037670 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c04f875-654b-4e97-9ab6-655aadd48336 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:48.038094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c04f875-654b-4e97-9ab6-655aadd48336 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:48.038785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c04f875-654b-4e97-9ab6-655aadd48336 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:48.039233 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c04f875-654b-4e97-9ab6-655aadd48336 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:48.039648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c04f875-654b-4e97-9ab6-655aadd48336 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:48.176589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8c04f875-654b-4e97-9ab6-655aadd48336 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:48.185149 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8c04f875-654b-4e97-9ab6-655aadd48336 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.159744 Sep 05 17:28:48.185722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1248/2341] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:48 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:48.758280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-23c6994a-4ef9-4b41-afc5-7862c103faf6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:48.758913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-23c6994a-4ef9-4b41-afc5-7862c103faf6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:48.765711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23c6994a-4ef9-4b41-afc5-7862c103faf6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:48.766212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23c6994a-4ef9-4b41-afc5-7862c103faf6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:48.766643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23c6994a-4ef9-4b41-afc5-7862c103faf6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:48.767331 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23c6994a-4ef9-4b41-afc5-7862c103faf6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:48.767788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23c6994a-4ef9-4b41-afc5-7862c103faf6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:48.768213 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23c6994a-4ef9-4b41-afc5-7862c103faf6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:48.897555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-23c6994a-4ef9-4b41-afc5-7862c103faf6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:48.906389 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-23c6994a-4ef9-4b41-afc5-7862c103faf6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.153651 Sep 05 17:28:48.906959 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1094/2342] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:48 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:49.210528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-994b795c-e488-4358-be94-c492944fbc8f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:49.211185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-994b795c-e488-4358-be94-c492944fbc8f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:49.218320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-994b795c-e488-4358-be94-c492944fbc8f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:49.218804 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-994b795c-e488-4358-be94-c492944fbc8f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:49.219235 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-994b795c-e488-4358-be94-c492944fbc8f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:49.219923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-994b795c-e488-4358-be94-c492944fbc8f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:49.220405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-994b795c-e488-4358-be94-c492944fbc8f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:49.220823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-994b795c-e488-4358-be94-c492944fbc8f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:49.361064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-994b795c-e488-4358-be94-c492944fbc8f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:49.371340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-994b795c-e488-4358-be94-c492944fbc8f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.165887 Sep 05 17:28:49.371945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1249/2343] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:49 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:49.934311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e7a222d7-6f46-458a-b392-d066de397ff2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:49.935282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e7a222d7-6f46-458a-b392-d066de397ff2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:49.945346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e7a222d7-6f46-458a-b392-d066de397ff2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:49.945828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e7a222d7-6f46-458a-b392-d066de397ff2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:49.946250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e7a222d7-6f46-458a-b392-d066de397ff2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:49.946931 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e7a222d7-6f46-458a-b392-d066de397ff2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:49.947354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e7a222d7-6f46-458a-b392-d066de397ff2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:49.947791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e7a222d7-6f46-458a-b392-d066de397ff2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:50.085724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e7a222d7-6f46-458a-b392-d066de397ff2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:50.094438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e7a222d7-6f46-458a-b392-d066de397ff2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.166758 Sep 05 17:28:50.095028 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1095/2344] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:49 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:50.398477 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2ad93e46-2bec-4147-88d1-a83aa5e358b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:50.399086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2ad93e46-2bec-4147-88d1-a83aa5e358b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:50.406013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ad93e46-2bec-4147-88d1-a83aa5e358b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:50.406510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ad93e46-2bec-4147-88d1-a83aa5e358b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:50.406918 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ad93e46-2bec-4147-88d1-a83aa5e358b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:50.407629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ad93e46-2bec-4147-88d1-a83aa5e358b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:50.408103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ad93e46-2bec-4147-88d1-a83aa5e358b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:50.408587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ad93e46-2bec-4147-88d1-a83aa5e358b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:50.547388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2ad93e46-2bec-4147-88d1-a83aa5e358b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:50.556461 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2ad93e46-2bec-4147-88d1-a83aa5e358b3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.163612 Sep 05 17:28:50.557015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1250/2345] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:50 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:51.122242 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b2d035ff-f4c6-4ea0-b46f-89a59637b08e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:51.123225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b2d035ff-f4c6-4ea0-b46f-89a59637b08e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:51.134215 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b2d035ff-f4c6-4ea0-b46f-89a59637b08e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:51.135014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b2d035ff-f4c6-4ea0-b46f-89a59637b08e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:51.135725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b2d035ff-f4c6-4ea0-b46f-89a59637b08e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:51.136906 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b2d035ff-f4c6-4ea0-b46f-89a59637b08e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:51.137658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b2d035ff-f4c6-4ea0-b46f-89a59637b08e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:51.138357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b2d035ff-f4c6-4ea0-b46f-89a59637b08e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:51.278325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b2d035ff-f4c6-4ea0-b46f-89a59637b08e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:51.287020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b2d035ff-f4c6-4ea0-b46f-89a59637b08e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.171457 Sep 05 17:28:51.287665 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1096/2346] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:51 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:51.583258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-649a5027-3be2-4326-8773-17a5d8a7822d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:51.584324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-649a5027-3be2-4326-8773-17a5d8a7822d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:51.595747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-649a5027-3be2-4326-8773-17a5d8a7822d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:51.596618 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-649a5027-3be2-4326-8773-17a5d8a7822d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:51.597347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-649a5027-3be2-4326-8773-17a5d8a7822d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:51.598492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-649a5027-3be2-4326-8773-17a5d8a7822d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:51.599328 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-649a5027-3be2-4326-8773-17a5d8a7822d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:51.599772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-649a5027-3be2-4326-8773-17a5d8a7822d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:51.740355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-649a5027-3be2-4326-8773-17a5d8a7822d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:51.749588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-649a5027-3be2-4326-8773-17a5d8a7822d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.172817 Sep 05 17:28:51.750171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1251/2347] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:51 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:52.314157 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0ebfbec4-a9fe-4aa5-996f-2a5f0dab61f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:52.315113 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0ebfbec4-a9fe-4aa5-996f-2a5f0dab61f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:52.323466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ebfbec4-a9fe-4aa5-996f-2a5f0dab61f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:52.323953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ebfbec4-a9fe-4aa5-996f-2a5f0dab61f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:52.324488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ebfbec4-a9fe-4aa5-996f-2a5f0dab61f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:52.325117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ebfbec4-a9fe-4aa5-996f-2a5f0dab61f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:52.325600 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ebfbec4-a9fe-4aa5-996f-2a5f0dab61f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:52.326024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0ebfbec4-a9fe-4aa5-996f-2a5f0dab61f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:52.465391 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0ebfbec4-a9fe-4aa5-996f-2a5f0dab61f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:52.474391 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0ebfbec4-a9fe-4aa5-996f-2a5f0dab61f6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.166882 Sep 05 17:28:52.475027 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1097/2348] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:52 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:52.776973 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-38ef22d3-28cb-4b5f-8b15-be672adcb386 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:52.777734 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-38ef22d3-28cb-4b5f-8b15-be672adcb386 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:52.786680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38ef22d3-28cb-4b5f-8b15-be672adcb386 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:52.787915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38ef22d3-28cb-4b5f-8b15-be672adcb386 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:52.788555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38ef22d3-28cb-4b5f-8b15-be672adcb386 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:52.789469 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38ef22d3-28cb-4b5f-8b15-be672adcb386 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:52.790071 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38ef22d3-28cb-4b5f-8b15-be672adcb386 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:52.790629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38ef22d3-28cb-4b5f-8b15-be672adcb386 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:52.927666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-38ef22d3-28cb-4b5f-8b15-be672adcb386 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:52.940946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-38ef22d3-28cb-4b5f-8b15-be672adcb386 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.169902 Sep 05 17:28:52.941800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1252/2349] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:52 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:53.502683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4dd2dcd0-7967-467a-80f7-5b7937c29b76 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:53.503699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4dd2dcd0-7967-467a-80f7-5b7937c29b76 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:53.514509 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4dd2dcd0-7967-467a-80f7-5b7937c29b76 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:53.515304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4dd2dcd0-7967-467a-80f7-5b7937c29b76 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:53.516011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4dd2dcd0-7967-467a-80f7-5b7937c29b76 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:53.517177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4dd2dcd0-7967-467a-80f7-5b7937c29b76 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:53.517914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4dd2dcd0-7967-467a-80f7-5b7937c29b76 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:53.518606 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4dd2dcd0-7967-467a-80f7-5b7937c29b76 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:53.660817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4dd2dcd0-7967-467a-80f7-5b7937c29b76 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:53.669620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4dd2dcd0-7967-467a-80f7-5b7937c29b76 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.173502 Sep 05 17:28:53.670169 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1098/2350] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:53 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:53.968419 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6f9f0ceb-c6bc-42ac-afd9-76bf5bf75cf9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:53.969158 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6f9f0ceb-c6bc-42ac-afd9-76bf5bf75cf9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:53.978566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f9f0ceb-c6bc-42ac-afd9-76bf5bf75cf9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:53.979187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f9f0ceb-c6bc-42ac-afd9-76bf5bf75cf9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:53.979750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f9f0ceb-c6bc-42ac-afd9-76bf5bf75cf9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:53.980702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f9f0ceb-c6bc-42ac-afd9-76bf5bf75cf9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:53.981294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f9f0ceb-c6bc-42ac-afd9-76bf5bf75cf9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:53.981843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f9f0ceb-c6bc-42ac-afd9-76bf5bf75cf9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:54.125626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6f9f0ceb-c6bc-42ac-afd9-76bf5bf75cf9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:54.138234 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6f9f0ceb-c6bc-42ac-afd9-76bf5bf75cf9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.175343 Sep 05 17:28:54.138987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1253/2351] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:53 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:54.697603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2b55a9b9-ee43-4563-9177-d0f66e63ad5e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:54.698216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2b55a9b9-ee43-4563-9177-d0f66e63ad5e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:54.705911 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b55a9b9-ee43-4563-9177-d0f66e63ad5e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:54.706446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b55a9b9-ee43-4563-9177-d0f66e63ad5e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:54.706921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b55a9b9-ee43-4563-9177-d0f66e63ad5e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:54.707684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b55a9b9-ee43-4563-9177-d0f66e63ad5e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:54.708199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b55a9b9-ee43-4563-9177-d0f66e63ad5e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:54.708675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2b55a9b9-ee43-4563-9177-d0f66e63ad5e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:54.846021 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2b55a9b9-ee43-4563-9177-d0f66e63ad5e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:54.859761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2b55a9b9-ee43-4563-9177-d0f66e63ad5e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.168691 Sep 05 17:28:54.860560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1099/2352] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:54 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:55.167590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a2707ff7-1376-467e-9ba3-2bb53cb708dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:55.168245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a2707ff7-1376-467e-9ba3-2bb53cb708dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:55.175989 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2707ff7-1376-467e-9ba3-2bb53cb708dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:55.176647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2707ff7-1376-467e-9ba3-2bb53cb708dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:55.177129 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2707ff7-1376-467e-9ba3-2bb53cb708dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:55.177891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2707ff7-1376-467e-9ba3-2bb53cb708dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:55.178383 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2707ff7-1376-467e-9ba3-2bb53cb708dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:55.178847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2707ff7-1376-467e-9ba3-2bb53cb708dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:55.317206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a2707ff7-1376-467e-9ba3-2bb53cb708dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:55.326239 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a2707ff7-1376-467e-9ba3-2bb53cb708dc tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.163594 Sep 05 17:28:55.326855 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1254/2353] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:55 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:55.887906 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8debd159-c971-428e-aeae-35c57021eab6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:55.888625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8debd159-c971-428e-aeae-35c57021eab6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:55.896283 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8debd159-c971-428e-aeae-35c57021eab6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:55.896816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8debd159-c971-428e-aeae-35c57021eab6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:55.897291 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8debd159-c971-428e-aeae-35c57021eab6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:55.898060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8debd159-c971-428e-aeae-35c57021eab6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:55.898669 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8debd159-c971-428e-aeae-35c57021eab6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:55.899196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8debd159-c971-428e-aeae-35c57021eab6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:56.043117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8debd159-c971-428e-aeae-35c57021eab6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:56.051395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8debd159-c971-428e-aeae-35c57021eab6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.168150 Sep 05 17:28:56.051966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1100/2354] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:55 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:56.352176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cdf03518-f6ea-4cd9-b5ea-b20c0b0a1dbe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:56.352992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cdf03518-f6ea-4cd9-b5ea-b20c0b0a1dbe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:56.361890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdf03518-f6ea-4cd9-b5ea-b20c0b0a1dbe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:56.362523 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdf03518-f6ea-4cd9-b5ea-b20c0b0a1dbe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:56.363132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdf03518-f6ea-4cd9-b5ea-b20c0b0a1dbe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:56.364038 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdf03518-f6ea-4cd9-b5ea-b20c0b0a1dbe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:56.364673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdf03518-f6ea-4cd9-b5ea-b20c0b0a1dbe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:56.365255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdf03518-f6ea-4cd9-b5ea-b20c0b0a1dbe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:56.507476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cdf03518-f6ea-4cd9-b5ea-b20c0b0a1dbe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:56.519575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cdf03518-f6ea-4cd9-b5ea-b20c0b0a1dbe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.172712 Sep 05 17:28:56.520448 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1255/2355] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:56 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:57.079346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fb6bad4c-96c0-43ac-ae07-082dc419f096 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:57.080672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fb6bad4c-96c0-43ac-ae07-082dc419f096 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:57.089903 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb6bad4c-96c0-43ac-ae07-082dc419f096 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:57.090410 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb6bad4c-96c0-43ac-ae07-082dc419f096 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:57.091185 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb6bad4c-96c0-43ac-ae07-082dc419f096 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:57.091865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb6bad4c-96c0-43ac-ae07-082dc419f096 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:57.092348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb6bad4c-96c0-43ac-ae07-082dc419f096 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:57.092765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fb6bad4c-96c0-43ac-ae07-082dc419f096 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:57.231713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fb6bad4c-96c0-43ac-ae07-082dc419f096 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:57.240478 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fb6bad4c-96c0-43ac-ae07-082dc419f096 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.168129 Sep 05 17:28:57.241055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1101/2356] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:57 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:57.548636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6dd6ec87-2fd2-4a0d-8548-295e39c32dd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:57.549684 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6dd6ec87-2fd2-4a0d-8548-295e39c32dd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:57.561560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd6ec87-2fd2-4a0d-8548-295e39c32dd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:57.562360 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd6ec87-2fd2-4a0d-8548-295e39c32dd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:57.563078 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd6ec87-2fd2-4a0d-8548-295e39c32dd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:57.564240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd6ec87-2fd2-4a0d-8548-295e39c32dd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:57.565032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd6ec87-2fd2-4a0d-8548-295e39c32dd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:57.565745 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd6ec87-2fd2-4a0d-8548-295e39c32dd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:57.708139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6dd6ec87-2fd2-4a0d-8548-295e39c32dd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:57.718234 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6dd6ec87-2fd2-4a0d-8548-295e39c32dd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.176120 Sep 05 17:28:57.718819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1256/2357] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:57 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:58.266743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3dc25262-92e2-4c02-b831-d772d16f1bbf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:58.267711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3dc25262-92e2-4c02-b831-d772d16f1bbf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:58.278822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dc25262-92e2-4c02-b831-d772d16f1bbf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:58.279621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dc25262-92e2-4c02-b831-d772d16f1bbf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:58.280423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dc25262-92e2-4c02-b831-d772d16f1bbf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:58.281575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dc25262-92e2-4c02-b831-d772d16f1bbf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:58.282348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dc25262-92e2-4c02-b831-d772d16f1bbf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:58.282929 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3dc25262-92e2-4c02-b831-d772d16f1bbf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:58.425590 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3dc25262-92e2-4c02-b831-d772d16f1bbf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:58.438456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3dc25262-92e2-4c02-b831-d772d16f1bbf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.177936 Sep 05 17:28:58.439204 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1102/2358] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:58 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:58.744673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b4d1e8d1-e330-402f-84ce-551075fe49ca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:58.745420 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b4d1e8d1-e330-402f-84ce-551075fe49ca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:58.753305 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4d1e8d1-e330-402f-84ce-551075fe49ca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:58.753897 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4d1e8d1-e330-402f-84ce-551075fe49ca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:58.754424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4d1e8d1-e330-402f-84ce-551075fe49ca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:58.755269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4d1e8d1-e330-402f-84ce-551075fe49ca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:58.755820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4d1e8d1-e330-402f-84ce-551075fe49ca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:58.756370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4d1e8d1-e330-402f-84ce-551075fe49ca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:58.895200 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b4d1e8d1-e330-402f-84ce-551075fe49ca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:58.903872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b4d1e8d1-e330-402f-84ce-551075fe49ca tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.165552 Sep 05 17:28:58.904507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1257/2359] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:58 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:59.461870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a8ad03d4-ecd9-4bc4-9143-61ec8799e4e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:59.462425 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a8ad03d4-ecd9-4bc4-9143-61ec8799e4e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:59.465196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:28:59.470836 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8ad03d4-ecd9-4bc4-9143-61ec8799e4e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:59.471237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8ad03d4-ecd9-4bc4-9143-61ec8799e4e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:59.471641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8ad03d4-ecd9-4bc4-9143-61ec8799e4e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:59.472646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8ad03d4-ecd9-4bc4-9143-61ec8799e4e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:59.473098 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8ad03d4-ecd9-4bc4-9143-61ec8799e4e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:59.473510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8ad03d4-ecd9-4bc4-9143-61ec8799e4e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:59.612649 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a8ad03d4-ecd9-4bc4-9143-61ec8799e4e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:28:59.625162 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a8ad03d4-ecd9-4bc4-9143-61ec8799e4e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.166889 Sep 05 17:28:59.625791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1103/2360] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:59 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:28:59.931402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7a7acde6-effe-4ae3-885a-8d000ba6c43f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:28:59.932333 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7a7acde6-effe-4ae3-885a-8d000ba6c43f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:28:59.936080 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:28:59.945112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a7acde6-effe-4ae3-885a-8d000ba6c43f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:59.945902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a7acde6-effe-4ae3-885a-8d000ba6c43f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:59.946616 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a7acde6-effe-4ae3-885a-8d000ba6c43f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:28:59.947741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a7acde6-effe-4ae3-885a-8d000ba6c43f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:28:59.948635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a7acde6-effe-4ae3-885a-8d000ba6c43f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:28:59.949083 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a7acde6-effe-4ae3-885a-8d000ba6c43f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:00.085123 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7a7acde6-effe-4ae3-885a-8d000ba6c43f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:00.094049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7a7acde6-effe-4ae3-885a-8d000ba6c43f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.169352 Sep 05 17:29:00.094627 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1258/2361] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:28:59 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:00.655237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9d52b984-aa90-489d-b0fb-3ac28fecebe5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:00.655826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9d52b984-aa90-489d-b0fb-3ac28fecebe5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:00.666938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9d52b984-aa90-489d-b0fb-3ac28fecebe5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:00.667516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9d52b984-aa90-489d-b0fb-3ac28fecebe5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:00.668007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9d52b984-aa90-489d-b0fb-3ac28fecebe5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:00.668794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9d52b984-aa90-489d-b0fb-3ac28fecebe5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:00.669245 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9d52b984-aa90-489d-b0fb-3ac28fecebe5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:00.669670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9d52b984-aa90-489d-b0fb-3ac28fecebe5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:00.807812 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9d52b984-aa90-489d-b0fb-3ac28fecebe5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:00.816932 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9d52b984-aa90-489d-b0fb-3ac28fecebe5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.167460 Sep 05 17:29:00.817479 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1104/2362] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:00 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:01.117258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0f761a4e-af51-4a29-a213-0168518942fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:01.117868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0f761a4e-af51-4a29-a213-0168518942fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:01.125446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f761a4e-af51-4a29-a213-0168518942fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:01.125946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f761a4e-af51-4a29-a213-0168518942fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:01.126388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f761a4e-af51-4a29-a213-0168518942fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:01.127100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f761a4e-af51-4a29-a213-0168518942fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:01.127552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f761a4e-af51-4a29-a213-0168518942fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:01.127976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f761a4e-af51-4a29-a213-0168518942fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:01.269059 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0f761a4e-af51-4a29-a213-0168518942fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:01.278354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0f761a4e-af51-4a29-a213-0168518942fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.165006 Sep 05 17:29:01.279025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1259/2363] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:01 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:01.846142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-55396ff6-a854-4b12-b585-904dee2d8c4b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:01.847084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-55396ff6-a854-4b12-b585-904dee2d8c4b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:01.858066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55396ff6-a854-4b12-b585-904dee2d8c4b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:01.858893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55396ff6-a854-4b12-b585-904dee2d8c4b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:01.859572 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55396ff6-a854-4b12-b585-904dee2d8c4b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:01.860793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55396ff6-a854-4b12-b585-904dee2d8c4b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:01.861536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55396ff6-a854-4b12-b585-904dee2d8c4b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:01.862239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55396ff6-a854-4b12-b585-904dee2d8c4b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:01.880484 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:29:02.002086 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-55396ff6-a854-4b12-b585-904dee2d8c4b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:02.011109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-55396ff6-a854-4b12-b585-904dee2d8c4b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.172282 Sep 05 17:29:02.011587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1105/2364] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:01 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:02.306117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c07dffcc-7bea-4bb6-af3b-9a5616af2029 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:02.306717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c07dffcc-7bea-4bb6-af3b-9a5616af2029 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:02.314103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c07dffcc-7bea-4bb6-af3b-9a5616af2029 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:02.314587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c07dffcc-7bea-4bb6-af3b-9a5616af2029 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:02.315022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c07dffcc-7bea-4bb6-af3b-9a5616af2029 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:02.315707 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c07dffcc-7bea-4bb6-af3b-9a5616af2029 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:02.316187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c07dffcc-7bea-4bb6-af3b-9a5616af2029 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:02.316607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c07dffcc-7bea-4bb6-af3b-9a5616af2029 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:02.457952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c07dffcc-7bea-4bb6-af3b-9a5616af2029 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:02.468239 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c07dffcc-7bea-4bb6-af3b-9a5616af2029 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.169009 Sep 05 17:29:02.468826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1260/2365] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:02 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:03.038933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-23fd88c5-e9e3-4630-b739-0459b449e26f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:03.039861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-23fd88c5-e9e3-4630-b739-0459b449e26f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:03.051114 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23fd88c5-e9e3-4630-b739-0459b449e26f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:03.051912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23fd88c5-e9e3-4630-b739-0459b449e26f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:03.052674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23fd88c5-e9e3-4630-b739-0459b449e26f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:03.053814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23fd88c5-e9e3-4630-b739-0459b449e26f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:03.054557 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23fd88c5-e9e3-4630-b739-0459b449e26f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:03.055256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-23fd88c5-e9e3-4630-b739-0459b449e26f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:03.198313 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-23fd88c5-e9e3-4630-b739-0459b449e26f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:03.206828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-23fd88c5-e9e3-4630-b739-0459b449e26f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.174529 Sep 05 17:29:03.207392 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1106/2366] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:03 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:03.496977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6f3e8f5c-d275-4369-ba6e-0178cc738d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:03.497981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6f3e8f5c-d275-4369-ba6e-0178cc738d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:03.508904 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f3e8f5c-d275-4369-ba6e-0178cc738d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:03.509751 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f3e8f5c-d275-4369-ba6e-0178cc738d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:03.510505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f3e8f5c-d275-4369-ba6e-0178cc738d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:03.512114 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f3e8f5c-d275-4369-ba6e-0178cc738d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:03.512630 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f3e8f5c-d275-4369-ba6e-0178cc738d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:03.513056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f3e8f5c-d275-4369-ba6e-0178cc738d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:03.515614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:29:03.648795 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6f3e8f5c-d275-4369-ba6e-0178cc738d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:03.657998 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6f3e8f5c-d275-4369-ba6e-0178cc738d91 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.167837 Sep 05 17:29:03.658580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1261/2367] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:03 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:04.233885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-52b13db9-fb6e-4e22-981a-f76c400a2d46 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:04.234546 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-52b13db9-fb6e-4e22-981a-f76c400a2d46 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:04.241886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-52b13db9-fb6e-4e22-981a-f76c400a2d46 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:04.242394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-52b13db9-fb6e-4e22-981a-f76c400a2d46 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:04.242846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-52b13db9-fb6e-4e22-981a-f76c400a2d46 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:04.243570 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-52b13db9-fb6e-4e22-981a-f76c400a2d46 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:04.244044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-52b13db9-fb6e-4e22-981a-f76c400a2d46 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:04.244523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-52b13db9-fb6e-4e22-981a-f76c400a2d46 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:04.380242 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-52b13db9-fb6e-4e22-981a-f76c400a2d46 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:04.391050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-52b13db9-fb6e-4e22-981a-f76c400a2d46 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.163661 Sep 05 17:29:04.391619 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1107/2368] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:04 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:04.682247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-068d2ed2-e062-4c51-91cd-59083e0c76b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:04.682931 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-068d2ed2-e062-4c51-91cd-59083e0c76b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:04.690163 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-068d2ed2-e062-4c51-91cd-59083e0c76b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:04.690659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-068d2ed2-e062-4c51-91cd-59083e0c76b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:04.691093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-068d2ed2-e062-4c51-91cd-59083e0c76b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:04.691785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-068d2ed2-e062-4c51-91cd-59083e0c76b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:04.692239 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-068d2ed2-e062-4c51-91cd-59083e0c76b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:04.692699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-068d2ed2-e062-4c51-91cd-59083e0c76b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:04.841156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-068d2ed2-e062-4c51-91cd-59083e0c76b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:04.853714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-068d2ed2-e062-4c51-91cd-59083e0c76b7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.175159 Sep 05 17:29:04.854493 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1262/2369] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:04 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:05.414677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8c68a190-cabe-452f-b545-5c33d26da994 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:05.415294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8c68a190-cabe-452f-b545-5c33d26da994 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:05.422440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c68a190-cabe-452f-b545-5c33d26da994 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:05.422932 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c68a190-cabe-452f-b545-5c33d26da994 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:05.423365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c68a190-cabe-452f-b545-5c33d26da994 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:05.424059 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c68a190-cabe-452f-b545-5c33d26da994 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:05.424587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c68a190-cabe-452f-b545-5c33d26da994 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:05.425081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c68a190-cabe-452f-b545-5c33d26da994 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:05.563501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8c68a190-cabe-452f-b545-5c33d26da994 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:05.574991 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8c68a190-cabe-452f-b545-5c33d26da994 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.164274 Sep 05 17:29:05.575553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1108/2370] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:05 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:05.888356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c5366fc3-f099-494e-b2bc-4be8ddcac041 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:05.889005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c5366fc3-f099-494e-b2bc-4be8ddcac041 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:05.895935 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5366fc3-f099-494e-b2bc-4be8ddcac041 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:05.896466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5366fc3-f099-494e-b2bc-4be8ddcac041 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:05.896918 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5366fc3-f099-494e-b2bc-4be8ddcac041 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:05.897630 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5366fc3-f099-494e-b2bc-4be8ddcac041 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:05.898099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5366fc3-f099-494e-b2bc-4be8ddcac041 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:05.898531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5366fc3-f099-494e-b2bc-4be8ddcac041 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:06.041192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c5366fc3-f099-494e-b2bc-4be8ddcac041 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:06.055180 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c5366fc3-f099-494e-b2bc-4be8ddcac041 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.172240 Sep 05 17:29:06.055985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1263/2371] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:05 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:06.610488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e94970be-fe89-444d-a652-a225488e3fe8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:06.611205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e94970be-fe89-444d-a652-a225488e3fe8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:06.619416 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e94970be-fe89-444d-a652-a225488e3fe8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:06.619953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e94970be-fe89-444d-a652-a225488e3fe8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:06.620520 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e94970be-fe89-444d-a652-a225488e3fe8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:06.632263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e94970be-fe89-444d-a652-a225488e3fe8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:06.632263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e94970be-fe89-444d-a652-a225488e3fe8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:06.632263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e94970be-fe89-444d-a652-a225488e3fe8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:06.763244 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e94970be-fe89-444d-a652-a225488e3fe8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:06.772013 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e94970be-fe89-444d-a652-a225488e3fe8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.167665 Sep 05 17:29:06.772618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1109/2372] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:06 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:07.084046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-30a94912-7be2-4cb9-9883-bb8c9d57e863 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:07.085052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-30a94912-7be2-4cb9-9883-bb8c9d57e863 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:07.096975 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30a94912-7be2-4cb9-9883-bb8c9d57e863 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:07.097733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30a94912-7be2-4cb9-9883-bb8c9d57e863 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:07.098440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30a94912-7be2-4cb9-9883-bb8c9d57e863 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:07.099576 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30a94912-7be2-4cb9-9883-bb8c9d57e863 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:07.100364 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30a94912-7be2-4cb9-9883-bb8c9d57e863 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:07.101060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30a94912-7be2-4cb9-9883-bb8c9d57e863 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:07.237210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-30a94912-7be2-4cb9-9883-bb8c9d57e863 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:07.245792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-30a94912-7be2-4cb9-9883-bb8c9d57e863 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.168358 Sep 05 17:29:07.246363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1264/2373] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:07 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:07.798072 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-588b59d2-6ead-4a28-aa0d-9ad5dcc5a997 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:07.798806 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-588b59d2-6ead-4a28-aa0d-9ad5dcc5a997 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:07.807126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-588b59d2-6ead-4a28-aa0d-9ad5dcc5a997 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:07.807730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-588b59d2-6ead-4a28-aa0d-9ad5dcc5a997 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:07.808654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-588b59d2-6ead-4a28-aa0d-9ad5dcc5a997 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:07.809241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-588b59d2-6ead-4a28-aa0d-9ad5dcc5a997 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:07.809862 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-588b59d2-6ead-4a28-aa0d-9ad5dcc5a997 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:07.810416 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-588b59d2-6ead-4a28-aa0d-9ad5dcc5a997 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:07.957798 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-588b59d2-6ead-4a28-aa0d-9ad5dcc5a997 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:07.971481 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-588b59d2-6ead-4a28-aa0d-9ad5dcc5a997 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.178303 Sep 05 17:29:07.972430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1110/2374] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:07 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:08.273765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5b1cd3a5-a48a-4173-9498-93acc662c2c2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:08.274738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5b1cd3a5-a48a-4173-9498-93acc662c2c2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:08.282841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b1cd3a5-a48a-4173-9498-93acc662c2c2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:08.283317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b1cd3a5-a48a-4173-9498-93acc662c2c2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:08.283745 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b1cd3a5-a48a-4173-9498-93acc662c2c2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:08.284455 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b1cd3a5-a48a-4173-9498-93acc662c2c2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:08.284899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b1cd3a5-a48a-4173-9498-93acc662c2c2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:08.285315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b1cd3a5-a48a-4173-9498-93acc662c2c2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:08.421842 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5b1cd3a5-a48a-4173-9498-93acc662c2c2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:08.430757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5b1cd3a5-a48a-4173-9498-93acc662c2c2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.163549 Sep 05 17:29:08.431333 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1265/2375] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:08 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:08.999215 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4f510de0-33e3-461c-92ba-117498c3cc9d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:08.999864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4f510de0-33e3-461c-92ba-117498c3cc9d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:09.006434 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f510de0-33e3-461c-92ba-117498c3cc9d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:09.006908 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f510de0-33e3-461c-92ba-117498c3cc9d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:09.007331 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f510de0-33e3-461c-92ba-117498c3cc9d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:09.007999 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f510de0-33e3-461c-92ba-117498c3cc9d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:09.008467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f510de0-33e3-461c-92ba-117498c3cc9d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:09.008881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f510de0-33e3-461c-92ba-117498c3cc9d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:09.144466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4f510de0-33e3-461c-92ba-117498c3cc9d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:09.153276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4f510de0-33e3-461c-92ba-117498c3cc9d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.158560 Sep 05 17:29:09.153818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1111/2376] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:08 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:09.458312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5f1f747d-3595-4dea-80b0-ebca2afa99f8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:09.459307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5f1f747d-3595-4dea-80b0-ebca2afa99f8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:09.470980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f1f747d-3595-4dea-80b0-ebca2afa99f8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:09.471788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f1f747d-3595-4dea-80b0-ebca2afa99f8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:09.472596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f1f747d-3595-4dea-80b0-ebca2afa99f8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:09.473739 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f1f747d-3595-4dea-80b0-ebca2afa99f8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:09.474536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f1f747d-3595-4dea-80b0-ebca2afa99f8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:09.475242 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f1f747d-3595-4dea-80b0-ebca2afa99f8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:09.622862 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f1f747d-3595-4dea-80b0-ebca2afa99f8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:09.635632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5f1f747d-3595-4dea-80b0-ebca2afa99f8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.183672 Sep 05 17:29:09.636587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1266/2377] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:09 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:10.180748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-87225b99-92fa-42cc-8ae7-e6b66e51a589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:10.181746 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-87225b99-92fa-42cc-8ae7-e6b66e51a589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:10.193570 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87225b99-92fa-42cc-8ae7-e6b66e51a589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:10.194513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87225b99-92fa-42cc-8ae7-e6b66e51a589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:10.195572 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87225b99-92fa-42cc-8ae7-e6b66e51a589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:10.196621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87225b99-92fa-42cc-8ae7-e6b66e51a589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:10.197511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87225b99-92fa-42cc-8ae7-e6b66e51a589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:10.198211 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87225b99-92fa-42cc-8ae7-e6b66e51a589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:10.333150 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-87225b99-92fa-42cc-8ae7-e6b66e51a589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:10.344684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-87225b99-92fa-42cc-8ae7-e6b66e51a589 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.170279 Sep 05 17:29:10.345345 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1112/2378] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:10 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:10.669640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f3381b87-9499-45bc-b994-3960c5523597 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:10.670571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f3381b87-9499-45bc-b994-3960c5523597 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:10.681605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3381b87-9499-45bc-b994-3960c5523597 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:10.682393 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3381b87-9499-45bc-b994-3960c5523597 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:10.683068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3381b87-9499-45bc-b994-3960c5523597 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:10.683749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3381b87-9499-45bc-b994-3960c5523597 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:10.684189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3381b87-9499-45bc-b994-3960c5523597 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:10.684623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3381b87-9499-45bc-b994-3960c5523597 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:10.831957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f3381b87-9499-45bc-b994-3960c5523597 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:10.841208 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f3381b87-9499-45bc-b994-3960c5523597 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.178310 Sep 05 17:29:10.841802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1267/2379] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:10 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:11.373778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-87a58fdb-7e96-49d9-a70e-e6eef30aa001 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:11.374355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-87a58fdb-7e96-49d9-a70e-e6eef30aa001 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:11.381110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87a58fdb-7e96-49d9-a70e-e6eef30aa001 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:11.381596 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87a58fdb-7e96-49d9-a70e-e6eef30aa001 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:11.382027 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87a58fdb-7e96-49d9-a70e-e6eef30aa001 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:11.382724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87a58fdb-7e96-49d9-a70e-e6eef30aa001 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:11.383176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87a58fdb-7e96-49d9-a70e-e6eef30aa001 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:11.383602 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87a58fdb-7e96-49d9-a70e-e6eef30aa001 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:11.517010 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-87a58fdb-7e96-49d9-a70e-e6eef30aa001 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:11.525665 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-87a58fdb-7e96-49d9-a70e-e6eef30aa001 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.156895 Sep 05 17:29:11.526216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1113/2380] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:11 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:11.865032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1af3ccad-41d6-4834-a68c-56f2cfa080ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:11.865724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1af3ccad-41d6-4834-a68c-56f2cfa080ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:11.873297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1af3ccad-41d6-4834-a68c-56f2cfa080ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:11.873790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1af3ccad-41d6-4834-a68c-56f2cfa080ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:11.874218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1af3ccad-41d6-4834-a68c-56f2cfa080ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:11.874926 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1af3ccad-41d6-4834-a68c-56f2cfa080ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:11.875376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1af3ccad-41d6-4834-a68c-56f2cfa080ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:11.875796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1af3ccad-41d6-4834-a68c-56f2cfa080ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:12.011309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1af3ccad-41d6-4834-a68c-56f2cfa080ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:12.020367 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1af3ccad-41d6-4834-a68c-56f2cfa080ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.159284 Sep 05 17:29:12.020946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1268/2381] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:11 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:12.553615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-acf0728e-ae28-4c94-8987-1a7c640d0ee6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:12.554662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-acf0728e-ae28-4c94-8987-1a7c640d0ee6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:12.565938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-acf0728e-ae28-4c94-8987-1a7c640d0ee6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:12.566692 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-acf0728e-ae28-4c94-8987-1a7c640d0ee6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:12.567459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-acf0728e-ae28-4c94-8987-1a7c640d0ee6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:12.568643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-acf0728e-ae28-4c94-8987-1a7c640d0ee6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:12.569446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-acf0728e-ae28-4c94-8987-1a7c640d0ee6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:12.570203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-acf0728e-ae28-4c94-8987-1a7c640d0ee6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:12.718528 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-acf0728e-ae28-4c94-8987-1a7c640d0ee6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:12.726931 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-acf0728e-ae28-4c94-8987-1a7c640d0ee6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.179899 Sep 05 17:29:12.727503 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1114/2382] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:12 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:13.052545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8793517c-3d59-4153-9a96-67231e6f3470 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:13.053458 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8793517c-3d59-4153-9a96-67231e6f3470 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:13.064461 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8793517c-3d59-4153-9a96-67231e6f3470 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:13.065276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8793517c-3d59-4153-9a96-67231e6f3470 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:13.065993 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8793517c-3d59-4153-9a96-67231e6f3470 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:13.067185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8793517c-3d59-4153-9a96-67231e6f3470 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:13.067909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8793517c-3d59-4153-9a96-67231e6f3470 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:13.068666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8793517c-3d59-4153-9a96-67231e6f3470 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:13.205253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8793517c-3d59-4153-9a96-67231e6f3470 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:13.213628 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8793517c-3d59-4153-9a96-67231e6f3470 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.167731 Sep 05 17:29:13.214675 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1269/2383] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:13 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:13.877708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-84f922be-fc90-424e-85e2-88f3689c99fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:13.878325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-84f922be-fc90-424e-85e2-88f3689c99fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:13.884498 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84f922be-fc90-424e-85e2-88f3689c99fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:13.884973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84f922be-fc90-424e-85e2-88f3689c99fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:13.885403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84f922be-fc90-424e-85e2-88f3689c99fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:13.886170 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84f922be-fc90-424e-85e2-88f3689c99fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:13.886626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84f922be-fc90-424e-85e2-88f3689c99fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:13.887035 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-84f922be-fc90-424e-85e2-88f3689c99fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:14.018350 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-84f922be-fc90-424e-85e2-88f3689c99fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:14.027216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-84f922be-fc90-424e-85e2-88f3689c99fb tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.279290 Sep 05 17:29:14.027785 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1115/2384] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:13 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:14.239645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f69582c8-2705-4afe-b417-77200270b8a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:14.240289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f69582c8-2705-4afe-b417-77200270b8a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:14.247402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f69582c8-2705-4afe-b417-77200270b8a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:14.247881 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f69582c8-2705-4afe-b417-77200270b8a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:14.248340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f69582c8-2705-4afe-b417-77200270b8a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:14.249072 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f69582c8-2705-4afe-b417-77200270b8a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:14.249518 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f69582c8-2705-4afe-b417-77200270b8a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:14.249930 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f69582c8-2705-4afe-b417-77200270b8a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:14.383683 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f69582c8-2705-4afe-b417-77200270b8a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:14.396520 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f69582c8-2705-4afe-b417-77200270b8a9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.160967 Sep 05 17:29:14.397103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1270/2385] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:14 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:15.051519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4e66ac79-734c-424a-b8da-72a31a68bfed tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:15.052214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4e66ac79-734c-424a-b8da-72a31a68bfed tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:15.059700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e66ac79-734c-424a-b8da-72a31a68bfed tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:15.060180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e66ac79-734c-424a-b8da-72a31a68bfed tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:15.060649 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e66ac79-734c-424a-b8da-72a31a68bfed tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:15.061342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e66ac79-734c-424a-b8da-72a31a68bfed tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:15.061797 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e66ac79-734c-424a-b8da-72a31a68bfed tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:15.062224 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e66ac79-734c-424a-b8da-72a31a68bfed tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:15.212879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4e66ac79-734c-424a-b8da-72a31a68bfed tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:15.222216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4e66ac79-734c-424a-b8da-72a31a68bfed tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.174920 Sep 05 17:29:15.222791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1116/2386] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:15 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:15.419512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1da885a3-165a-4da9-a2d9-5a49004acdc8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:15.420121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1da885a3-165a-4da9-a2d9-5a49004acdc8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:15.427338 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1da885a3-165a-4da9-a2d9-5a49004acdc8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:15.427823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1da885a3-165a-4da9-a2d9-5a49004acdc8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:15.428298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1da885a3-165a-4da9-a2d9-5a49004acdc8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:15.428997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1da885a3-165a-4da9-a2d9-5a49004acdc8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:15.429449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1da885a3-165a-4da9-a2d9-5a49004acdc8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:15.429876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1da885a3-165a-4da9-a2d9-5a49004acdc8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:15.560858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1da885a3-165a-4da9-a2d9-5a49004acdc8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:15.569192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1da885a3-165a-4da9-a2d9-5a49004acdc8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.153922 Sep 05 17:29:15.569768 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1271/2387] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:15 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:16.246092 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9905c443-8fa9-4e6f-9d0a-1255835618b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:16.246843 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9905c443-8fa9-4e6f-9d0a-1255835618b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:16.253755 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9905c443-8fa9-4e6f-9d0a-1255835618b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:16.254228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9905c443-8fa9-4e6f-9d0a-1255835618b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:16.254650 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9905c443-8fa9-4e6f-9d0a-1255835618b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:16.255329 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9905c443-8fa9-4e6f-9d0a-1255835618b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:16.255915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9905c443-8fa9-4e6f-9d0a-1255835618b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:16.256365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9905c443-8fa9-4e6f-9d0a-1255835618b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:16.393233 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9905c443-8fa9-4e6f-9d0a-1255835618b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:16.401864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9905c443-8fa9-4e6f-9d0a-1255835618b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.159749 Sep 05 17:29:16.402445 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1117/2388] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:16 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:16.596866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6b5c2fa7-a2ac-4f0f-b72f-2316a34db60f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:16.598040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6b5c2fa7-a2ac-4f0f-b72f-2316a34db60f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:16.609697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b5c2fa7-a2ac-4f0f-b72f-2316a34db60f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:16.610501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b5c2fa7-a2ac-4f0f-b72f-2316a34db60f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:16.611274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b5c2fa7-a2ac-4f0f-b72f-2316a34db60f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:16.612498 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b5c2fa7-a2ac-4f0f-b72f-2316a34db60f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:16.613252 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b5c2fa7-a2ac-4f0f-b72f-2316a34db60f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:16.613956 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b5c2fa7-a2ac-4f0f-b72f-2316a34db60f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:16.761652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6b5c2fa7-a2ac-4f0f-b72f-2316a34db60f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:16.774075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6b5c2fa7-a2ac-4f0f-b72f-2316a34db60f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.183935 Sep 05 17:29:16.774875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1272/2389] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:16 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:17.425722 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-aa20fcaa-45dc-4c1b-bf32-17aad118b01f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:17.426246 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-aa20fcaa-45dc-4c1b-bf32-17aad118b01f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:17.433481 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aa20fcaa-45dc-4c1b-bf32-17aad118b01f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:17.433960 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aa20fcaa-45dc-4c1b-bf32-17aad118b01f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:17.434387 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aa20fcaa-45dc-4c1b-bf32-17aad118b01f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:17.435066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aa20fcaa-45dc-4c1b-bf32-17aad118b01f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:17.435535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aa20fcaa-45dc-4c1b-bf32-17aad118b01f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:17.435981 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aa20fcaa-45dc-4c1b-bf32-17aad118b01f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:17.612896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-aa20fcaa-45dc-4c1b-bf32-17aad118b01f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:17.621883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-aa20fcaa-45dc-4c1b-bf32-17aad118b01f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.200256 Sep 05 17:29:17.622474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1118/2390] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:17 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:17.799491 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fa027db6-0ac1-4c3a-9a2d-3e95db248503 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:17.800314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fa027db6-0ac1-4c3a-9a2d-3e95db248503 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:17.813404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa027db6-0ac1-4c3a-9a2d-3e95db248503 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:17.814159 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa027db6-0ac1-4c3a-9a2d-3e95db248503 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:17.814934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa027db6-0ac1-4c3a-9a2d-3e95db248503 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:17.816060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa027db6-0ac1-4c3a-9a2d-3e95db248503 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:17.816833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa027db6-0ac1-4c3a-9a2d-3e95db248503 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:17.817534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa027db6-0ac1-4c3a-9a2d-3e95db248503 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:17.974505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fa027db6-0ac1-4c3a-9a2d-3e95db248503 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:17.984292 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fa027db6-0ac1-4c3a-9a2d-3e95db248503 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.189403 Sep 05 17:29:17.984996 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1273/2391] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:17 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:18.651263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1d2902c3-4dff-4d29-a4ad-f6cb07ad612a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:18.652268 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1d2902c3-4dff-4d29-a4ad-f6cb07ad612a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:18.658899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1d2902c3-4dff-4d29-a4ad-f6cb07ad612a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:18.659387 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1d2902c3-4dff-4d29-a4ad-f6cb07ad612a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:18.659819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1d2902c3-4dff-4d29-a4ad-f6cb07ad612a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:18.660549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1d2902c3-4dff-4d29-a4ad-f6cb07ad612a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:18.660997 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1d2902c3-4dff-4d29-a4ad-f6cb07ad612a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:18.661420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1d2902c3-4dff-4d29-a4ad-f6cb07ad612a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:18.799651 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1d2902c3-4dff-4d29-a4ad-f6cb07ad612a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:18.810795 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1d2902c3-4dff-4d29-a4ad-f6cb07ad612a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.166439 Sep 05 17:29:18.811362 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1119/2392] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:18 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:19.011029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9209b503-036f-43bf-b085-280e18c0af2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:19.011755 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9209b503-036f-43bf-b085-280e18c0af2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:19.018126 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9209b503-036f-43bf-b085-280e18c0af2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:19.018603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9209b503-036f-43bf-b085-280e18c0af2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:19.019147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9209b503-036f-43bf-b085-280e18c0af2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:19.019839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9209b503-036f-43bf-b085-280e18c0af2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:19.020326 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9209b503-036f-43bf-b085-280e18c0af2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:19.020749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9209b503-036f-43bf-b085-280e18c0af2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:19.162918 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9209b503-036f-43bf-b085-280e18c0af2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:19.171660 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9209b503-036f-43bf-b085-280e18c0af2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.164660 Sep 05 17:29:19.172281 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1274/2393] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:19 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:19.838803 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d2c552b4-651c-43e1-a0ef-1c81a55b1a4e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:19.839850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d2c552b4-651c-43e1-a0ef-1c81a55b1a4e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:19.851239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2c552b4-651c-43e1-a0ef-1c81a55b1a4e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:19.852033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2c552b4-651c-43e1-a0ef-1c81a55b1a4e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:19.852774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2c552b4-651c-43e1-a0ef-1c81a55b1a4e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:19.853944 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2c552b4-651c-43e1-a0ef-1c81a55b1a4e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:19.854698 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2c552b4-651c-43e1-a0ef-1c81a55b1a4e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:19.855480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d2c552b4-651c-43e1-a0ef-1c81a55b1a4e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:20.002278 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d2c552b4-651c-43e1-a0ef-1c81a55b1a4e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:20.013939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d2c552b4-651c-43e1-a0ef-1c81a55b1a4e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.181875 Sep 05 17:29:20.014507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1120/2394] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:19 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:20.200683 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1c1cb2c1-695c-4f76-bcf7-ca06ea580dd4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:20.201622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1c1cb2c1-695c-4f76-bcf7-ca06ea580dd4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:20.212535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c1cb2c1-695c-4f76-bcf7-ca06ea580dd4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:20.213373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c1cb2c1-695c-4f76-bcf7-ca06ea580dd4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:20.214075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c1cb2c1-695c-4f76-bcf7-ca06ea580dd4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:20.215131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c1cb2c1-695c-4f76-bcf7-ca06ea580dd4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:20.216019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c1cb2c1-695c-4f76-bcf7-ca06ea580dd4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:20.216462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c1cb2c1-695c-4f76-bcf7-ca06ea580dd4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:20.356267 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1c1cb2c1-695c-4f76-bcf7-ca06ea580dd4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:20.369591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1c1cb2c1-695c-4f76-bcf7-ca06ea580dd4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.176109 Sep 05 17:29:20.370413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1275/2395] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:20 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:21.041462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-37637464-12c8-43a2-90d8-1ce411cb2052 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:21.042427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-37637464-12c8-43a2-90d8-1ce411cb2052 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:21.053459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37637464-12c8-43a2-90d8-1ce411cb2052 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:21.054248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37637464-12c8-43a2-90d8-1ce411cb2052 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:21.054957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37637464-12c8-43a2-90d8-1ce411cb2052 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:21.056088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37637464-12c8-43a2-90d8-1ce411cb2052 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:21.056866 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37637464-12c8-43a2-90d8-1ce411cb2052 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:21.057591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-37637464-12c8-43a2-90d8-1ce411cb2052 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:21.193398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-37637464-12c8-43a2-90d8-1ce411cb2052 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:21.202211 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-37637464-12c8-43a2-90d8-1ce411cb2052 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.167402 Sep 05 17:29:21.202791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1121/2396] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:21 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:21.394128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0caac3a2-0e00-481e-8de2-05addd7c6b79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:21.394736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0caac3a2-0e00-481e-8de2-05addd7c6b79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:21.401673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0caac3a2-0e00-481e-8de2-05addd7c6b79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:21.402149 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0caac3a2-0e00-481e-8de2-05addd7c6b79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:21.402594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0caac3a2-0e00-481e-8de2-05addd7c6b79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:21.403293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0caac3a2-0e00-481e-8de2-05addd7c6b79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:21.403733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0caac3a2-0e00-481e-8de2-05addd7c6b79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:21.404166 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0caac3a2-0e00-481e-8de2-05addd7c6b79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:21.534411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0caac3a2-0e00-481e-8de2-05addd7c6b79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:21.543929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0caac3a2-0e00-481e-8de2-05addd7c6b79 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.153399 Sep 05 17:29:21.544562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1276/2397] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:21 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:22.229475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-26f9d66b-d9f9-4e05-be1d-032f226ba801 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:22.230400 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-26f9d66b-d9f9-4e05-be1d-032f226ba801 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:22.238447 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26f9d66b-d9f9-4e05-be1d-032f226ba801 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:22.239086 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26f9d66b-d9f9-4e05-be1d-032f226ba801 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:22.239683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26f9d66b-d9f9-4e05-be1d-032f226ba801 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:22.240925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26f9d66b-d9f9-4e05-be1d-032f226ba801 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:22.241478 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26f9d66b-d9f9-4e05-be1d-032f226ba801 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:22.241938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26f9d66b-d9f9-4e05-be1d-032f226ba801 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:22.245828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:29:22.388702 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-26f9d66b-d9f9-4e05-be1d-032f226ba801 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:22.397199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-26f9d66b-d9f9-4e05-be1d-032f226ba801 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.173850 Sep 05 17:29:22.397774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1122/2398] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:22 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:22.571258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e0dc3e87-8e1a-4080-814b-f8711eaaa6fe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:22.572187 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e0dc3e87-8e1a-4080-814b-f8711eaaa6fe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:22.583478 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e0dc3e87-8e1a-4080-814b-f8711eaaa6fe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:22.584354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e0dc3e87-8e1a-4080-814b-f8711eaaa6fe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:22.585097 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e0dc3e87-8e1a-4080-814b-f8711eaaa6fe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:22.586228 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e0dc3e87-8e1a-4080-814b-f8711eaaa6fe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:22.586977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e0dc3e87-8e1a-4080-814b-f8711eaaa6fe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:22.587676 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e0dc3e87-8e1a-4080-814b-f8711eaaa6fe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:22.725228 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e0dc3e87-8e1a-4080-814b-f8711eaaa6fe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:22.728384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:29:22.736645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e0dc3e87-8e1a-4080-814b-f8711eaaa6fe tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.172106 Sep 05 17:29:22.737219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1277/2399] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:22 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:23.421216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d8feda07-b174-4f09-be0a-47408f801cde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:23.421791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d8feda07-b174-4f09-be0a-47408f801cde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:23.428777 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d8feda07-b174-4f09-be0a-47408f801cde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:23.429262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d8feda07-b174-4f09-be0a-47408f801cde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:23.429697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d8feda07-b174-4f09-be0a-47408f801cde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:23.430386 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d8feda07-b174-4f09-be0a-47408f801cde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:23.430843 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d8feda07-b174-4f09-be0a-47408f801cde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:23.431265 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d8feda07-b174-4f09-be0a-47408f801cde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:23.562563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d8feda07-b174-4f09-be0a-47408f801cde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:23.570947 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d8feda07-b174-4f09-be0a-47408f801cde tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.153905 Sep 05 17:29:23.571493 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1123/2400] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:23 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:23.763987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a15670dd-e282-4317-8b9d-c1351dc91508 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:23.764804 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a15670dd-e282-4317-8b9d-c1351dc91508 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:23.771706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a15670dd-e282-4317-8b9d-c1351dc91508 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:23.772221 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a15670dd-e282-4317-8b9d-c1351dc91508 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:23.772686 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a15670dd-e282-4317-8b9d-c1351dc91508 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:23.773410 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a15670dd-e282-4317-8b9d-c1351dc91508 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:23.773872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a15670dd-e282-4317-8b9d-c1351dc91508 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:23.774314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a15670dd-e282-4317-8b9d-c1351dc91508 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:23.912466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a15670dd-e282-4317-8b9d-c1351dc91508 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:23.924668 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a15670dd-e282-4317-8b9d-c1351dc91508 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.167049 Sep 05 17:29:23.925487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1278/2401] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:23 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:24.597099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b30e098e-6494-4d04-a609-ba5c3cefe173 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:24.597761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b30e098e-6494-4d04-a609-ba5c3cefe173 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:24.605319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b30e098e-6494-4d04-a609-ba5c3cefe173 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:24.605854 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b30e098e-6494-4d04-a609-ba5c3cefe173 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:24.606332 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b30e098e-6494-4d04-a609-ba5c3cefe173 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:24.607085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b30e098e-6494-4d04-a609-ba5c3cefe173 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:24.608303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b30e098e-6494-4d04-a609-ba5c3cefe173 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:24.608780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b30e098e-6494-4d04-a609-ba5c3cefe173 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:24.750718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b30e098e-6494-4d04-a609-ba5c3cefe173 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:24.759525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b30e098e-6494-4d04-a609-ba5c3cefe173 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.166928 Sep 05 17:29:24.760095 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1124/2402] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:24 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:24.955127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-62ff58ef-e1df-4002-a61d-718f7d80d873 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:24.955756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-62ff58ef-e1df-4002-a61d-718f7d80d873 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:24.963179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62ff58ef-e1df-4002-a61d-718f7d80d873 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:24.963707 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62ff58ef-e1df-4002-a61d-718f7d80d873 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:24.964189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62ff58ef-e1df-4002-a61d-718f7d80d873 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:24.964964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62ff58ef-e1df-4002-a61d-718f7d80d873 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:24.965817 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62ff58ef-e1df-4002-a61d-718f7d80d873 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:24.966468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62ff58ef-e1df-4002-a61d-718f7d80d873 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:25.113170 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-62ff58ef-e1df-4002-a61d-718f7d80d873 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:25.126671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-62ff58ef-e1df-4002-a61d-718f7d80d873 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.176608 Sep 05 17:29:25.127506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1279/2403] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:24 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:25.786847 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c92a4634-c35b-42b5-b44b-5d1ed2796f32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:25.787877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c92a4634-c35b-42b5-b44b-5d1ed2796f32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:25.797353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c92a4634-c35b-42b5-b44b-5d1ed2796f32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:25.797839 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c92a4634-c35b-42b5-b44b-5d1ed2796f32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:25.798266 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c92a4634-c35b-42b5-b44b-5d1ed2796f32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:25.798953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c92a4634-c35b-42b5-b44b-5d1ed2796f32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:25.799406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c92a4634-c35b-42b5-b44b-5d1ed2796f32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:25.799830 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c92a4634-c35b-42b5-b44b-5d1ed2796f32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:25.931514 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c92a4634-c35b-42b5-b44b-5d1ed2796f32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:25.943814 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c92a4634-c35b-42b5-b44b-5d1ed2796f32 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.163335 Sep 05 17:29:25.944670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1125/2404] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:25 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:26.157762 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b9f6e6a0-f412-48c6-b15f-e5bc8512e918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:26.158382 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b9f6e6a0-f412-48c6-b15f-e5bc8512e918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:26.165306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9f6e6a0-f412-48c6-b15f-e5bc8512e918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:26.165781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9f6e6a0-f412-48c6-b15f-e5bc8512e918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:26.166214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9f6e6a0-f412-48c6-b15f-e5bc8512e918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:26.166896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9f6e6a0-f412-48c6-b15f-e5bc8512e918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:26.167373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9f6e6a0-f412-48c6-b15f-e5bc8512e918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:26.167795 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9f6e6a0-f412-48c6-b15f-e5bc8512e918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:26.310920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b9f6e6a0-f412-48c6-b15f-e5bc8512e918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:26.319656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b9f6e6a0-f412-48c6-b15f-e5bc8512e918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.167023 Sep 05 17:29:26.320261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1280/2405] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:26 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:26.971286 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-97b0b073-fd6f-4ebc-a826-b0c697ad1139 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:26.972065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-97b0b073-fd6f-4ebc-a826-b0c697ad1139 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:26.980526 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-97b0b073-fd6f-4ebc-a826-b0c697ad1139 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:26.981131 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-97b0b073-fd6f-4ebc-a826-b0c697ad1139 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:26.981674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-97b0b073-fd6f-4ebc-a826-b0c697ad1139 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:26.982874 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-97b0b073-fd6f-4ebc-a826-b0c697ad1139 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:26.983067 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-97b0b073-fd6f-4ebc-a826-b0c697ad1139 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:26.983610 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-97b0b073-fd6f-4ebc-a826-b0c697ad1139 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:27.122466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-97b0b073-fd6f-4ebc-a826-b0c697ad1139 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:27.131228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-97b0b073-fd6f-4ebc-a826-b0c697ad1139 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.165820 Sep 05 17:29:27.131817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1126/2406] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:26 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:27.344316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-97ad75a3-78d1-44b4-9bd9-0ff19c0fc899 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:27.344992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-97ad75a3-78d1-44b4-9bd9-0ff19c0fc899 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:27.352120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-97ad75a3-78d1-44b4-9bd9-0ff19c0fc899 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:27.352655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-97ad75a3-78d1-44b4-9bd9-0ff19c0fc899 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:27.353103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-97ad75a3-78d1-44b4-9bd9-0ff19c0fc899 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:27.353822 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-97ad75a3-78d1-44b4-9bd9-0ff19c0fc899 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:27.354283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-97ad75a3-78d1-44b4-9bd9-0ff19c0fc899 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:27.354728 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-97ad75a3-78d1-44b4-9bd9-0ff19c0fc899 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:27.491010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-97ad75a3-78d1-44b4-9bd9-0ff19c0fc899 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:27.503750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-97ad75a3-78d1-44b4-9bd9-0ff19c0fc899 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.164162 Sep 05 17:29:27.504606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1281/2407] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:27 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:28.159922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-38dce47f-68bc-49e3-8510-4eb8d3bfa737 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:28.160966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-38dce47f-68bc-49e3-8510-4eb8d3bfa737 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:28.171343 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38dce47f-68bc-49e3-8510-4eb8d3bfa737 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:28.171832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38dce47f-68bc-49e3-8510-4eb8d3bfa737 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:28.172278 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38dce47f-68bc-49e3-8510-4eb8d3bfa737 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:28.172980 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38dce47f-68bc-49e3-8510-4eb8d3bfa737 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:28.173429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38dce47f-68bc-49e3-8510-4eb8d3bfa737 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:28.173849 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38dce47f-68bc-49e3-8510-4eb8d3bfa737 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:28.321224 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-38dce47f-68bc-49e3-8510-4eb8d3bfa737 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:28.330192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-38dce47f-68bc-49e3-8510-4eb8d3bfa737 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.177691 Sep 05 17:29:28.330763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1127/2408] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:28 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:28.533746 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c3a36839-d11c-4498-a650-b92bf5346100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:28.534490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c3a36839-d11c-4498-a650-b92bf5346100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:28.542789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3a36839-d11c-4498-a650-b92bf5346100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:28.543430 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3a36839-d11c-4498-a650-b92bf5346100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:28.544014 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3a36839-d11c-4498-a650-b92bf5346100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:28.544975 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3a36839-d11c-4498-a650-b92bf5346100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:28.545581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3a36839-d11c-4498-a650-b92bf5346100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:28.546153 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3a36839-d11c-4498-a650-b92bf5346100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:28.697813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c3a36839-d11c-4498-a650-b92bf5346100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:28.707518 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c3a36839-d11c-4498-a650-b92bf5346100 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.180054 Sep 05 17:29:28.708074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1282/2409] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:28 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:29.362963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-bdbaf0ad-073d-4f68-972d-52f01aee3e50 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:29.363611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-bdbaf0ad-073d-4f68-972d-52f01aee3e50 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:29.370217 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bdbaf0ad-073d-4f68-972d-52f01aee3e50 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:29.370710 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bdbaf0ad-073d-4f68-972d-52f01aee3e50 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:29.371172 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bdbaf0ad-073d-4f68-972d-52f01aee3e50 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:29.371878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bdbaf0ad-073d-4f68-972d-52f01aee3e50 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:29.375180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bdbaf0ad-073d-4f68-972d-52f01aee3e50 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:29.375180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bdbaf0ad-073d-4f68-972d-52f01aee3e50 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:29.515531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bdbaf0ad-073d-4f68-972d-52f01aee3e50 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:29.524100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-bdbaf0ad-073d-4f68-972d-52f01aee3e50 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.174118 Sep 05 17:29:29.524699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1128/2410] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:29 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:29.735241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-374e41d1-75c5-4ae8-a200-478de6ab0b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:29.735897 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-374e41d1-75c5-4ae8-a200-478de6ab0b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:29.743878 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-374e41d1-75c5-4ae8-a200-478de6ab0b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:29.744483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-374e41d1-75c5-4ae8-a200-478de6ab0b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:29.744991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-374e41d1-75c5-4ae8-a200-478de6ab0b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:29.745784 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-374e41d1-75c5-4ae8-a200-478de6ab0b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:29.746313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-374e41d1-75c5-4ae8-a200-478de6ab0b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:29.746800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-374e41d1-75c5-4ae8-a200-478de6ab0b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:29.881619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-374e41d1-75c5-4ae8-a200-478de6ab0b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:29.894296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-374e41d1-75c5-4ae8-a200-478de6ab0b57 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.165257 Sep 05 17:29:29.895089 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1283/2411] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:29 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:30.551417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-bf425b05-459e-4239-9983-1a7f3b66a246 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:30.552426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-bf425b05-459e-4239-9983-1a7f3b66a246 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:30.556137 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=52 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:29:30.563978 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bf425b05-459e-4239-9983-1a7f3b66a246 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:30.564477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bf425b05-459e-4239-9983-1a7f3b66a246 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:30.564917 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bf425b05-459e-4239-9983-1a7f3b66a246 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:30.565579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bf425b05-459e-4239-9983-1a7f3b66a246 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:30.566025 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bf425b05-459e-4239-9983-1a7f3b66a246 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:30.566420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bf425b05-459e-4239-9983-1a7f3b66a246 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:30.697473 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bf425b05-459e-4239-9983-1a7f3b66a246 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:30.706111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-bf425b05-459e-4239-9983-1a7f3b66a246 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.161524 Sep 05 17:29:30.706677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1129/2412] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:30 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:30.925806 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dfd7a152-4c3e-4888-ac70-3654a88adb6d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:30.926685 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dfd7a152-4c3e-4888-ac70-3654a88adb6d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:30.930432 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=52 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:29:30.938233 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfd7a152-4c3e-4888-ac70-3654a88adb6d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:30.938704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfd7a152-4c3e-4888-ac70-3654a88adb6d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:30.939130 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfd7a152-4c3e-4888-ac70-3654a88adb6d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:30.939808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfd7a152-4c3e-4888-ac70-3654a88adb6d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:30.940263 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfd7a152-4c3e-4888-ac70-3654a88adb6d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:30.940673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfd7a152-4c3e-4888-ac70-3654a88adb6d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:31.085746 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dfd7a152-4c3e-4888-ac70-3654a88adb6d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:31.098615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dfd7a152-4c3e-4888-ac70-3654a88adb6d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.179479 Sep 05 17:29:31.099414 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1284/2413] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:30 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:31.733945 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-96f7cf0b-66bd-41b2-b1e2-7489ff6b96ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:31.734885 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-96f7cf0b-66bd-41b2-b1e2-7489ff6b96ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:31.742953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96f7cf0b-66bd-41b2-b1e2-7489ff6b96ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:31.743525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96f7cf0b-66bd-41b2-b1e2-7489ff6b96ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:31.744034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96f7cf0b-66bd-41b2-b1e2-7489ff6b96ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:31.744891 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96f7cf0b-66bd-41b2-b1e2-7489ff6b96ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:31.745423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96f7cf0b-66bd-41b2-b1e2-7489ff6b96ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:31.745920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-96f7cf0b-66bd-41b2-b1e2-7489ff6b96ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:31.880778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-96f7cf0b-66bd-41b2-b1e2-7489ff6b96ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:31.889442 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-96f7cf0b-66bd-41b2-b1e2-7489ff6b96ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.162135 Sep 05 17:29:31.890030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1130/2414] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:31 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:32.126771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b5f3ecdb-7a94-4030-9545-c5fc2ae45caf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:32.127428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b5f3ecdb-7a94-4030-9545-c5fc2ae45caf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:32.135177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5f3ecdb-7a94-4030-9545-c5fc2ae45caf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:32.135823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5f3ecdb-7a94-4030-9545-c5fc2ae45caf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:32.136503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5f3ecdb-7a94-4030-9545-c5fc2ae45caf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:32.137314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5f3ecdb-7a94-4030-9545-c5fc2ae45caf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:32.137925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5f3ecdb-7a94-4030-9545-c5fc2ae45caf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:32.138566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5f3ecdb-7a94-4030-9545-c5fc2ae45caf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:32.289223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b5f3ecdb-7a94-4030-9545-c5fc2ae45caf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:32.297780 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b5f3ecdb-7a94-4030-9545-c5fc2ae45caf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.176383 Sep 05 17:29:32.298352 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1285/2415] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:32 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:32.920130 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-212481c2-cdbc-4a3f-bf91-210292f5a9dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:32.921185 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-212481c2-cdbc-4a3f-bf91-210292f5a9dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:32.932376 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-212481c2-cdbc-4a3f-bf91-210292f5a9dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:32.933205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-212481c2-cdbc-4a3f-bf91-210292f5a9dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:32.933916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-212481c2-cdbc-4a3f-bf91-210292f5a9dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:32.935058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-212481c2-cdbc-4a3f-bf91-210292f5a9dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:32.935811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-212481c2-cdbc-4a3f-bf91-210292f5a9dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:32.936563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-212481c2-cdbc-4a3f-bf91-210292f5a9dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:33.072665 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-212481c2-cdbc-4a3f-bf91-210292f5a9dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:33.081301 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-212481c2-cdbc-4a3f-bf91-210292f5a9dc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.170830 Sep 05 17:29:33.081879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1131/2416] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:32 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:33.325899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-334fa95c-2aae-4642-830f-8ad89ca3cdc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:33.326930 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-334fa95c-2aae-4642-830f-8ad89ca3cdc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:33.334526 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-334fa95c-2aae-4642-830f-8ad89ca3cdc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:33.335004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-334fa95c-2aae-4642-830f-8ad89ca3cdc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:33.335431 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-334fa95c-2aae-4642-830f-8ad89ca3cdc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:33.336112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-334fa95c-2aae-4642-830f-8ad89ca3cdc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:33.336593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-334fa95c-2aae-4642-830f-8ad89ca3cdc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:33.337013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-334fa95c-2aae-4642-830f-8ad89ca3cdc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:33.471791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-334fa95c-2aae-4642-830f-8ad89ca3cdc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:33.480588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-334fa95c-2aae-4642-830f-8ad89ca3cdc9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.161291 Sep 05 17:29:33.481176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1286/2417] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:33 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:34.109577 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cf87600e-d701-41a8-8964-8823cb6c2094 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:34.110546 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cf87600e-d701-41a8-8964-8823cb6c2094 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:34.117806 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf87600e-d701-41a8-8964-8823cb6c2094 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:34.118291 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf87600e-d701-41a8-8964-8823cb6c2094 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:34.118722 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf87600e-d701-41a8-8964-8823cb6c2094 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:34.119407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf87600e-d701-41a8-8964-8823cb6c2094 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:34.119860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf87600e-d701-41a8-8964-8823cb6c2094 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:34.120311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf87600e-d701-41a8-8964-8823cb6c2094 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:34.263350 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cf87600e-d701-41a8-8964-8823cb6c2094 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:34.276677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cf87600e-d701-41a8-8964-8823cb6c2094 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.173436 Sep 05 17:29:34.277330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1132/2418] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:34 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:34.506164 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1866a053-d2c0-4525-ad3e-675c0e81bbe7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:34.506822 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1866a053-d2c0-4525-ad3e-675c0e81bbe7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:34.513682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1866a053-d2c0-4525-ad3e-675c0e81bbe7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:34.514169 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1866a053-d2c0-4525-ad3e-675c0e81bbe7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:34.514637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1866a053-d2c0-4525-ad3e-675c0e81bbe7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:34.515327 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1866a053-d2c0-4525-ad3e-675c0e81bbe7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:34.515779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1866a053-d2c0-4525-ad3e-675c0e81bbe7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:34.516207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1866a053-d2c0-4525-ad3e-675c0e81bbe7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:34.652350 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1866a053-d2c0-4525-ad3e-675c0e81bbe7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:34.661323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1866a053-d2c0-4525-ad3e-675c0e81bbe7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.159775 Sep 05 17:29:34.661875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1287/2419] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:34 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:35.306129 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a8eddaf6-65af-4912-a767-3cf7e2fbddc4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:35.309346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a8eddaf6-65af-4912-a767-3cf7e2fbddc4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:35.319138 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8eddaf6-65af-4912-a767-3cf7e2fbddc4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:35.319624 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8eddaf6-65af-4912-a767-3cf7e2fbddc4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:35.320055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8eddaf6-65af-4912-a767-3cf7e2fbddc4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:35.320800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8eddaf6-65af-4912-a767-3cf7e2fbddc4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:35.321248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8eddaf6-65af-4912-a767-3cf7e2fbddc4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:35.321671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a8eddaf6-65af-4912-a767-3cf7e2fbddc4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:35.462697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a8eddaf6-65af-4912-a767-3cf7e2fbddc4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:35.475713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a8eddaf6-65af-4912-a767-3cf7e2fbddc4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.175673 Sep 05 17:29:35.476546 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1133/2420] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:35 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:35.689627 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ac5533db-a0dc-4cfc-999d-f3c9dd44403e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:35.690568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ac5533db-a0dc-4cfc-999d-f3c9dd44403e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:35.701654 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac5533db-a0dc-4cfc-999d-f3c9dd44403e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:35.702444 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac5533db-a0dc-4cfc-999d-f3c9dd44403e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:35.703149 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac5533db-a0dc-4cfc-999d-f3c9dd44403e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:35.704309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac5533db-a0dc-4cfc-999d-f3c9dd44403e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:35.705307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac5533db-a0dc-4cfc-999d-f3c9dd44403e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:35.705566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac5533db-a0dc-4cfc-999d-f3c9dd44403e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:35.850499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ac5533db-a0dc-4cfc-999d-f3c9dd44403e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:35.858954 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ac5533db-a0dc-4cfc-999d-f3c9dd44403e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.176245 Sep 05 17:29:35.859531 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1288/2421] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:35 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:36.504119 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-633d00ef-895a-44fc-a0dd-d825ed1972d0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:36.504807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-633d00ef-895a-44fc-a0dd-d825ed1972d0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:36.511756 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-633d00ef-895a-44fc-a0dd-d825ed1972d0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:36.512263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-633d00ef-895a-44fc-a0dd-d825ed1972d0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:36.512696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-633d00ef-895a-44fc-a0dd-d825ed1972d0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:36.513373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-633d00ef-895a-44fc-a0dd-d825ed1972d0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:36.513825 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-633d00ef-895a-44fc-a0dd-d825ed1972d0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:36.514240 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-633d00ef-895a-44fc-a0dd-d825ed1972d0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:36.654148 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-633d00ef-895a-44fc-a0dd-d825ed1972d0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:36.662625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-633d00ef-895a-44fc-a0dd-d825ed1972d0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.163209 Sep 05 17:29:36.663197 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1134/2422] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:36 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:36.888178 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7541c80f-c107-4811-9121-85202610758d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:36.889193 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7541c80f-c107-4811-9121-85202610758d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:36.897447 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7541c80f-c107-4811-9121-85202610758d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:36.897932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7541c80f-c107-4811-9121-85202610758d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:36.898367 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7541c80f-c107-4811-9121-85202610758d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:36.899061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7541c80f-c107-4811-9121-85202610758d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:36.899519 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7541c80f-c107-4811-9121-85202610758d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:36.899946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7541c80f-c107-4811-9121-85202610758d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:37.039012 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7541c80f-c107-4811-9121-85202610758d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:37.047568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7541c80f-c107-4811-9121-85202610758d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.166522 Sep 05 17:29:37.048163 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1289/2423] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:36 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:37.686216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9ecf3aa9-ab5e-4843-b859-3205da533531 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:37.686965 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9ecf3aa9-ab5e-4843-b859-3205da533531 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:37.695047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ecf3aa9-ab5e-4843-b859-3205da533531 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:37.695612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ecf3aa9-ab5e-4843-b859-3205da533531 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:37.696115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ecf3aa9-ab5e-4843-b859-3205da533531 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:37.696952 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ecf3aa9-ab5e-4843-b859-3205da533531 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:37.697487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ecf3aa9-ab5e-4843-b859-3205da533531 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:37.697977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9ecf3aa9-ab5e-4843-b859-3205da533531 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:37.839205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9ecf3aa9-ab5e-4843-b859-3205da533531 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:37.852050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9ecf3aa9-ab5e-4843-b859-3205da533531 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.170192 Sep 05 17:29:37.852942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1135/2424] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:37 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:38.075223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-48ae2885-bdd7-4ac8-a7a1-98b218a8ffd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:38.076264 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-48ae2885-bdd7-4ac8-a7a1-98b218a8ffd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:38.087502 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48ae2885-bdd7-4ac8-a7a1-98b218a8ffd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:38.088340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48ae2885-bdd7-4ac8-a7a1-98b218a8ffd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:38.089094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48ae2885-bdd7-4ac8-a7a1-98b218a8ffd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:38.090219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48ae2885-bdd7-4ac8-a7a1-98b218a8ffd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:38.091376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48ae2885-bdd7-4ac8-a7a1-98b218a8ffd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:38.092065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48ae2885-bdd7-4ac8-a7a1-98b218a8ffd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:38.233998 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-48ae2885-bdd7-4ac8-a7a1-98b218a8ffd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:38.242985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-48ae2885-bdd7-4ac8-a7a1-98b218a8ffd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.174385 Sep 05 17:29:38.243555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1290/2425] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:38 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:38.879365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3829b6e6-ef1d-4ed3-ae85-411d88b8f840 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:38.880019 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3829b6e6-ef1d-4ed3-ae85-411d88b8f840 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:38.887456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3829b6e6-ef1d-4ed3-ae85-411d88b8f840 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:38.887964 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3829b6e6-ef1d-4ed3-ae85-411d88b8f840 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:38.888452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3829b6e6-ef1d-4ed3-ae85-411d88b8f840 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:38.889173 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3829b6e6-ef1d-4ed3-ae85-411d88b8f840 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:38.889643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3829b6e6-ef1d-4ed3-ae85-411d88b8f840 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:38.890086 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3829b6e6-ef1d-4ed3-ae85-411d88b8f840 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:39.028728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3829b6e6-ef1d-4ed3-ae85-411d88b8f840 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:39.037171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3829b6e6-ef1d-4ed3-ae85-411d88b8f840 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.163468 Sep 05 17:29:39.037740 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1136/2426] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:38 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:39.267712 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-95886d87-fc71-4f76-985c-780d214697f7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:39.268916 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-95886d87-fc71-4f76-985c-780d214697f7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:39.275496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95886d87-fc71-4f76-985c-780d214697f7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:39.276007 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95886d87-fc71-4f76-985c-780d214697f7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:39.276441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95886d87-fc71-4f76-985c-780d214697f7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:39.277134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95886d87-fc71-4f76-985c-780d214697f7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:39.277581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95886d87-fc71-4f76-985c-780d214697f7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:39.278028 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95886d87-fc71-4f76-985c-780d214697f7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:39.413479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-95886d87-fc71-4f76-985c-780d214697f7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:39.421970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-95886d87-fc71-4f76-985c-780d214697f7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.158616 Sep 05 17:29:39.422554 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1291/2427] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:39 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:40.064822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-836014f1-317d-4bca-8826-ddc489b7b0e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:40.065816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-836014f1-317d-4bca-8826-ddc489b7b0e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:40.077279 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-836014f1-317d-4bca-8826-ddc489b7b0e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:40.078065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-836014f1-317d-4bca-8826-ddc489b7b0e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:40.078754 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-836014f1-317d-4bca-8826-ddc489b7b0e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:40.079886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-836014f1-317d-4bca-8826-ddc489b7b0e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:40.080667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-836014f1-317d-4bca-8826-ddc489b7b0e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:40.081365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-836014f1-317d-4bca-8826-ddc489b7b0e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:40.217923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-836014f1-317d-4bca-8826-ddc489b7b0e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:40.226618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-836014f1-317d-4bca-8826-ddc489b7b0e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.168447 Sep 05 17:29:40.227177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1137/2428] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:40 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:40.447834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3d58fb19-827f-4760-80cc-8460126e1f96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:40.448808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3d58fb19-827f-4760-80cc-8460126e1f96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:40.459381 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d58fb19-827f-4760-80cc-8460126e1f96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:40.460118 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d58fb19-827f-4760-80cc-8460126e1f96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:40.460838 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d58fb19-827f-4760-80cc-8460126e1f96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:40.461896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d58fb19-827f-4760-80cc-8460126e1f96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:40.462591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d58fb19-827f-4760-80cc-8460126e1f96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:40.463242 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d58fb19-827f-4760-80cc-8460126e1f96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:40.599460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3d58fb19-827f-4760-80cc-8460126e1f96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:40.607800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3d58fb19-827f-4760-80cc-8460126e1f96 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.165984 Sep 05 17:29:40.608406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1292/2429] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:40 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:41.261381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-927c2f43-7c26-4198-8127-f3c6f0801c98 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:41.262254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-927c2f43-7c26-4198-8127-f3c6f0801c98 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:41.273424 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-927c2f43-7c26-4198-8127-f3c6f0801c98 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:41.274283 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-927c2f43-7c26-4198-8127-f3c6f0801c98 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:41.275266 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-927c2f43-7c26-4198-8127-f3c6f0801c98 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:41.276426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-927c2f43-7c26-4198-8127-f3c6f0801c98 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:41.277148 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-927c2f43-7c26-4198-8127-f3c6f0801c98 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:41.277864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-927c2f43-7c26-4198-8127-f3c6f0801c98 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:41.430714 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-927c2f43-7c26-4198-8127-f3c6f0801c98 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:41.434053 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:29:41.445218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-927c2f43-7c26-4198-8127-f3c6f0801c98 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.190161 Sep 05 17:29:41.446014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1138/2430] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:41 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:41.635709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fefcd1f4-b5d1-48ab-8faf-9b5571c7c5fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:41.636740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fefcd1f4-b5d1-48ab-8faf-9b5571c7c5fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:41.647356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fefcd1f4-b5d1-48ab-8faf-9b5571c7c5fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:41.648136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fefcd1f4-b5d1-48ab-8faf-9b5571c7c5fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:41.648620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fefcd1f4-b5d1-48ab-8faf-9b5571c7c5fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:41.649314 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fefcd1f4-b5d1-48ab-8faf-9b5571c7c5fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:41.649752 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fefcd1f4-b5d1-48ab-8faf-9b5571c7c5fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:41.650173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fefcd1f4-b5d1-48ab-8faf-9b5571c7c5fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:41.783191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fefcd1f4-b5d1-48ab-8faf-9b5571c7c5fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:41.792895 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fefcd1f4-b5d1-48ab-8faf-9b5571c7c5fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.163903 Sep 05 17:29:41.793503 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1293/2431] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:41 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:42.474318 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-968dba11-d1b9-4320-b1a3-04637bf1495f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:42.474991 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-968dba11-d1b9-4320-b1a3-04637bf1495f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:42.482535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-968dba11-d1b9-4320-b1a3-04637bf1495f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:42.483076 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-968dba11-d1b9-4320-b1a3-04637bf1495f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:42.483559 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-968dba11-d1b9-4320-b1a3-04637bf1495f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:42.484369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-968dba11-d1b9-4320-b1a3-04637bf1495f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:42.484876 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-968dba11-d1b9-4320-b1a3-04637bf1495f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:42.485468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-968dba11-d1b9-4320-b1a3-04637bf1495f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:42.626460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-968dba11-d1b9-4320-b1a3-04637bf1495f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:42.634967 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-968dba11-d1b9-4320-b1a3-04637bf1495f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.167596 Sep 05 17:29:42.635472 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1139/2432] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:42 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:42.820499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-481e9bf6-e696-48f6-b796-dbf2c2100441 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:42.821425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-481e9bf6-e696-48f6-b796-dbf2c2100441 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:42.832286 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-481e9bf6-e696-48f6-b796-dbf2c2100441 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:42.833223 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-481e9bf6-e696-48f6-b796-dbf2c2100441 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:42.833921 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-481e9bf6-e696-48f6-b796-dbf2c2100441 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:42.834617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-481e9bf6-e696-48f6-b796-dbf2c2100441 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:42.835067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-481e9bf6-e696-48f6-b796-dbf2c2100441 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:42.835483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-481e9bf6-e696-48f6-b796-dbf2c2100441 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:42.851093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:29:42.973819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-481e9bf6-e696-48f6-b796-dbf2c2100441 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:42.982475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-481e9bf6-e696-48f6-b796-dbf2c2100441 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.168670 Sep 05 17:29:42.983068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1294/2433] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:42 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:43.662433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e2be34ba-4883-4a9f-974d-d967ba195336 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:43.663355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e2be34ba-4883-4a9f-974d-d967ba195336 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:43.673671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e2be34ba-4883-4a9f-974d-d967ba195336 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:43.674477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e2be34ba-4883-4a9f-974d-d967ba195336 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:43.675189 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e2be34ba-4883-4a9f-974d-d967ba195336 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:43.676372 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e2be34ba-4883-4a9f-974d-d967ba195336 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:43.677043 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e2be34ba-4883-4a9f-974d-d967ba195336 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:43.677463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e2be34ba-4883-4a9f-974d-d967ba195336 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:43.817077 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e2be34ba-4883-4a9f-974d-d967ba195336 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:43.825351 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e2be34ba-4883-4a9f-974d-d967ba195336 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.169936 Sep 05 17:29:43.825953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1140/2434] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:43 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:44.012322 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-98f76834-6f87-4e12-9a56-879502f006ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:44.013177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-98f76834-6f87-4e12-9a56-879502f006ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:44.024241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98f76834-6f87-4e12-9a56-879502f006ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:44.025090 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98f76834-6f87-4e12-9a56-879502f006ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:44.025814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98f76834-6f87-4e12-9a56-879502f006ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:44.026955 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98f76834-6f87-4e12-9a56-879502f006ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:44.027715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98f76834-6f87-4e12-9a56-879502f006ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:44.028479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-98f76834-6f87-4e12-9a56-879502f006ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:44.167331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-98f76834-6f87-4e12-9a56-879502f006ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:44.179954 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-98f76834-6f87-4e12-9a56-879502f006ba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.174089 Sep 05 17:29:44.180903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1295/2435] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:44 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:44.854918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f8d6395c-ffa1-4d8f-86a3-1b1823b89262 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:44.855868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f8d6395c-ffa1-4d8f-86a3-1b1823b89262 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:44.866914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d6395c-ffa1-4d8f-86a3-1b1823b89262 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:44.867717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d6395c-ffa1-4d8f-86a3-1b1823b89262 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:44.868505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d6395c-ffa1-4d8f-86a3-1b1823b89262 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:44.869641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d6395c-ffa1-4d8f-86a3-1b1823b89262 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:44.870395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d6395c-ffa1-4d8f-86a3-1b1823b89262 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:44.871094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f8d6395c-ffa1-4d8f-86a3-1b1823b89262 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:45.025061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f8d6395c-ffa1-4d8f-86a3-1b1823b89262 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:45.033635 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f8d6395c-ffa1-4d8f-86a3-1b1823b89262 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.185742 Sep 05 17:29:45.034222 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1141/2436] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:44 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:45.211020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-47f0595d-3431-46a2-8cb8-e71349157689 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:45.211609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-47f0595d-3431-46a2-8cb8-e71349157689 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:45.218554 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47f0595d-3431-46a2-8cb8-e71349157689 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:45.219035 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47f0595d-3431-46a2-8cb8-e71349157689 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:45.219467 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47f0595d-3431-46a2-8cb8-e71349157689 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:45.220178 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47f0595d-3431-46a2-8cb8-e71349157689 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:45.220633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47f0595d-3431-46a2-8cb8-e71349157689 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:45.221056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47f0595d-3431-46a2-8cb8-e71349157689 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:45.358653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-47f0595d-3431-46a2-8cb8-e71349157689 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:45.367236 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-47f0595d-3431-46a2-8cb8-e71349157689 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.161886 Sep 05 17:29:45.367791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1296/2437] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:45 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:46.061781 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b9daa506-3088-497b-a08a-102fc7fa97a8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:46.062832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b9daa506-3088-497b-a08a-102fc7fa97a8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:46.074698 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b9daa506-3088-497b-a08a-102fc7fa97a8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:46.075463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b9daa506-3088-497b-a08a-102fc7fa97a8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:46.076224 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b9daa506-3088-497b-a08a-102fc7fa97a8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:46.077397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b9daa506-3088-497b-a08a-102fc7fa97a8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:46.078143 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b9daa506-3088-497b-a08a-102fc7fa97a8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:46.078820 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b9daa506-3088-497b-a08a-102fc7fa97a8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:46.227947 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b9daa506-3088-497b-a08a-102fc7fa97a8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:46.236719 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b9daa506-3088-497b-a08a-102fc7fa97a8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.181634 Sep 05 17:29:46.237299 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1142/2438] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:46 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:46.391261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-29299af7-2e00-416b-838d-09f5268e11bb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:46.391903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-29299af7-2e00-416b-838d-09f5268e11bb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:46.400646 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29299af7-2e00-416b-838d-09f5268e11bb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:46.401146 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29299af7-2e00-416b-838d-09f5268e11bb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:46.401589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29299af7-2e00-416b-838d-09f5268e11bb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:46.402280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29299af7-2e00-416b-838d-09f5268e11bb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:46.402792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29299af7-2e00-416b-838d-09f5268e11bb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:46.403219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29299af7-2e00-416b-838d-09f5268e11bb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:46.785459 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-29299af7-2e00-416b-838d-09f5268e11bb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:46.799420 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-29299af7-2e00-416b-838d-09f5268e11bb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.411852 Sep 05 17:29:46.800190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1297/2439] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:46 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:47.264477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f3ba1f09-0a99-4fd4-851f-6838c8df6610 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:47.265433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f3ba1f09-0a99-4fd4-851f-6838c8df6610 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:47.275259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3ba1f09-0a99-4fd4-851f-6838c8df6610 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:47.275736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3ba1f09-0a99-4fd4-851f-6838c8df6610 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:47.276184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3ba1f09-0a99-4fd4-851f-6838c8df6610 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:47.276873 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3ba1f09-0a99-4fd4-851f-6838c8df6610 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:47.277318 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3ba1f09-0a99-4fd4-851f-6838c8df6610 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:47.277732 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f3ba1f09-0a99-4fd4-851f-6838c8df6610 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:47.433313 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f3ba1f09-0a99-4fd4-851f-6838c8df6610 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:47.446715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f3ba1f09-0a99-4fd4-851f-6838c8df6610 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.188590 Sep 05 17:29:47.447469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1143/2440] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:47 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:47.825325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-68155db1-4261-424b-8429-c9af85132007 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:47.826027 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-68155db1-4261-424b-8429-c9af85132007 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:47.834222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68155db1-4261-424b-8429-c9af85132007 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:47.834796 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68155db1-4261-424b-8429-c9af85132007 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:47.835298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68155db1-4261-424b-8429-c9af85132007 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:47.836202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68155db1-4261-424b-8429-c9af85132007 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:47.836829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68155db1-4261-424b-8429-c9af85132007 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:47.837353 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68155db1-4261-424b-8429-c9af85132007 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:47.976477 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-68155db1-4261-424b-8429-c9af85132007 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:47.989150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-68155db1-4261-424b-8429-c9af85132007 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.168628 Sep 05 17:29:47.989997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1298/2441] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:47 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:48.478844 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c3d6edb1-8e5c-4f20-80e0-93b1dac25a6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:48.479573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c3d6edb1-8e5c-4f20-80e0-93b1dac25a6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:48.488009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3d6edb1-8e5c-4f20-80e0-93b1dac25a6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:48.488641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3d6edb1-8e5c-4f20-80e0-93b1dac25a6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:48.489170 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3d6edb1-8e5c-4f20-80e0-93b1dac25a6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:48.490017 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3d6edb1-8e5c-4f20-80e0-93b1dac25a6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:48.490573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3d6edb1-8e5c-4f20-80e0-93b1dac25a6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:48.491097 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c3d6edb1-8e5c-4f20-80e0-93b1dac25a6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:48.626400 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c3d6edb1-8e5c-4f20-80e0-93b1dac25a6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:48.635300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c3d6edb1-8e5c-4f20-80e0-93b1dac25a6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.162611 Sep 05 17:29:48.635939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1144/2442] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:48 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:49.014032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-350aa043-ebf8-411e-9666-d46c2f9fafde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:49.014639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-350aa043-ebf8-411e-9666-d46c2f9fafde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:49.021311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-350aa043-ebf8-411e-9666-d46c2f9fafde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:49.021793 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-350aa043-ebf8-411e-9666-d46c2f9fafde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:49.022219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-350aa043-ebf8-411e-9666-d46c2f9fafde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:49.022897 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-350aa043-ebf8-411e-9666-d46c2f9fafde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:49.023600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-350aa043-ebf8-411e-9666-d46c2f9fafde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:49.023776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-350aa043-ebf8-411e-9666-d46c2f9fafde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:49.157946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-350aa043-ebf8-411e-9666-d46c2f9fafde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:49.166970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-350aa043-ebf8-411e-9666-d46c2f9fafde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.157057 Sep 05 17:29:49.167547 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1299/2443] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:49 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:49.662964 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c9c2b83f-cc27-47ea-8c7f-216350d980a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:49.663937 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c9c2b83f-cc27-47ea-8c7f-216350d980a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:49.674834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9c2b83f-cc27-47ea-8c7f-216350d980a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:49.675643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9c2b83f-cc27-47ea-8c7f-216350d980a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:49.676407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9c2b83f-cc27-47ea-8c7f-216350d980a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:49.677529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9c2b83f-cc27-47ea-8c7f-216350d980a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:49.678281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9c2b83f-cc27-47ea-8c7f-216350d980a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:49.678976 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c9c2b83f-cc27-47ea-8c7f-216350d980a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:49.818778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c9c2b83f-cc27-47ea-8c7f-216350d980a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:49.827202 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c9c2b83f-cc27-47ea-8c7f-216350d980a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.170830 Sep 05 17:29:49.827744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1145/2444] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:49 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:50.200062 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-69271791-85ec-4cd4-846f-c39a18713f8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:50.201072 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-69271791-85ec-4cd4-846f-c39a18713f8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:50.210042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69271791-85ec-4cd4-846f-c39a18713f8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:50.210681 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69271791-85ec-4cd4-846f-c39a18713f8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:50.211260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69271791-85ec-4cd4-846f-c39a18713f8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:50.212298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69271791-85ec-4cd4-846f-c39a18713f8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:50.212752 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69271791-85ec-4cd4-846f-c39a18713f8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:50.213177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69271791-85ec-4cd4-846f-c39a18713f8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:50.360818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-69271791-85ec-4cd4-846f-c39a18713f8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:50.369726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-69271791-85ec-4cd4-846f-c39a18713f8c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.175038 Sep 05 17:29:50.370307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1300/2445] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:50 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:50.863405 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1ce6651a-b75d-4a78-af88-37eff36cfe90 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:50.864420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1ce6651a-b75d-4a78-af88-37eff36cfe90 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:50.875824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ce6651a-b75d-4a78-af88-37eff36cfe90 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:50.876695 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ce6651a-b75d-4a78-af88-37eff36cfe90 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:50.877417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ce6651a-b75d-4a78-af88-37eff36cfe90 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:50.878564 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ce6651a-b75d-4a78-af88-37eff36cfe90 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:50.879478 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ce6651a-b75d-4a78-af88-37eff36cfe90 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:50.880219 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ce6651a-b75d-4a78-af88-37eff36cfe90 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:51.013136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1ce6651a-b75d-4a78-af88-37eff36cfe90 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:51.021695 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1ce6651a-b75d-4a78-af88-37eff36cfe90 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.164833 Sep 05 17:29:51.022316 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1146/2446] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:50 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:51.392825 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-427992cf-4f88-4ad8-9823-fbc23a26b82f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:51.393422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-427992cf-4f88-4ad8-9823-fbc23a26b82f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:51.400425 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-427992cf-4f88-4ad8-9823-fbc23a26b82f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:51.400910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-427992cf-4f88-4ad8-9823-fbc23a26b82f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:51.401345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-427992cf-4f88-4ad8-9823-fbc23a26b82f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:51.402068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-427992cf-4f88-4ad8-9823-fbc23a26b82f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:51.402521 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-427992cf-4f88-4ad8-9823-fbc23a26b82f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:51.402941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-427992cf-4f88-4ad8-9823-fbc23a26b82f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:51.534047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-427992cf-4f88-4ad8-9823-fbc23a26b82f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:51.542838 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-427992cf-4f88-4ad8-9823-fbc23a26b82f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.153992 Sep 05 17:29:51.543418 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1301/2447] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:51 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:52.049699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c0bd90d5-ded8-4f07-aaf7-a6680db77925 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:52.050704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c0bd90d5-ded8-4f07-aaf7-a6680db77925 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:52.059426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0bd90d5-ded8-4f07-aaf7-a6680db77925 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:52.059904 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0bd90d5-ded8-4f07-aaf7-a6680db77925 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:52.060373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0bd90d5-ded8-4f07-aaf7-a6680db77925 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:52.061045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0bd90d5-ded8-4f07-aaf7-a6680db77925 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:52.061487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0bd90d5-ded8-4f07-aaf7-a6680db77925 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:52.061900 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c0bd90d5-ded8-4f07-aaf7-a6680db77925 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:52.202451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c0bd90d5-ded8-4f07-aaf7-a6680db77925 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:52.214693 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c0bd90d5-ded8-4f07-aaf7-a6680db77925 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.171357 Sep 05 17:29:52.215690 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1147/2448] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:52 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:52.569856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5786027e-156f-4466-9d64-883debd4a655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:52.570843 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5786027e-156f-4466-9d64-883debd4a655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:52.582128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5786027e-156f-4466-9d64-883debd4a655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:52.582932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5786027e-156f-4466-9d64-883debd4a655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:52.583651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5786027e-156f-4466-9d64-883debd4a655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:52.584834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5786027e-156f-4466-9d64-883debd4a655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:52.585779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5786027e-156f-4466-9d64-883debd4a655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:52.586540 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5786027e-156f-4466-9d64-883debd4a655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:52.728770 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5786027e-156f-4466-9d64-883debd4a655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:52.737632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5786027e-156f-4466-9d64-883debd4a655 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.174486 Sep 05 17:29:52.738204 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1302/2449] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:52 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:53.239352 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4bda64c7-265c-4eab-a569-f3d471a427a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:53.239990 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4bda64c7-265c-4eab-a569-f3d471a427a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:53.246869 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4bda64c7-265c-4eab-a569-f3d471a427a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:53.247386 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4bda64c7-265c-4eab-a569-f3d471a427a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:53.247816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4bda64c7-265c-4eab-a569-f3d471a427a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:53.248553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4bda64c7-265c-4eab-a569-f3d471a427a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:53.249031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4bda64c7-265c-4eab-a569-f3d471a427a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:53.249448 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4bda64c7-265c-4eab-a569-f3d471a427a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:53.399227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4bda64c7-265c-4eab-a569-f3d471a427a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:53.408494 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4bda64c7-265c-4eab-a569-f3d471a427a9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.173126 Sep 05 17:29:53.409141 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1148/2450] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:53 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:53.767623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-df63c055-325e-4f02-b979-4893b134cbd8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:53.768599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-df63c055-325e-4f02-b979-4893b134cbd8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:53.779747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df63c055-325e-4f02-b979-4893b134cbd8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:53.780606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df63c055-325e-4f02-b979-4893b134cbd8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:53.781316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df63c055-325e-4f02-b979-4893b134cbd8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:53.782454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df63c055-325e-4f02-b979-4893b134cbd8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:53.783209 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df63c055-325e-4f02-b979-4893b134cbd8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:53.783913 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df63c055-325e-4f02-b979-4893b134cbd8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:53.926093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-df63c055-325e-4f02-b979-4893b134cbd8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:53.936643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-df63c055-325e-4f02-b979-4893b134cbd8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.176050 Sep 05 17:29:53.937217 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1303/2451] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:53 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:54.432121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-90ee1281-bd34-4686-933a-18c0d0872d61 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:54.432750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-90ee1281-bd34-4686-933a-18c0d0872d61 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:54.439724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90ee1281-bd34-4686-933a-18c0d0872d61 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:54.440240 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90ee1281-bd34-4686-933a-18c0d0872d61 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:54.440675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90ee1281-bd34-4686-933a-18c0d0872d61 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:54.441366 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90ee1281-bd34-4686-933a-18c0d0872d61 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:54.441848 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90ee1281-bd34-4686-933a-18c0d0872d61 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:54.442271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-90ee1281-bd34-4686-933a-18c0d0872d61 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:54.579701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-90ee1281-bd34-4686-933a-18c0d0872d61 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:54.588325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-90ee1281-bd34-4686-933a-18c0d0872d61 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.160078 Sep 05 17:29:54.588907 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1149/2452] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:54 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:54.959560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-146a2849-f8b2-4b6c-a3cf-bcee266b4bc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:54.960305 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-146a2849-f8b2-4b6c-a3cf-bcee266b4bc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:54.968468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-146a2849-f8b2-4b6c-a3cf-bcee266b4bc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:54.968948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-146a2849-f8b2-4b6c-a3cf-bcee266b4bc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:54.969379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-146a2849-f8b2-4b6c-a3cf-bcee266b4bc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:54.970070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-146a2849-f8b2-4b6c-a3cf-bcee266b4bc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:54.970519 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-146a2849-f8b2-4b6c-a3cf-bcee266b4bc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:54.970941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-146a2849-f8b2-4b6c-a3cf-bcee266b4bc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:55.112619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-146a2849-f8b2-4b6c-a3cf-bcee266b4bc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:55.126701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-146a2849-f8b2-4b6c-a3cf-bcee266b4bc4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.170950 Sep 05 17:29:55.127525 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1304/2453] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:54 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:55.616698 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-898970fd-d258-4030-86c1-e5012f8bd32e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:55.617619 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-898970fd-d258-4030-86c1-e5012f8bd32e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:55.626167 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-898970fd-d258-4030-86c1-e5012f8bd32e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:55.626643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-898970fd-d258-4030-86c1-e5012f8bd32e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:55.627065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-898970fd-d258-4030-86c1-e5012f8bd32e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:55.627747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-898970fd-d258-4030-86c1-e5012f8bd32e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:55.628191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-898970fd-d258-4030-86c1-e5012f8bd32e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:55.628639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-898970fd-d258-4030-86c1-e5012f8bd32e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:55.765038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-898970fd-d258-4030-86c1-e5012f8bd32e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:55.773793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-898970fd-d258-4030-86c1-e5012f8bd32e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.163823 Sep 05 17:29:55.774361 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1150/2454] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:55 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:56.159955 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a8482d73-ce7f-4625-956f-534f6f040d70 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:56.160978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a8482d73-ce7f-4625-956f-534f6f040d70 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:56.171206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8482d73-ce7f-4625-956f-534f6f040d70 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:56.171994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8482d73-ce7f-4625-956f-534f6f040d70 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:56.172772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8482d73-ce7f-4625-956f-534f6f040d70 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:56.173866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8482d73-ce7f-4625-956f-534f6f040d70 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:56.174607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8482d73-ce7f-4625-956f-534f6f040d70 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:56.175289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8482d73-ce7f-4625-956f-534f6f040d70 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:56.316642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a8482d73-ce7f-4625-956f-534f6f040d70 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:56.325739 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a8482d73-ce7f-4625-956f-534f6f040d70 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.172933 Sep 05 17:29:56.326334 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1305/2455] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:56 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:56.797608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c96c560b-61b4-4e81-a9d6-552c1a55e678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:56.798270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c96c560b-61b4-4e81-a9d6-552c1a55e678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:56.805161 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c96c560b-61b4-4e81-a9d6-552c1a55e678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:56.805643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c96c560b-61b4-4e81-a9d6-552c1a55e678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:56.806066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c96c560b-61b4-4e81-a9d6-552c1a55e678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:56.806757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c96c560b-61b4-4e81-a9d6-552c1a55e678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:56.807201 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c96c560b-61b4-4e81-a9d6-552c1a55e678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:56.807616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c96c560b-61b4-4e81-a9d6-552c1a55e678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:56.956984 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c96c560b-61b4-4e81-a9d6-552c1a55e678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:56.971447 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c96c560b-61b4-4e81-a9d6-552c1a55e678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.177682 Sep 05 17:29:56.972186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1151/2456] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:56 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:57.352347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8b548c08-0991-4897-bc5f-7343ed8c3f01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:57.353088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8b548c08-0991-4897-bc5f-7343ed8c3f01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:57.361041 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b548c08-0991-4897-bc5f-7343ed8c3f01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:57.361598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b548c08-0991-4897-bc5f-7343ed8c3f01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:57.362108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b548c08-0991-4897-bc5f-7343ed8c3f01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:57.362903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b548c08-0991-4897-bc5f-7343ed8c3f01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:57.363422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b548c08-0991-4897-bc5f-7343ed8c3f01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:57.363914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b548c08-0991-4897-bc5f-7343ed8c3f01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:57.500720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8b548c08-0991-4897-bc5f-7343ed8c3f01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:57.510640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8b548c08-0991-4897-bc5f-7343ed8c3f01 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.163077 Sep 05 17:29:57.511222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1306/2457] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:57 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:57.998910 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f083d7ff-2160-47fc-9ede-b3fce85c2704 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:57.999667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f083d7ff-2160-47fc-9ede-b3fce85c2704 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:58.007512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f083d7ff-2160-47fc-9ede-b3fce85c2704 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:58.008082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f083d7ff-2160-47fc-9ede-b3fce85c2704 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:58.008621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f083d7ff-2160-47fc-9ede-b3fce85c2704 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:58.009422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f083d7ff-2160-47fc-9ede-b3fce85c2704 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:58.009988 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f083d7ff-2160-47fc-9ede-b3fce85c2704 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:58.010480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f083d7ff-2160-47fc-9ede-b3fce85c2704 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:58.149463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f083d7ff-2160-47fc-9ede-b3fce85c2704 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:58.158259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f083d7ff-2160-47fc-9ede-b3fce85c2704 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.165212 Sep 05 17:29:58.158808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1152/2458] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:57 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:58.538555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0f77c69a-1a72-4ec2-867f-407eee08ab26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:58.539460 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0f77c69a-1a72-4ec2-867f-407eee08ab26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:58.548283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f77c69a-1a72-4ec2-867f-407eee08ab26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:58.548840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f77c69a-1a72-4ec2-867f-407eee08ab26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:58.549342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f77c69a-1a72-4ec2-867f-407eee08ab26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:58.550138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f77c69a-1a72-4ec2-867f-407eee08ab26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:58.550659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f77c69a-1a72-4ec2-867f-407eee08ab26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:58.551147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f77c69a-1a72-4ec2-867f-407eee08ab26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:58.694248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0f77c69a-1a72-4ec2-867f-407eee08ab26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:58.702977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0f77c69a-1a72-4ec2-867f-407eee08ab26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.170716 Sep 05 17:29:58.703602 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1307/2459] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:58 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:59.190946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ff050a3f-ae7b-4cf4-92bb-17327b0a14de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:59.191584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ff050a3f-ae7b-4cf4-92bb-17327b0a14de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:59.198192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff050a3f-ae7b-4cf4-92bb-17327b0a14de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:59.198683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff050a3f-ae7b-4cf4-92bb-17327b0a14de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:59.199093 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff050a3f-ae7b-4cf4-92bb-17327b0a14de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:59.199753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff050a3f-ae7b-4cf4-92bb-17327b0a14de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:59.200324 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff050a3f-ae7b-4cf4-92bb-17327b0a14de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:59.200733 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ff050a3f-ae7b-4cf4-92bb-17327b0a14de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:59.338679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ff050a3f-ae7b-4cf4-92bb-17327b0a14de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:59.347926 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ff050a3f-ae7b-4cf4-92bb-17327b0a14de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.160962 Sep 05 17:29:59.348731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1153/2460] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:59 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:29:59.730847 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-44b6ac68-64c5-4ccf-bc3e-14904b010c2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:29:59.731799 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-44b6ac68-64c5-4ccf-bc3e-14904b010c2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:29:59.742746 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44b6ac68-64c5-4ccf-bc3e-14904b010c2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:59.743530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44b6ac68-64c5-4ccf-bc3e-14904b010c2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:59.744256 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44b6ac68-64c5-4ccf-bc3e-14904b010c2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:59.745418 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44b6ac68-64c5-4ccf-bc3e-14904b010c2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:29:59.746157 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44b6ac68-64c5-4ccf-bc3e-14904b010c2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:29:59.746848 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44b6ac68-64c5-4ccf-bc3e-14904b010c2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:29:59.890210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-44b6ac68-64c5-4ccf-bc3e-14904b010c2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:29:59.898585 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-44b6ac68-64c5-4ccf-bc3e-14904b010c2c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.174491 Sep 05 17:29:59.899173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1308/2461] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:29:59 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:00.372379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f7d66b67-d3e2-46a5-b0a6-e219eb4d40b6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:00.373100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f7d66b67-d3e2-46a5-b0a6-e219eb4d40b6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:00.379601 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f7d66b67-d3e2-46a5-b0a6-e219eb4d40b6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:00.380090 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f7d66b67-d3e2-46a5-b0a6-e219eb4d40b6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:00.380665 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f7d66b67-d3e2-46a5-b0a6-e219eb4d40b6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:00.381370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f7d66b67-d3e2-46a5-b0a6-e219eb4d40b6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:00.381833 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f7d66b67-d3e2-46a5-b0a6-e219eb4d40b6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:00.382319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f7d66b67-d3e2-46a5-b0a6-e219eb4d40b6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:00.515339 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f7d66b67-d3e2-46a5-b0a6-e219eb4d40b6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:00.523938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f7d66b67-d3e2-46a5-b0a6-e219eb4d40b6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.155509 Sep 05 17:30:00.524533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1154/2462] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:00 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:00.929396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aee03e13-4ab9-488a-8560-b6a2d5538600 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:00.930536 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aee03e13-4ab9-488a-8560-b6a2d5538600 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:00.942283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aee03e13-4ab9-488a-8560-b6a2d5538600 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:00.943151 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aee03e13-4ab9-488a-8560-b6a2d5538600 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:00.943869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aee03e13-4ab9-488a-8560-b6a2d5538600 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:00.945056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aee03e13-4ab9-488a-8560-b6a2d5538600 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:00.945763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aee03e13-4ab9-488a-8560-b6a2d5538600 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:00.946501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aee03e13-4ab9-488a-8560-b6a2d5538600 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:01.034935 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-29378a62-8906-4966-824d-05dd0514a367 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:01.035446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-29378a62-8906-4966-824d-05dd0514a367 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:01.037479 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=52 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:30:01.042861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-29378a62-8906-4966-824d-05dd0514a367 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:01.043348 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-29378a62-8906-4966-824d-05dd0514a367 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:01.043777 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-29378a62-8906-4966-824d-05dd0514a367 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:01.044621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-29378a62-8906-4966-824d-05dd0514a367 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:01.045081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-29378a62-8906-4966-824d-05dd0514a367 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:01.045500 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-29378a62-8906-4966-824d-05dd0514a367 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:01.059660 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:30:01.069996 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-29378a62-8906-4966-824d-05dd0514a367 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5/ips" status: 200 len: 144 microversion: 2.1 time: 0.039272 Sep 05 17:30:01.070576 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1155/2463] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Sep 5 17:30:01 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5/ips => generated 144 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:30:01.086075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aee03e13-4ab9-488a-8560-b6a2d5538600 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:01.095098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aee03e13-4ab9-488a-8560-b6a2d5538600 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.173882 Sep 05 17:30:01.095804 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1309/2464] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:00 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:01.549606 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b7d0e007-7991-4a04-ab4c-c1e4c8bc4e79 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:01.550297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b7d0e007-7991-4a04-ab4c-c1e4c8bc4e79 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:01.558586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7d0e007-7991-4a04-ab4c-c1e4c8bc4e79 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:01.559185 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7d0e007-7991-4a04-ab4c-c1e4c8bc4e79 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:01.559720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7d0e007-7991-4a04-ab4c-c1e4c8bc4e79 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:01.560675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7d0e007-7991-4a04-ab4c-c1e4c8bc4e79 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:01.561368 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7d0e007-7991-4a04-ab4c-c1e4c8bc4e79 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:01.561892 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7d0e007-7991-4a04-ab4c-c1e4c8bc4e79 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:01.696170 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b7d0e007-7991-4a04-ab4c-c1e4c8bc4e79 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:01.705600 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b7d0e007-7991-4a04-ab4c-c1e4c8bc4e79 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.161252 Sep 05 17:30:01.706181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1156/2465] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:01 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:02.118868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6d6f80cf-266a-4e16-ae36-70dc1117e7d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:02.119494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6d6f80cf-266a-4e16-ae36-70dc1117e7d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:02.122036 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=52 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:30:02.127577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d6f80cf-266a-4e16-ae36-70dc1117e7d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:02.127929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d6f80cf-266a-4e16-ae36-70dc1117e7d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:02.128438 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d6f80cf-266a-4e16-ae36-70dc1117e7d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:02.129098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d6f80cf-266a-4e16-ae36-70dc1117e7d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:02.129632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d6f80cf-266a-4e16-ae36-70dc1117e7d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:02.130113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d6f80cf-266a-4e16-ae36-70dc1117e7d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:02.268018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6d6f80cf-266a-4e16-ae36-70dc1117e7d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:02.276347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6d6f80cf-266a-4e16-ae36-70dc1117e7d8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.161616 Sep 05 17:30:02.276918 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1310/2466] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:02 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:02.730555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-35810816-74a7-4e9c-a315-8ea888e23af7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:02.731130 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-35810816-74a7-4e9c-a315-8ea888e23af7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:02.738342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35810816-74a7-4e9c-a315-8ea888e23af7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:02.738824 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35810816-74a7-4e9c-a315-8ea888e23af7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:02.739247 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35810816-74a7-4e9c-a315-8ea888e23af7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:02.739933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35810816-74a7-4e9c-a315-8ea888e23af7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:02.740541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35810816-74a7-4e9c-a315-8ea888e23af7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:02.740961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-35810816-74a7-4e9c-a315-8ea888e23af7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:02.880350 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-35810816-74a7-4e9c-a315-8ea888e23af7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:02.891431 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-35810816-74a7-4e9c-a315-8ea888e23af7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.164959 Sep 05 17:30:02.892009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1157/2467] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:02 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:03.303698 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5f00bf1a-6af3-46b9-95c0-3552c7f73475 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:03.304748 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5f00bf1a-6af3-46b9-95c0-3552c7f73475 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:03.314181 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f00bf1a-6af3-46b9-95c0-3552c7f73475 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:03.314667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f00bf1a-6af3-46b9-95c0-3552c7f73475 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:03.315099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f00bf1a-6af3-46b9-95c0-3552c7f73475 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:03.315794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f00bf1a-6af3-46b9-95c0-3552c7f73475 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:03.316282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f00bf1a-6af3-46b9-95c0-3552c7f73475 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:03.316710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f00bf1a-6af3-46b9-95c0-3552c7f73475 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:03.319412 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:30:03.450953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f00bf1a-6af3-46b9-95c0-3552c7f73475 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:03.459506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5f00bf1a-6af3-46b9-95c0-3552c7f73475 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.162280 Sep 05 17:30:03.460082 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1311/2468] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:03 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:03.919276 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ccbcf86c-257c-47b0-bb7b-e278b48999b7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:03.919995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ccbcf86c-257c-47b0-bb7b-e278b48999b7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:03.927641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ccbcf86c-257c-47b0-bb7b-e278b48999b7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:03.928200 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ccbcf86c-257c-47b0-bb7b-e278b48999b7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:03.928695 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ccbcf86c-257c-47b0-bb7b-e278b48999b7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:03.929463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ccbcf86c-257c-47b0-bb7b-e278b48999b7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:03.929964 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ccbcf86c-257c-47b0-bb7b-e278b48999b7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:03.930439 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ccbcf86c-257c-47b0-bb7b-e278b48999b7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:04.070658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ccbcf86c-257c-47b0-bb7b-e278b48999b7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:04.083954 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ccbcf86c-257c-47b0-bb7b-e278b48999b7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.171135 Sep 05 17:30:04.084812 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1158/2469] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:03 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:04.487283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a67c6ca9-0128-4fa8-ae71-027fa808619e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:04.487987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a67c6ca9-0128-4fa8-ae71-027fa808619e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:04.496472 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a67c6ca9-0128-4fa8-ae71-027fa808619e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:04.497376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a67c6ca9-0128-4fa8-ae71-027fa808619e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:04.498359 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a67c6ca9-0128-4fa8-ae71-027fa808619e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:04.499213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a67c6ca9-0128-4fa8-ae71-027fa808619e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:04.499832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a67c6ca9-0128-4fa8-ae71-027fa808619e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:04.500401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a67c6ca9-0128-4fa8-ae71-027fa808619e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:04.637201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a67c6ca9-0128-4fa8-ae71-027fa808619e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:04.646661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a67c6ca9-0128-4fa8-ae71-027fa808619e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.165245 Sep 05 17:30:04.647240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1312/2470] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:04 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:05.112280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-df66abff-7784-41a3-a6ff-26dc0eac8ebc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:05.112989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-df66abff-7784-41a3-a6ff-26dc0eac8ebc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:05.120923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df66abff-7784-41a3-a6ff-26dc0eac8ebc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:05.121525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df66abff-7784-41a3-a6ff-26dc0eac8ebc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:05.122492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df66abff-7784-41a3-a6ff-26dc0eac8ebc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:05.123024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df66abff-7784-41a3-a6ff-26dc0eac8ebc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:05.123562 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df66abff-7784-41a3-a6ff-26dc0eac8ebc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:05.124087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df66abff-7784-41a3-a6ff-26dc0eac8ebc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:05.262659 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-df66abff-7784-41a3-a6ff-26dc0eac8ebc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:05.271278 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-df66abff-7784-41a3-a6ff-26dc0eac8ebc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.163623 Sep 05 17:30:05.271846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1159/2471] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:05 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:05.672977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-00fc4eaf-aa83-4839-a80e-2d63c214e4f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:05.673697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-00fc4eaf-aa83-4839-a80e-2d63c214e4f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:05.682190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00fc4eaf-aa83-4839-a80e-2d63c214e4f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:05.682787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00fc4eaf-aa83-4839-a80e-2d63c214e4f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:05.683315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00fc4eaf-aa83-4839-a80e-2d63c214e4f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:05.684174 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00fc4eaf-aa83-4839-a80e-2d63c214e4f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:05.685086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00fc4eaf-aa83-4839-a80e-2d63c214e4f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:05.685570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00fc4eaf-aa83-4839-a80e-2d63c214e4f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:05.828567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-00fc4eaf-aa83-4839-a80e-2d63c214e4f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:05.836900 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-00fc4eaf-aa83-4839-a80e-2d63c214e4f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.169330 Sep 05 17:30:05.837473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1313/2472] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:05 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:06.295625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9c13f7c7-f4d9-4553-860d-6e4fca688059 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:06.296297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9c13f7c7-f4d9-4553-860d-6e4fca688059 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:06.302996 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c13f7c7-f4d9-4553-860d-6e4fca688059 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:06.303478 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c13f7c7-f4d9-4553-860d-6e4fca688059 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:06.303909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c13f7c7-f4d9-4553-860d-6e4fca688059 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:06.304640 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c13f7c7-f4d9-4553-860d-6e4fca688059 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:06.305083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c13f7c7-f4d9-4553-860d-6e4fca688059 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:06.305505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c13f7c7-f4d9-4553-860d-6e4fca688059 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:06.440359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9c13f7c7-f4d9-4553-860d-6e4fca688059 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:06.449134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9c13f7c7-f4d9-4553-860d-6e4fca688059 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.157951 Sep 05 17:30:06.449698 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1160/2473] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:06 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:06.864922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0bd9cfd5-1f23-40f9-b308-536a0da97be1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:06.866013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0bd9cfd5-1f23-40f9-b308-536a0da97be1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:06.877554 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bd9cfd5-1f23-40f9-b308-536a0da97be1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:06.878396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bd9cfd5-1f23-40f9-b308-536a0da97be1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:06.879112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bd9cfd5-1f23-40f9-b308-536a0da97be1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:06.880297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bd9cfd5-1f23-40f9-b308-536a0da97be1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:06.881196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bd9cfd5-1f23-40f9-b308-536a0da97be1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:06.881794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0bd9cfd5-1f23-40f9-b308-536a0da97be1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:07.020832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0bd9cfd5-1f23-40f9-b308-536a0da97be1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:07.029651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0bd9cfd5-1f23-40f9-b308-536a0da97be1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.171263 Sep 05 17:30:07.030263 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1314/2474] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:06 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:07.479792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0e32cae9-d95f-41ef-8afa-1cfd4432fb1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:07.480393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0e32cae9-d95f-41ef-8afa-1cfd4432fb1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:07.488321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0e32cae9-d95f-41ef-8afa-1cfd4432fb1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:07.490906 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0e32cae9-d95f-41ef-8afa-1cfd4432fb1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:07.492081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0e32cae9-d95f-41ef-8afa-1cfd4432fb1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:07.493175 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0e32cae9-d95f-41ef-8afa-1cfd4432fb1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:07.493488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0e32cae9-d95f-41ef-8afa-1cfd4432fb1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:07.493907 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0e32cae9-d95f-41ef-8afa-1cfd4432fb1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:07.640007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0e32cae9-d95f-41ef-8afa-1cfd4432fb1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:07.649369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0e32cae9-d95f-41ef-8afa-1cfd4432fb1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.175846 Sep 05 17:30:07.650099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1161/2475] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:07 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:08.056735 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6dd93eeb-6543-4462-97d9-0eadf8868458 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:08.057740 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6dd93eeb-6543-4462-97d9-0eadf8868458 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:08.065500 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd93eeb-6543-4462-97d9-0eadf8868458 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:08.065960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd93eeb-6543-4462-97d9-0eadf8868458 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:08.066401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd93eeb-6543-4462-97d9-0eadf8868458 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:08.067088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd93eeb-6543-4462-97d9-0eadf8868458 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:08.067530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd93eeb-6543-4462-97d9-0eadf8868458 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:08.067967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dd93eeb-6543-4462-97d9-0eadf8868458 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:08.208258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6dd93eeb-6543-4462-97d9-0eadf8868458 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:08.220677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6dd93eeb-6543-4462-97d9-0eadf8868458 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.170281 Sep 05 17:30:08.221441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1315/2476] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:08 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:08.677758 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6bc2dd0e-904b-476c-aa26-e1fa71ca63cc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:08.678666 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6bc2dd0e-904b-476c-aa26-e1fa71ca63cc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:08.689439 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bc2dd0e-904b-476c-aa26-e1fa71ca63cc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:08.690072 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bc2dd0e-904b-476c-aa26-e1fa71ca63cc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:08.690552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bc2dd0e-904b-476c-aa26-e1fa71ca63cc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:08.691532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bc2dd0e-904b-476c-aa26-e1fa71ca63cc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:08.692131 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bc2dd0e-904b-476c-aa26-e1fa71ca63cc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:08.692712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bc2dd0e-904b-476c-aa26-e1fa71ca63cc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:08.842404 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6bc2dd0e-904b-476c-aa26-e1fa71ca63cc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:08.855849 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6bc2dd0e-904b-476c-aa26-e1fa71ca63cc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.184824 Sep 05 17:30:08.856739 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1162/2477] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:08 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:09.247440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d8504bc9-70ee-4325-b85b-461aad8929ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:09.248624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d8504bc9-70ee-4325-b85b-461aad8929ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:09.255894 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8504bc9-70ee-4325-b85b-461aad8929ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:09.256510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8504bc9-70ee-4325-b85b-461aad8929ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:09.256992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8504bc9-70ee-4325-b85b-461aad8929ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:09.257687 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8504bc9-70ee-4325-b85b-461aad8929ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:09.258138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8504bc9-70ee-4325-b85b-461aad8929ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:09.258556 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8504bc9-70ee-4325-b85b-461aad8929ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:09.393707 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d8504bc9-70ee-4325-b85b-461aad8929ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:09.404516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d8504bc9-70ee-4325-b85b-461aad8929ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.161172 Sep 05 17:30:09.405071 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1316/2478] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:09 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:09.890813 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6f343060-8e90-49d0-b744-651e70219403 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:09.891496 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6f343060-8e90-49d0-b744-651e70219403 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:09.899223 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f343060-8e90-49d0-b744-651e70219403 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:09.899753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f343060-8e90-49d0-b744-651e70219403 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:09.900265 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f343060-8e90-49d0-b744-651e70219403 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:09.901023 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f343060-8e90-49d0-b744-651e70219403 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:09.901519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f343060-8e90-49d0-b744-651e70219403 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:09.901983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6f343060-8e90-49d0-b744-651e70219403 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:10.033440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6f343060-8e90-49d0-b744-651e70219403 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:10.041991 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6f343060-8e90-49d0-b744-651e70219403 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.157389 Sep 05 17:30:10.042580 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1163/2479] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:09 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:10.432238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b5677981-096b-4b73-831a-56edd011f3e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:10.433250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b5677981-096b-4b73-831a-56edd011f3e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:10.444117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5677981-096b-4b73-831a-56edd011f3e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:10.444957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5677981-096b-4b73-831a-56edd011f3e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:10.445665 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5677981-096b-4b73-831a-56edd011f3e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:10.446791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5677981-096b-4b73-831a-56edd011f3e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:10.447523 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5677981-096b-4b73-831a-56edd011f3e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:10.448213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5677981-096b-4b73-831a-56edd011f3e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:10.590363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b5677981-096b-4b73-831a-56edd011f3e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:10.603550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b5677981-096b-4b73-831a-56edd011f3e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.177553 Sep 05 17:30:10.604426 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1317/2480] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:10 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:11.070051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4f6b3dd5-8f1f-408a-b2fe-70d935dd32e7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:11.071203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4f6b3dd5-8f1f-408a-b2fe-70d935dd32e7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:11.081892 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f6b3dd5-8f1f-408a-b2fe-70d935dd32e7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:11.082684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f6b3dd5-8f1f-408a-b2fe-70d935dd32e7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:11.083389 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f6b3dd5-8f1f-408a-b2fe-70d935dd32e7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:11.084571 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f6b3dd5-8f1f-408a-b2fe-70d935dd32e7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:11.085315 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f6b3dd5-8f1f-408a-b2fe-70d935dd32e7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:11.086009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f6b3dd5-8f1f-408a-b2fe-70d935dd32e7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:11.231446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4f6b3dd5-8f1f-408a-b2fe-70d935dd32e7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:11.239985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4f6b3dd5-8f1f-408a-b2fe-70d935dd32e7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.176517 Sep 05 17:30:11.240632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1164/2481] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:11 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:11.629939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5a1ed3d5-0c72-42c7-b261-ee580923cbe4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:11.630795 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5a1ed3d5-0c72-42c7-b261-ee580923cbe4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:11.640202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a1ed3d5-0c72-42c7-b261-ee580923cbe4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:11.641137 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a1ed3d5-0c72-42c7-b261-ee580923cbe4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:11.641750 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a1ed3d5-0c72-42c7-b261-ee580923cbe4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:11.642713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a1ed3d5-0c72-42c7-b261-ee580923cbe4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:11.643349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a1ed3d5-0c72-42c7-b261-ee580923cbe4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:11.643941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a1ed3d5-0c72-42c7-b261-ee580923cbe4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:11.778494 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5a1ed3d5-0c72-42c7-b261-ee580923cbe4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:11.786948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5a1ed3d5-0c72-42c7-b261-ee580923cbe4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.162783 Sep 05 17:30:11.787550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1318/2482] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:11 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:30:12.266650 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3cfdf3ac-e2c1-4310-9435-1788abfa55f9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:12.267575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3cfdf3ac-e2c1-4310-9435-1788abfa55f9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:12.277942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cfdf3ac-e2c1-4310-9435-1788abfa55f9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:12.278575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cfdf3ac-e2c1-4310-9435-1788abfa55f9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:12.279104 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cfdf3ac-e2c1-4310-9435-1788abfa55f9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:12.279820 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cfdf3ac-e2c1-4310-9435-1788abfa55f9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:12.280305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cfdf3ac-e2c1-4310-9435-1788abfa55f9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:12.280727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cfdf3ac-e2c1-4310-9435-1788abfa55f9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:12.423065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3cfdf3ac-e2c1-4310-9435-1788abfa55f9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:12.432187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3cfdf3ac-e2c1-4310-9435-1788abfa55f9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.171684 Sep 05 17:30:12.432734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1165/2483] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:12 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:12.822580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0c8c359d-d807-4420-b6ff-be2840b511df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:12.823526 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0c8c359d-d807-4420-b6ff-be2840b511df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:12.831508 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c8c359d-d807-4420-b6ff-be2840b511df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:12.831989 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c8c359d-d807-4420-b6ff-be2840b511df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:12.832449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c8c359d-d807-4420-b6ff-be2840b511df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:12.833140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c8c359d-d807-4420-b6ff-be2840b511df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:12.833587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c8c359d-d807-4420-b6ff-be2840b511df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:12.834010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c8c359d-d807-4420-b6ff-be2840b511df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:12.971468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0c8c359d-d807-4420-b6ff-be2840b511df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:12.979964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0c8c359d-d807-4420-b6ff-be2840b511df tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.164131 Sep 05 17:30:12.980569 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1319/2484] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:12 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:13.455523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3c7c0b3a-3b47-4a26-a97b-9233598f010c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:13.456137 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3c7c0b3a-3b47-4a26-a97b-9233598f010c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:13.462547 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c7c0b3a-3b47-4a26-a97b-9233598f010c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:13.463033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c7c0b3a-3b47-4a26-a97b-9233598f010c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:13.463459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c7c0b3a-3b47-4a26-a97b-9233598f010c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:13.464278 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c7c0b3a-3b47-4a26-a97b-9233598f010c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:13.464615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c7c0b3a-3b47-4a26-a97b-9233598f010c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:13.465372 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3c7c0b3a-3b47-4a26-a97b-9233598f010c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:13.609279 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3c7c0b3a-3b47-4a26-a97b-9233598f010c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:13.618697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3c7c0b3a-3b47-4a26-a97b-9233598f010c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.167386 Sep 05 17:30:13.619241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1166/2485] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:13 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:14.004185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c85b1014-1445-44c3-89df-cc0d33c35bde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:14.004802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c85b1014-1445-44c3-89df-cc0d33c35bde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:14.012102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c85b1014-1445-44c3-89df-cc0d33c35bde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:14.012617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c85b1014-1445-44c3-89df-cc0d33c35bde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:14.013055 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c85b1014-1445-44c3-89df-cc0d33c35bde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:14.013743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c85b1014-1445-44c3-89df-cc0d33c35bde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:14.014199 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c85b1014-1445-44c3-89df-cc0d33c35bde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:14.014790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c85b1014-1445-44c3-89df-cc0d33c35bde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:14.152696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c85b1014-1445-44c3-89df-cc0d33c35bde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:14.165281 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c85b1014-1445-44c3-89df-cc0d33c35bde tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.164818 Sep 05 17:30:14.165836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1320/2486] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:13 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:14.645124 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5023506e-66cc-40e7-b63f-73ef4db61d8f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:14.645719 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5023506e-66cc-40e7-b63f-73ef4db61d8f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:14.656402 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5023506e-66cc-40e7-b63f-73ef4db61d8f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:14.656883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5023506e-66cc-40e7-b63f-73ef4db61d8f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:14.657317 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5023506e-66cc-40e7-b63f-73ef4db61d8f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:14.658002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5023506e-66cc-40e7-b63f-73ef4db61d8f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:14.658451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5023506e-66cc-40e7-b63f-73ef4db61d8f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:14.658866 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5023506e-66cc-40e7-b63f-73ef4db61d8f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:14.795150 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5023506e-66cc-40e7-b63f-73ef4db61d8f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:14.803817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5023506e-66cc-40e7-b63f-73ef4db61d8f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.165233 Sep 05 17:30:14.804419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1167/2487] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:14 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:15.191721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c093d0e5-45e3-4e3f-9a80-70867892a6fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:15.192373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c093d0e5-45e3-4e3f-9a80-70867892a6fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:15.199214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c093d0e5-45e3-4e3f-9a80-70867892a6fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:15.199704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c093d0e5-45e3-4e3f-9a80-70867892a6fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:15.200192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c093d0e5-45e3-4e3f-9a80-70867892a6fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:15.201054 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c093d0e5-45e3-4e3f-9a80-70867892a6fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:15.201552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c093d0e5-45e3-4e3f-9a80-70867892a6fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:15.201983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c093d0e5-45e3-4e3f-9a80-70867892a6fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:15.345628 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c093d0e5-45e3-4e3f-9a80-70867892a6fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:15.353706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c093d0e5-45e3-4e3f-9a80-70867892a6fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.166074 Sep 05 17:30:15.354280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1321/2488] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:15 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:15.830018 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6765c18b-76dd-46ab-98c3-a3471350e342 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:15.830724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6765c18b-76dd-46ab-98c3-a3471350e342 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:15.838449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6765c18b-76dd-46ab-98c3-a3471350e342 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:15.838856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6765c18b-76dd-46ab-98c3-a3471350e342 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:15.839373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6765c18b-76dd-46ab-98c3-a3471350e342 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:15.840434 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6765c18b-76dd-46ab-98c3-a3471350e342 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:15.840913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6765c18b-76dd-46ab-98c3-a3471350e342 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:15.841327 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6765c18b-76dd-46ab-98c3-a3471350e342 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:16.008095 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6765c18b-76dd-46ab-98c3-a3471350e342 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:16.017167 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6765c18b-76dd-46ab-98c3-a3471350e342 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.192204 Sep 05 17:30:16.017916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1168/2489] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:15 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:16.379316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2b1a9b51-3e5d-4811-ac4e-fb0f3bcf2974 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:16.381033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2b1a9b51-3e5d-4811-ac4e-fb0f3bcf2974 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:16.407604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b1a9b51-3e5d-4811-ac4e-fb0f3bcf2974 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:16.408103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b1a9b51-3e5d-4811-ac4e-fb0f3bcf2974 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:16.408567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b1a9b51-3e5d-4811-ac4e-fb0f3bcf2974 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:16.409282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b1a9b51-3e5d-4811-ac4e-fb0f3bcf2974 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:16.409733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b1a9b51-3e5d-4811-ac4e-fb0f3bcf2974 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:16.410143 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b1a9b51-3e5d-4811-ac4e-fb0f3bcf2974 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:16.567617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2b1a9b51-3e5d-4811-ac4e-fb0f3bcf2974 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:16.579461 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2b1a9b51-3e5d-4811-ac4e-fb0f3bcf2974 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.205278 Sep 05 17:30:16.580065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1322/2490] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:16 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:17.040624 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b3e66ebd-e321-4170-a3c0-eed86a3d3839 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:17.041230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b3e66ebd-e321-4170-a3c0-eed86a3d3839 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:17.049112 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3e66ebd-e321-4170-a3c0-eed86a3d3839 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:17.049591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3e66ebd-e321-4170-a3c0-eed86a3d3839 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:17.050020 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3e66ebd-e321-4170-a3c0-eed86a3d3839 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:17.050707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3e66ebd-e321-4170-a3c0-eed86a3d3839 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:17.051160 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3e66ebd-e321-4170-a3c0-eed86a3d3839 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:17.051583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b3e66ebd-e321-4170-a3c0-eed86a3d3839 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:17.192941 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b3e66ebd-e321-4170-a3c0-eed86a3d3839 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:17.216711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b3e66ebd-e321-4170-a3c0-eed86a3d3839 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.179896 Sep 05 17:30:17.217274 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1169/2491] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:17 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:17.607261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f5aacd70-e555-4afb-9cd3-8dd1da80df08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:17.608864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f5aacd70-e555-4afb-9cd3-8dd1da80df08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:17.616892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5aacd70-e555-4afb-9cd3-8dd1da80df08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:17.617372 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5aacd70-e555-4afb-9cd3-8dd1da80df08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:17.617892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5aacd70-e555-4afb-9cd3-8dd1da80df08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:17.618836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5aacd70-e555-4afb-9cd3-8dd1da80df08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:17.619283 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5aacd70-e555-4afb-9cd3-8dd1da80df08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:17.619701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5aacd70-e555-4afb-9cd3-8dd1da80df08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:17.766644 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f5aacd70-e555-4afb-9cd3-8dd1da80df08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:17.774978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f5aacd70-e555-4afb-9cd3-8dd1da80df08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1599 microversion: 2.1 time: 0.175712 Sep 05 17:30:17.775636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1323/2492] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:17 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:17.982661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-e834ae1c-c1d5-4bf9-a1c8-454dec841b77 req-ef942c70-009b-4a8b-b7b6-cf5187669904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c420ca-19c4-4f51-8091-e83672ea54ca", "name": "network-vif-deleted", "tag": "6e894232-478f-47a6-86f4-399c64bf7399"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:30:17.992656 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-e834ae1c-c1d5-4bf9-a1c8-454dec841b77 req-ef942c70-009b-4a8b-b7b6-cf5187669904 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:17.993137 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-e834ae1c-c1d5-4bf9-a1c8-454dec841b77 req-ef942c70-009b-4a8b-b7b6-cf5187669904 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:17.993574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-e834ae1c-c1d5-4bf9-a1c8-454dec841b77 req-ef942c70-009b-4a8b-b7b6-cf5187669904 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:18.005079 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-e834ae1c-c1d5-4bf9-a1c8-454dec841b77 req-ef942c70-009b-4a8b-b7b6-cf5187669904 service nova] Creating event network-vif-deleted:6e894232-478f-47a6-86f4-399c64bf7399 for instance c8c420ca-19c4-4f51-8091-e83672ea54ca on hv-cinder-85596 Sep 05 17:30:18.010622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-e834ae1c-c1d5-4bf9-a1c8-454dec841b77 req-ef942c70-009b-4a8b-b7b6-cf5187669904 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032612 Sep 05 17:30:18.011256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1170/2493] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:30:18.239941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3642bc92-1ca0-4f7a-9c61-97ecfa6816ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:18.240480 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3642bc92-1ca0-4f7a-9c61-97ecfa6816ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:18.247029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3642bc92-1ca0-4f7a-9c61-97ecfa6816ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:18.247500 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3642bc92-1ca0-4f7a-9c61-97ecfa6816ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:18.247916 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3642bc92-1ca0-4f7a-9c61-97ecfa6816ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:18.248637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3642bc92-1ca0-4f7a-9c61-97ecfa6816ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:18.249078 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3642bc92-1ca0-4f7a-9c61-97ecfa6816ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:18.249489 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3642bc92-1ca0-4f7a-9c61-97ecfa6816ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:18.399737 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3642bc92-1ca0-4f7a-9c61-97ecfa6816ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:18.410398 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3642bc92-1ca0-4f7a-9c61-97ecfa6816ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.174384 Sep 05 17:30:18.411070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1324/2494] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:18 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:18.803022 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3bf1df52-3aab-4ae3-8574-be244ed4096b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:18.803672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3bf1df52-3aab-4ae3-8574-be244ed4096b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:18.810965 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bf1df52-3aab-4ae3-8574-be244ed4096b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:18.811430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bf1df52-3aab-4ae3-8574-be244ed4096b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:18.811882 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bf1df52-3aab-4ae3-8574-be244ed4096b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:18.812682 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bf1df52-3aab-4ae3-8574-be244ed4096b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:18.813142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bf1df52-3aab-4ae3-8574-be244ed4096b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:18.813568 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3bf1df52-3aab-4ae3-8574-be244ed4096b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:18.878260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3bf1df52-3aab-4ae3-8574-be244ed4096b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:18.887188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3bf1df52-3aab-4ae3-8574-be244ed4096b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.091535 Sep 05 17:30:18.887787 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1171/2495] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:18 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:19.434086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-77c762d1-b65e-4040-ab0c-50d4a18e7a39 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:19.434701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-77c762d1-b65e-4040-ab0c-50d4a18e7a39 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:19.442528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77c762d1-b65e-4040-ab0c-50d4a18e7a39 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:19.443053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77c762d1-b65e-4040-ab0c-50d4a18e7a39 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:19.443486 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77c762d1-b65e-4040-ab0c-50d4a18e7a39 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:19.444217 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77c762d1-b65e-4040-ab0c-50d4a18e7a39 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:19.444672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77c762d1-b65e-4040-ab0c-50d4a18e7a39 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:19.445096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77c762d1-b65e-4040-ab0c-50d4a18e7a39 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:19.616517 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-77c762d1-b65e-4040-ab0c-50d4a18e7a39 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:19.625741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-77c762d1-b65e-4040-ab0c-50d4a18e7a39 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.195441 Sep 05 17:30:19.627063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1325/2496] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:19 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:19.914542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4d1ae2c3-8895-4ca3-9ad6-bf77e677ca19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:19.915414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4d1ae2c3-8895-4ca3-9ad6-bf77e677ca19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:19.925062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d1ae2c3-8895-4ca3-9ad6-bf77e677ca19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:19.925537 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d1ae2c3-8895-4ca3-9ad6-bf77e677ca19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:19.929596 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d1ae2c3-8895-4ca3-9ad6-bf77e677ca19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:19.931173 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d1ae2c3-8895-4ca3-9ad6-bf77e677ca19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:19.931638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d1ae2c3-8895-4ca3-9ad6-bf77e677ca19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:19.932061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4d1ae2c3-8895-4ca3-9ad6-bf77e677ca19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:20.003651 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4d1ae2c3-8895-4ca3-9ad6-bf77e677ca19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:20.012424 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4d1ae2c3-8895-4ca3-9ad6-bf77e677ca19 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.104494 Sep 05 17:30:20.012995 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1172/2497] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:19 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:20.657146 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-28ba27a1-9c39-4c0f-8557-b9cd522c717b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:20.658030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-28ba27a1-9c39-4c0f-8557-b9cd522c717b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:20.668453 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28ba27a1-9c39-4c0f-8557-b9cd522c717b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:20.669251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28ba27a1-9c39-4c0f-8557-b9cd522c717b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:20.670151 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28ba27a1-9c39-4c0f-8557-b9cd522c717b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:20.671092 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28ba27a1-9c39-4c0f-8557-b9cd522c717b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:20.671951 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28ba27a1-9c39-4c0f-8557-b9cd522c717b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:20.672702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28ba27a1-9c39-4c0f-8557-b9cd522c717b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:20.824475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-28ba27a1-9c39-4c0f-8557-b9cd522c717b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:20.837152 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-28ba27a1-9c39-4c0f-8557-b9cd522c717b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.186881 Sep 05 17:30:20.837964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1326/2498] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:20 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:21.035517 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-de7eee51-84ad-4938-9a53-912a1a324660 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:21.036091 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-de7eee51-84ad-4938-9a53-912a1a324660 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:21.042881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-de7eee51-84ad-4938-9a53-912a1a324660 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:21.043359 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-de7eee51-84ad-4938-9a53-912a1a324660 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:21.043783 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-de7eee51-84ad-4938-9a53-912a1a324660 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:21.044500 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-de7eee51-84ad-4938-9a53-912a1a324660 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:21.044949 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-de7eee51-84ad-4938-9a53-912a1a324660 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:21.045361 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-de7eee51-84ad-4938-9a53-912a1a324660 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:21.048083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:30:21.115080 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-de7eee51-84ad-4938-9a53-912a1a324660 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:21.123966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-de7eee51-84ad-4938-9a53-912a1a324660 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.092576 Sep 05 17:30:21.124576 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1173/2499] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:21 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:21.866159 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2ad7c47c-faf5-4d07-93c9-25439e880820 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:21.867136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2ad7c47c-faf5-4d07-93c9-25439e880820 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:21.877879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ad7c47c-faf5-4d07-93c9-25439e880820 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:21.878361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ad7c47c-faf5-4d07-93c9-25439e880820 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:21.878791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ad7c47c-faf5-4d07-93c9-25439e880820 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:21.879485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ad7c47c-faf5-4d07-93c9-25439e880820 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:21.879932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ad7c47c-faf5-4d07-93c9-25439e880820 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:21.880389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ad7c47c-faf5-4d07-93c9-25439e880820 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:22.019853 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2ad7c47c-faf5-4d07-93c9-25439e880820 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:22.022115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:30:22.029523 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2ad7c47c-faf5-4d07-93c9-25439e880820 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.170744 Sep 05 17:30:22.030067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1327/2500] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:21 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:22.149374 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9606aa26-ae8d-46f6-a9f0-3c6b1728ddcd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:22.150121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9606aa26-ae8d-46f6-a9f0-3c6b1728ddcd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:22.159624 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9606aa26-ae8d-46f6-a9f0-3c6b1728ddcd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:22.160302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9606aa26-ae8d-46f6-a9f0-3c6b1728ddcd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:22.160878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9606aa26-ae8d-46f6-a9f0-3c6b1728ddcd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:22.161780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9606aa26-ae8d-46f6-a9f0-3c6b1728ddcd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:22.162356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9606aa26-ae8d-46f6-a9f0-3c6b1728ddcd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:22.162911 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9606aa26-ae8d-46f6-a9f0-3c6b1728ddcd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:22.231046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9606aa26-ae8d-46f6-a9f0-3c6b1728ddcd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:22.240957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9606aa26-ae8d-46f6-a9f0-3c6b1728ddcd tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.097039 Sep 05 17:30:22.241520 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1174/2501] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:22 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:23.060393 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-de3955ac-2e3d-4568-a602-fe274faabcae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:23.061578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-de3955ac-2e3d-4568-a602-fe274faabcae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:23.068949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de3955ac-2e3d-4568-a602-fe274faabcae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:23.069407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de3955ac-2e3d-4568-a602-fe274faabcae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:23.069854 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de3955ac-2e3d-4568-a602-fe274faabcae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:23.070545 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de3955ac-2e3d-4568-a602-fe274faabcae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:23.070986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de3955ac-2e3d-4568-a602-fe274faabcae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:23.071400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de3955ac-2e3d-4568-a602-fe274faabcae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:23.202436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-de3955ac-2e3d-4568-a602-fe274faabcae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:23.211261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-de3955ac-2e3d-4568-a602-fe274faabcae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.157433 Sep 05 17:30:23.211818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1328/2502] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:23 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:23.264088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-501486dc-0960-41ed-9185-35ef9c1635f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:23.264697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-501486dc-0960-41ed-9185-35ef9c1635f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:23.271446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-501486dc-0960-41ed-9185-35ef9c1635f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:23.271916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-501486dc-0960-41ed-9185-35ef9c1635f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:23.272375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-501486dc-0960-41ed-9185-35ef9c1635f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:23.273084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-501486dc-0960-41ed-9185-35ef9c1635f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:23.273496 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-501486dc-0960-41ed-9185-35ef9c1635f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:23.273903 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-501486dc-0960-41ed-9185-35ef9c1635f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:23.338491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-501486dc-0960-41ed-9185-35ef9c1635f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:23.347411 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-501486dc-0960-41ed-9185-35ef9c1635f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.087268 Sep 05 17:30:23.347975 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1175/2503] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:23 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:24.237831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b5d7ea46-84ce-4d0d-b404-e609de7dcd40 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:24.238489 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b5d7ea46-84ce-4d0d-b404-e609de7dcd40 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:24.245337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5d7ea46-84ce-4d0d-b404-e609de7dcd40 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:24.245826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5d7ea46-84ce-4d0d-b404-e609de7dcd40 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:24.246259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5d7ea46-84ce-4d0d-b404-e609de7dcd40 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:24.246944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5d7ea46-84ce-4d0d-b404-e609de7dcd40 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:24.247397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5d7ea46-84ce-4d0d-b404-e609de7dcd40 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:24.247815 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5d7ea46-84ce-4d0d-b404-e609de7dcd40 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:24.370462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-72c6cd94-21f5-4c2d-a7c6-68ad87a73ae2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:24.371088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-72c6cd94-21f5-4c2d-a7c6-68ad87a73ae2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:24.378221 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72c6cd94-21f5-4c2d-a7c6-68ad87a73ae2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:24.378965 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72c6cd94-21f5-4c2d-a7c6-68ad87a73ae2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:24.379586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72c6cd94-21f5-4c2d-a7c6-68ad87a73ae2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:24.380558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72c6cd94-21f5-4c2d-a7c6-68ad87a73ae2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:24.381272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72c6cd94-21f5-4c2d-a7c6-68ad87a73ae2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:24.381379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-72c6cd94-21f5-4c2d-a7c6-68ad87a73ae2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:24.384017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b5d7ea46-84ce-4d0d-b404-e609de7dcd40 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:24.392474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b5d7ea46-84ce-4d0d-b404-e609de7dcd40 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.159912 Sep 05 17:30:24.393025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1329/2504] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:24 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:24.446093 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-72c6cd94-21f5-4c2d-a7c6-68ad87a73ae2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:24.454972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-72c6cd94-21f5-4c2d-a7c6-68ad87a73ae2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.088499 Sep 05 17:30:24.455536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1176/2505] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:24 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:25.420666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-efbb4966-2570-408e-af66-9793404fda6b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:25.421636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-efbb4966-2570-408e-af66-9793404fda6b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:25.432866 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efbb4966-2570-408e-af66-9793404fda6b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:25.433601 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efbb4966-2570-408e-af66-9793404fda6b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:25.434260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efbb4966-2570-408e-af66-9793404fda6b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:25.435305 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efbb4966-2570-408e-af66-9793404fda6b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:25.435992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efbb4966-2570-408e-af66-9793404fda6b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:25.436700 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efbb4966-2570-408e-af66-9793404fda6b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:25.478495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-511bd631-9a72-452e-8804-8f9631b7751a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:25.479125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-511bd631-9a72-452e-8804-8f9631b7751a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:25.486065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-511bd631-9a72-452e-8804-8f9631b7751a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:25.486666 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-511bd631-9a72-452e-8804-8f9631b7751a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:25.487088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-511bd631-9a72-452e-8804-8f9631b7751a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:25.487777 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-511bd631-9a72-452e-8804-8f9631b7751a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:25.488336 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-511bd631-9a72-452e-8804-8f9631b7751a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:25.488750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-511bd631-9a72-452e-8804-8f9631b7751a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:25.561249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-511bd631-9a72-452e-8804-8f9631b7751a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:25.570525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-511bd631-9a72-452e-8804-8f9631b7751a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.096017 Sep 05 17:30:25.571125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1177/2506] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:25 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:25.593050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-efbb4966-2570-408e-af66-9793404fda6b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:25.601570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-efbb4966-2570-408e-af66-9793404fda6b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.187071 Sep 05 17:30:25.602206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1330/2507] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:25 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:26.594568 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-00ea2132-909d-4005-a8cb-1a398027ce26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:26.595210 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-00ea2132-909d-4005-a8cb-1a398027ce26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:26.602294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00ea2132-909d-4005-a8cb-1a398027ce26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:26.602773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00ea2132-909d-4005-a8cb-1a398027ce26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:26.603200 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00ea2132-909d-4005-a8cb-1a398027ce26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:26.603886 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00ea2132-909d-4005-a8cb-1a398027ce26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:26.604381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00ea2132-909d-4005-a8cb-1a398027ce26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:26.604801 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00ea2132-909d-4005-a8cb-1a398027ce26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:26.625423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-936010bf-a655-4207-a56b-f37ca7fab50b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:26.625973 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-936010bf-a655-4207-a56b-f37ca7fab50b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:26.633113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-936010bf-a655-4207-a56b-f37ca7fab50b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:26.633978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-936010bf-a655-4207-a56b-f37ca7fab50b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:26.634415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-936010bf-a655-4207-a56b-f37ca7fab50b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:26.635108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-936010bf-a655-4207-a56b-f37ca7fab50b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:26.635561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-936010bf-a655-4207-a56b-f37ca7fab50b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:26.635980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-936010bf-a655-4207-a56b-f37ca7fab50b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:26.667685 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-00ea2132-909d-4005-a8cb-1a398027ce26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:26.676801 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-00ea2132-909d-4005-a8cb-1a398027ce26 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.086484 Sep 05 17:30:26.678295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1178/2508] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:26 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:26.767907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-936010bf-a655-4207-a56b-f37ca7fab50b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:26.778002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-936010bf-a655-4207-a56b-f37ca7fab50b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.157116 Sep 05 17:30:26.778577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1331/2509] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:26 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:27.701296 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e31ed870-1c95-480f-96ad-1bd0602a4a99 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:27.701857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e31ed870-1c95-480f-96ad-1bd0602a4a99 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:27.708786 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e31ed870-1c95-480f-96ad-1bd0602a4a99 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:27.709270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e31ed870-1c95-480f-96ad-1bd0602a4a99 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:27.709706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e31ed870-1c95-480f-96ad-1bd0602a4a99 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:27.710397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e31ed870-1c95-480f-96ad-1bd0602a4a99 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:27.710848 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e31ed870-1c95-480f-96ad-1bd0602a4a99 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:27.711272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e31ed870-1c95-480f-96ad-1bd0602a4a99 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:27.777708 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e31ed870-1c95-480f-96ad-1bd0602a4a99 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:27.788318 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e31ed870-1c95-480f-96ad-1bd0602a4a99 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.091088 Sep 05 17:30:27.788887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1179/2510] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:27 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:27.808278 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4185e7e3-6b96-470f-ba09-823857784478 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:27.808926 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4185e7e3-6b96-470f-ba09-823857784478 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:27.815568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4185e7e3-6b96-470f-ba09-823857784478 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:27.816048 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4185e7e3-6b96-470f-ba09-823857784478 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:27.816519 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4185e7e3-6b96-470f-ba09-823857784478 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:27.817206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4185e7e3-6b96-470f-ba09-823857784478 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:27.817655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4185e7e3-6b96-470f-ba09-823857784478 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:27.818086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4185e7e3-6b96-470f-ba09-823857784478 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:27.949032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4185e7e3-6b96-470f-ba09-823857784478 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:27.958625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4185e7e3-6b96-470f-ba09-823857784478 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.154146 Sep 05 17:30:27.959127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1332/2511] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:27 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:28.813373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-be515546-a5ec-4b2e-8561-0dc9fdbd56f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:28.814191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-be515546-a5ec-4b2e-8561-0dc9fdbd56f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:28.823745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-be515546-a5ec-4b2e-8561-0dc9fdbd56f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:28.824455 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-be515546-a5ec-4b2e-8561-0dc9fdbd56f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:28.825030 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-be515546-a5ec-4b2e-8561-0dc9fdbd56f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:28.825944 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-be515546-a5ec-4b2e-8561-0dc9fdbd56f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:28.826905 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-be515546-a5ec-4b2e-8561-0dc9fdbd56f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:28.827473 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-be515546-a5ec-4b2e-8561-0dc9fdbd56f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:28.890085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-be515546-a5ec-4b2e-8561-0dc9fdbd56f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:28.899779 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-be515546-a5ec-4b2e-8561-0dc9fdbd56f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.091790 Sep 05 17:30:28.900387 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1180/2512] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:28 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:28.983944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f590c2d4-0a62-4246-85b1-46c6450bb064 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:28.985068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f590c2d4-0a62-4246-85b1-46c6450bb064 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:28.992397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f590c2d4-0a62-4246-85b1-46c6450bb064 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:28.992887 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f590c2d4-0a62-4246-85b1-46c6450bb064 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:28.993319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f590c2d4-0a62-4246-85b1-46c6450bb064 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:28.994011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f590c2d4-0a62-4246-85b1-46c6450bb064 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:28.994466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f590c2d4-0a62-4246-85b1-46c6450bb064 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:28.994910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f590c2d4-0a62-4246-85b1-46c6450bb064 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:29.133225 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f590c2d4-0a62-4246-85b1-46c6450bb064 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:29.142238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f590c2d4-0a62-4246-85b1-46c6450bb064 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.163720 Sep 05 17:30:29.142818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1333/2513] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:28 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:29.927534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cba24053-a198-4d07-9821-ccc786a3c89b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:29.928639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cba24053-a198-4d07-9821-ccc786a3c89b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:29.939561 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cba24053-a198-4d07-9821-ccc786a3c89b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:29.940412 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cba24053-a198-4d07-9821-ccc786a3c89b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:29.941049 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cba24053-a198-4d07-9821-ccc786a3c89b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:29.941742 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cba24053-a198-4d07-9821-ccc786a3c89b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:29.942195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cba24053-a198-4d07-9821-ccc786a3c89b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:29.942612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cba24053-a198-4d07-9821-ccc786a3c89b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:30.015105 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-cba24053-a198-4d07-9821-ccc786a3c89b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:30.023631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cba24053-a198-4d07-9821-ccc786a3c89b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.103003 Sep 05 17:30:30.024198 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1181/2514] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:29 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:30.175327 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9e99fb40-fcc3-443b-b5a2-85027e3fe2e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:30.175933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9e99fb40-fcc3-443b-b5a2-85027e3fe2e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:30.183062 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e99fb40-fcc3-443b-b5a2-85027e3fe2e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:30.183481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e99fb40-fcc3-443b-b5a2-85027e3fe2e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:30.183915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e99fb40-fcc3-443b-b5a2-85027e3fe2e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:30.184636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e99fb40-fcc3-443b-b5a2-85027e3fe2e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:30.185085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e99fb40-fcc3-443b-b5a2-85027e3fe2e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:30.185514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e99fb40-fcc3-443b-b5a2-85027e3fe2e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:30.321957 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9e99fb40-fcc3-443b-b5a2-85027e3fe2e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:30.330286 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9e99fb40-fcc3-443b-b5a2-85027e3fe2e3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.161808 Sep 05 17:30:30.330859 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1334/2515] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:30 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:31.051246 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7591ebdb-d558-4ca0-8524-44831343816e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:31.051878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7591ebdb-d558-4ca0-8524-44831343816e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:31.054282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=54 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:30:31.059919 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7591ebdb-d558-4ca0-8524-44831343816e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:31.060435 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7591ebdb-d558-4ca0-8524-44831343816e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:31.060867 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7591ebdb-d558-4ca0-8524-44831343816e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:31.061554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7591ebdb-d558-4ca0-8524-44831343816e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:31.062007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7591ebdb-d558-4ca0-8524-44831343816e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:31.062436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7591ebdb-d558-4ca0-8524-44831343816e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:31.132890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7591ebdb-d558-4ca0-8524-44831343816e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:31.145281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7591ebdb-d558-4ca0-8524-44831343816e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.100388 Sep 05 17:30:31.145899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1182/2516] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:31 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:31.355066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-41ece36e-e4e6-45b2-a7dc-f3e255fa0341 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:31.355748 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-41ece36e-e4e6-45b2-a7dc-f3e255fa0341 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:31.363131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41ece36e-e4e6-45b2-a7dc-f3e255fa0341 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:31.363694 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41ece36e-e4e6-45b2-a7dc-f3e255fa0341 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:31.364217 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41ece36e-e4e6-45b2-a7dc-f3e255fa0341 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:31.364961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41ece36e-e4e6-45b2-a7dc-f3e255fa0341 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:31.365455 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41ece36e-e4e6-45b2-a7dc-f3e255fa0341 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:31.365918 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41ece36e-e4e6-45b2-a7dc-f3e255fa0341 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:31.506057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-41ece36e-e4e6-45b2-a7dc-f3e255fa0341 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:31.518317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-41ece36e-e4e6-45b2-a7dc-f3e255fa0341 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.167420 Sep 05 17:30:31.519058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1335/2517] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:31 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:32.170346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-171308fb-a0a9-4891-8590-6a9762af7289 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:32.171061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-171308fb-a0a9-4891-8590-6a9762af7289 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:32.179201 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-171308fb-a0a9-4891-8590-6a9762af7289 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:32.179769 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-171308fb-a0a9-4891-8590-6a9762af7289 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:32.180265 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-171308fb-a0a9-4891-8590-6a9762af7289 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:32.181054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-171308fb-a0a9-4891-8590-6a9762af7289 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:32.181579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-171308fb-a0a9-4891-8590-6a9762af7289 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:32.182060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-171308fb-a0a9-4891-8590-6a9762af7289 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:32.254589 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-171308fb-a0a9-4891-8590-6a9762af7289 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:32.263074 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-171308fb-a0a9-4891-8590-6a9762af7289 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.097728 Sep 05 17:30:32.263632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1183/2518] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:32 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:32.547841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b9b58a2d-28ee-4859-b446-e37e873059de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:32.548450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b9b58a2d-28ee-4859-b446-e37e873059de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:32.550807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=52 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:30:32.557127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9b58a2d-28ee-4859-b446-e37e873059de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:32.557606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9b58a2d-28ee-4859-b446-e37e873059de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:32.558036 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9b58a2d-28ee-4859-b446-e37e873059de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:32.558709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9b58a2d-28ee-4859-b446-e37e873059de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:32.559155 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9b58a2d-28ee-4859-b446-e37e873059de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:32.559574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9b58a2d-28ee-4859-b446-e37e873059de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:32.865726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b9b58a2d-28ee-4859-b446-e37e873059de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:32.878855 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b9b58a2d-28ee-4859-b446-e37e873059de tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.334940 Sep 05 17:30:32.879777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1336/2519] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:32 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:33.289639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9c2398b9-336a-4f7e-a710-67da3fc696a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:33.290760 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9c2398b9-336a-4f7e-a710-67da3fc696a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:33.301465 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c2398b9-336a-4f7e-a710-67da3fc696a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:33.302255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c2398b9-336a-4f7e-a710-67da3fc696a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:33.302965 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c2398b9-336a-4f7e-a710-67da3fc696a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:33.304069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c2398b9-336a-4f7e-a710-67da3fc696a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:33.304735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c2398b9-336a-4f7e-a710-67da3fc696a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:33.305145 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9c2398b9-336a-4f7e-a710-67da3fc696a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:33.368791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9c2398b9-336a-4f7e-a710-67da3fc696a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:33.377294 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9c2398b9-336a-4f7e-a710-67da3fc696a7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.094303 Sep 05 17:30:33.377878 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1184/2520] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:33 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:33.904743 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-68e1aab7-f8bd-4ffa-89fd-b095cf84c155 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:33.905346 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-68e1aab7-f8bd-4ffa-89fd-b095cf84c155 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:33.914506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68e1aab7-f8bd-4ffa-89fd-b095cf84c155 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:33.914991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68e1aab7-f8bd-4ffa-89fd-b095cf84c155 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:33.915423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68e1aab7-f8bd-4ffa-89fd-b095cf84c155 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:33.916103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68e1aab7-f8bd-4ffa-89fd-b095cf84c155 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:33.916590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68e1aab7-f8bd-4ffa-89fd-b095cf84c155 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:33.916977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68e1aab7-f8bd-4ffa-89fd-b095cf84c155 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:34.063584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-68e1aab7-f8bd-4ffa-89fd-b095cf84c155 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:34.075094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-68e1aab7-f8bd-4ffa-89fd-b095cf84c155 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.175171 Sep 05 17:30:34.075661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1337/2521] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:33 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:34.401355 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-749ade32-78b7-4a57-a4a2-685538d80acf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:34.401895 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-749ade32-78b7-4a57-a4a2-685538d80acf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:34.409036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-749ade32-78b7-4a57-a4a2-685538d80acf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:34.409522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-749ade32-78b7-4a57-a4a2-685538d80acf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:34.409955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-749ade32-78b7-4a57-a4a2-685538d80acf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:34.410645 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-749ade32-78b7-4a57-a4a2-685538d80acf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:34.411104 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-749ade32-78b7-4a57-a4a2-685538d80acf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:34.411521 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-749ade32-78b7-4a57-a4a2-685538d80acf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:34.482143 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-749ade32-78b7-4a57-a4a2-685538d80acf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:34.490665 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-749ade32-78b7-4a57-a4a2-685538d80acf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.093532 Sep 05 17:30:34.491237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1185/2522] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:34 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:35.099197 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-11b45959-8ea3-42d0-8b08-72897183f93a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:35.099813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-11b45959-8ea3-42d0-8b08-72897183f93a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:35.107472 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11b45959-8ea3-42d0-8b08-72897183f93a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:35.107977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11b45959-8ea3-42d0-8b08-72897183f93a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:35.108418 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11b45959-8ea3-42d0-8b08-72897183f93a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:35.109121 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11b45959-8ea3-42d0-8b08-72897183f93a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:35.109572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11b45959-8ea3-42d0-8b08-72897183f93a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:35.109992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11b45959-8ea3-42d0-8b08-72897183f93a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:35.245084 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-11b45959-8ea3-42d0-8b08-72897183f93a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:35.253557 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-11b45959-8ea3-42d0-8b08-72897183f93a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.158378 Sep 05 17:30:35.254131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1338/2523] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:35 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:35.514673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b91a2ab3-c957-4df4-9c49-b3a80e63cadb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:35.515283 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b91a2ab3-c957-4df4-9c49-b3a80e63cadb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:35.522793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b91a2ab3-c957-4df4-9c49-b3a80e63cadb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:35.523544 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b91a2ab3-c957-4df4-9c49-b3a80e63cadb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:35.523975 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b91a2ab3-c957-4df4-9c49-b3a80e63cadb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:35.524712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b91a2ab3-c957-4df4-9c49-b3a80e63cadb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:35.525165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b91a2ab3-c957-4df4-9c49-b3a80e63cadb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:35.525583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b91a2ab3-c957-4df4-9c49-b3a80e63cadb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:35.591179 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b91a2ab3-c957-4df4-9c49-b3a80e63cadb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:35.602820 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b91a2ab3-c957-4df4-9c49-b3a80e63cadb tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.092067 Sep 05 17:30:35.603439 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1186/2524] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:35 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:36.277210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a02f6a6d-c8ec-481d-abe9-5eb83a6ba6db tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:36.277810 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a02f6a6d-c8ec-481d-abe9-5eb83a6ba6db tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:36.284953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a02f6a6d-c8ec-481d-abe9-5eb83a6ba6db tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:36.285442 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a02f6a6d-c8ec-481d-abe9-5eb83a6ba6db tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:36.285879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a02f6a6d-c8ec-481d-abe9-5eb83a6ba6db tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:36.286566 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a02f6a6d-c8ec-481d-abe9-5eb83a6ba6db tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:36.287014 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a02f6a6d-c8ec-481d-abe9-5eb83a6ba6db tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:36.287438 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a02f6a6d-c8ec-481d-abe9-5eb83a6ba6db tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:36.424629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a02f6a6d-c8ec-481d-abe9-5eb83a6ba6db tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:36.433897 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a02f6a6d-c8ec-481d-abe9-5eb83a6ba6db tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.160968 Sep 05 17:30:36.434496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1339/2525] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:36 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:36.626517 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-989cb0fd-9b47-426d-ae78-1a99788c00f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:36.627120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-989cb0fd-9b47-426d-ae78-1a99788c00f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:36.634484 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-989cb0fd-9b47-426d-ae78-1a99788c00f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:36.634847 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-989cb0fd-9b47-426d-ae78-1a99788c00f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:36.635279 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-989cb0fd-9b47-426d-ae78-1a99788c00f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:36.635950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-989cb0fd-9b47-426d-ae78-1a99788c00f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:36.636468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-989cb0fd-9b47-426d-ae78-1a99788c00f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:36.636880 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-989cb0fd-9b47-426d-ae78-1a99788c00f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:36.702169 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-989cb0fd-9b47-426d-ae78-1a99788c00f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:36.711439 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-989cb0fd-9b47-426d-ae78-1a99788c00f0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.088843 Sep 05 17:30:36.712125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1187/2526] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:36 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:37.457648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4ea23dfd-0c91-4a2a-8a12-74d176430f38 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:37.458987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4ea23dfd-0c91-4a2a-8a12-74d176430f38 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:37.466091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ea23dfd-0c91-4a2a-8a12-74d176430f38 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:37.466576 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ea23dfd-0c91-4a2a-8a12-74d176430f38 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:37.467027 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ea23dfd-0c91-4a2a-8a12-74d176430f38 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:37.467723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ea23dfd-0c91-4a2a-8a12-74d176430f38 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:37.468222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ea23dfd-0c91-4a2a-8a12-74d176430f38 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:37.468611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ea23dfd-0c91-4a2a-8a12-74d176430f38 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:37.610968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4ea23dfd-0c91-4a2a-8a12-74d176430f38 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:37.619995 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4ea23dfd-0c91-4a2a-8a12-74d176430f38 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.166474 Sep 05 17:30:37.620599 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1340/2527] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:37 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:37.735983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d14844c9-d8f7-4baf-b6b1-d5254f8f4f0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:37.736621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d14844c9-d8f7-4baf-b6b1-d5254f8f4f0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:37.743881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d14844c9-d8f7-4baf-b6b1-d5254f8f4f0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:37.744290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d14844c9-d8f7-4baf-b6b1-d5254f8f4f0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:37.744748 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d14844c9-d8f7-4baf-b6b1-d5254f8f4f0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:37.745436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d14844c9-d8f7-4baf-b6b1-d5254f8f4f0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:37.745874 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d14844c9-d8f7-4baf-b6b1-d5254f8f4f0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:37.746288 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d14844c9-d8f7-4baf-b6b1-d5254f8f4f0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:37.811904 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d14844c9-d8f7-4baf-b6b1-d5254f8f4f0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:37.820714 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d14844c9-d8f7-4baf-b6b1-d5254f8f4f0c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.088749 Sep 05 17:30:37.821415 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1188/2528] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:37 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:38.645781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8753f811-abbf-4574-b866-ff711392bcd3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:38.646353 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8753f811-abbf-4574-b866-ff711392bcd3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:38.653458 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8753f811-abbf-4574-b866-ff711392bcd3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:38.654678 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8753f811-abbf-4574-b866-ff711392bcd3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:38.655184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8753f811-abbf-4574-b866-ff711392bcd3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:38.655907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8753f811-abbf-4574-b866-ff711392bcd3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:38.656405 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8753f811-abbf-4574-b866-ff711392bcd3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:38.656839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8753f811-abbf-4574-b866-ff711392bcd3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:38.792388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8753f811-abbf-4574-b866-ff711392bcd3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:38.801079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8753f811-abbf-4574-b866-ff711392bcd3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.159297 Sep 05 17:30:38.801641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1341/2529] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:38 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:38.843390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f1e57c6c-daa9-4c9c-83c9-4dc2ee1109e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:38.843983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f1e57c6c-daa9-4c9c-83c9-4dc2ee1109e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:38.850860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1e57c6c-daa9-4c9c-83c9-4dc2ee1109e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:38.851341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1e57c6c-daa9-4c9c-83c9-4dc2ee1109e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:38.851771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1e57c6c-daa9-4c9c-83c9-4dc2ee1109e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:38.852493 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1e57c6c-daa9-4c9c-83c9-4dc2ee1109e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:38.852931 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1e57c6c-daa9-4c9c-83c9-4dc2ee1109e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:38.853351 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1e57c6c-daa9-4c9c-83c9-4dc2ee1109e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:38.920921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f1e57c6c-daa9-4c9c-83c9-4dc2ee1109e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:38.923867 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:30:38.931542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f1e57c6c-daa9-4c9c-83c9-4dc2ee1109e8 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.092439 Sep 05 17:30:38.932668 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1189/2530] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:38 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:39.824938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-29c2e1a6-f002-4562-b97e-a71eacafac6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:39.825617 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-29c2e1a6-f002-4562-b97e-a71eacafac6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:39.832711 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29c2e1a6-f002-4562-b97e-a71eacafac6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:39.833198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29c2e1a6-f002-4562-b97e-a71eacafac6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:39.833632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29c2e1a6-f002-4562-b97e-a71eacafac6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:39.834333 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29c2e1a6-f002-4562-b97e-a71eacafac6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:39.834788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29c2e1a6-f002-4562-b97e-a71eacafac6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:39.835205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29c2e1a6-f002-4562-b97e-a71eacafac6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:39.954747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-89239bf8-f015-42b8-8118-08705af8f2d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:39.955353 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-89239bf8-f015-42b8-8118-08705af8f2d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:39.963567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-89239bf8-f015-42b8-8118-08705af8f2d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:39.964209 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-89239bf8-f015-42b8-8118-08705af8f2d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:39.964614 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-89239bf8-f015-42b8-8118-08705af8f2d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:39.965671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-89239bf8-f015-42b8-8118-08705af8f2d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:39.966116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-89239bf8-f015-42b8-8118-08705af8f2d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:39.966534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-89239bf8-f015-42b8-8118-08705af8f2d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:39.974863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-29c2e1a6-f002-4562-b97e-a71eacafac6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:39.984356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-29c2e1a6-f002-4562-b97e-a71eacafac6f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.163447 Sep 05 17:30:39.984897 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1342/2531] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:39 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:40.033058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-89239bf8-f015-42b8-8118-08705af8f2d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:40.041454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-89239bf8-f015-42b8-8118-08705af8f2d3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.090614 Sep 05 17:30:40.042264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1190/2532] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:39 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:30:41.007655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b703c06f-de4f-4cf8-ae4b-dea43dc7fe7f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:41.008327 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b703c06f-de4f-4cf8-ae4b-dea43dc7fe7f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:41.014829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b703c06f-de4f-4cf8-ae4b-dea43dc7fe7f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:41.015293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b703c06f-de4f-4cf8-ae4b-dea43dc7fe7f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:41.015733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b703c06f-de4f-4cf8-ae4b-dea43dc7fe7f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:41.016491 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b703c06f-de4f-4cf8-ae4b-dea43dc7fe7f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:41.016942 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b703c06f-de4f-4cf8-ae4b-dea43dc7fe7f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:41.017368 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b703c06f-de4f-4cf8-ae4b-dea43dc7fe7f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:41.065257 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-77bc28dd-a8b2-4583-bfd1-cf960708379e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:41.066591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-77bc28dd-a8b2-4583-bfd1-cf960708379e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:41.073620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77bc28dd-a8b2-4583-bfd1-cf960708379e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:41.074560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77bc28dd-a8b2-4583-bfd1-cf960708379e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:41.075167 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77bc28dd-a8b2-4583-bfd1-cf960708379e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:41.076209 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77bc28dd-a8b2-4583-bfd1-cf960708379e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:41.076828 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77bc28dd-a8b2-4583-bfd1-cf960708379e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:41.077417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-77bc28dd-a8b2-4583-bfd1-cf960708379e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:41.158080 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-77bc28dd-a8b2-4583-bfd1-cf960708379e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:41.166946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-77bc28dd-a8b2-4583-bfd1-cf960708379e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.105665 Sep 05 17:30:41.175289 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1191/2533] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:41 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:41.178987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b703c06f-de4f-4cf8-ae4b-dea43dc7fe7f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:41.187943 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b703c06f-de4f-4cf8-ae4b-dea43dc7fe7f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.184226 Sep 05 17:30:41.188571 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1343/2534] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:41 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:30:42.190198 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d86eea16-b7cb-40f6-aa57-a3b2043c59ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:42.190801 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d86eea16-b7cb-40f6-aa57-a3b2043c59ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:42.197401 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d86eea16-b7cb-40f6-aa57-a3b2043c59ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:42.197889 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d86eea16-b7cb-40f6-aa57-a3b2043c59ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:42.198311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d86eea16-b7cb-40f6-aa57-a3b2043c59ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:42.198994 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d86eea16-b7cb-40f6-aa57-a3b2043c59ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:42.199444 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d86eea16-b7cb-40f6-aa57-a3b2043c59ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:42.199859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d86eea16-b7cb-40f6-aa57-a3b2043c59ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:42.211055 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-926d6a7b-7a12-4182-8c5e-09f55d40d2d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:42.211948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-926d6a7b-7a12-4182-8c5e-09f55d40d2d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:42.219641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926d6a7b-7a12-4182-8c5e-09f55d40d2d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:42.220311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926d6a7b-7a12-4182-8c5e-09f55d40d2d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:42.220766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926d6a7b-7a12-4182-8c5e-09f55d40d2d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:42.221463 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926d6a7b-7a12-4182-8c5e-09f55d40d2d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:42.221912 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926d6a7b-7a12-4182-8c5e-09f55d40d2d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:42.222333 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926d6a7b-7a12-4182-8c5e-09f55d40d2d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:42.237580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:30:42.275044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d86eea16-b7cb-40f6-aa57-a3b2043c59ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:42.283775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d86eea16-b7cb-40f6-aa57-a3b2043c59ea tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.097848 Sep 05 17:30:42.284416 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1192/2535] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:42 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:42.364435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-926d6a7b-7a12-4182-8c5e-09f55d40d2d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:42.373177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-926d6a7b-7a12-4182-8c5e-09f55d40d2d2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.165994 Sep 05 17:30:42.373973 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1344/2536] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:42 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:30:43.307288 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-401c772a-1efb-4a68-a188-e5fa4c40dc36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:43.307881 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-401c772a-1efb-4a68-a188-e5fa4c40dc36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:43.314429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-401c772a-1efb-4a68-a188-e5fa4c40dc36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:43.314920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-401c772a-1efb-4a68-a188-e5fa4c40dc36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:43.315343 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-401c772a-1efb-4a68-a188-e5fa4c40dc36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:43.316021 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-401c772a-1efb-4a68-a188-e5fa4c40dc36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:43.316523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-401c772a-1efb-4a68-a188-e5fa4c40dc36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:43.316940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-401c772a-1efb-4a68-a188-e5fa4c40dc36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:43.383716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-401c772a-1efb-4a68-a188-e5fa4c40dc36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:43.392481 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-401c772a-1efb-4a68-a188-e5fa4c40dc36 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.089226 Sep 05 17:30:43.397331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-484747cf-23cb-409b-b3e0-67f895d7301d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:43.397943 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-484747cf-23cb-409b-b3e0-67f895d7301d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:43.405040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-484747cf-23cb-409b-b3e0-67f895d7301d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:43.405515 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-484747cf-23cb-409b-b3e0-67f895d7301d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:43.405943 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-484747cf-23cb-409b-b3e0-67f895d7301d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:43.406628 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-484747cf-23cb-409b-b3e0-67f895d7301d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:43.407070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-484747cf-23cb-409b-b3e0-67f895d7301d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:43.407496 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-484747cf-23cb-409b-b3e0-67f895d7301d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:43.407722 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1193/2537] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:43 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:43.545865 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-484747cf-23cb-409b-b3e0-67f895d7301d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:43.554791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-484747cf-23cb-409b-b3e0-67f895d7301d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.161442 Sep 05 17:30:43.555368 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1345/2538] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:43 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:44.418126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-09ecd84f-950c-4dca-b3ab-08ab30552f5e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:44.419033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-09ecd84f-950c-4dca-b3ab-08ab30552f5e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:44.429334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09ecd84f-950c-4dca-b3ab-08ab30552f5e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:44.429987 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09ecd84f-950c-4dca-b3ab-08ab30552f5e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:44.430584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09ecd84f-950c-4dca-b3ab-08ab30552f5e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:44.431464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09ecd84f-950c-4dca-b3ab-08ab30552f5e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:44.432195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09ecd84f-950c-4dca-b3ab-08ab30552f5e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:44.432692 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09ecd84f-950c-4dca-b3ab-08ab30552f5e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:44.493477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-09ecd84f-950c-4dca-b3ab-08ab30552f5e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:44.502195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-09ecd84f-950c-4dca-b3ab-08ab30552f5e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.089906 Sep 05 17:30:44.502772 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1194/2539] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:44 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:44.580671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e5682783-878d-4488-b965-4741b9d93711 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:44.581440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e5682783-878d-4488-b965-4741b9d93711 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:44.590797 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5682783-878d-4488-b965-4741b9d93711 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:44.591436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5682783-878d-4488-b965-4741b9d93711 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:44.592011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5682783-878d-4488-b965-4741b9d93711 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:44.592972 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5682783-878d-4488-b965-4741b9d93711 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:44.593606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5682783-878d-4488-b965-4741b9d93711 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:44.594177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5682783-878d-4488-b965-4741b9d93711 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:44.735975 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e5682783-878d-4488-b965-4741b9d93711 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:44.749658 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e5682783-878d-4488-b965-4741b9d93711 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.173944 Sep 05 17:30:44.750598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1346/2540] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:44 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:45.530147 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c19fb9e7-5d4a-4717-ae5b-7be2ea8f34ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:45.531088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c19fb9e7-5d4a-4717-ae5b-7be2ea8f34ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:45.542289 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c19fb9e7-5d4a-4717-ae5b-7be2ea8f34ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:45.542796 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c19fb9e7-5d4a-4717-ae5b-7be2ea8f34ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:45.543218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c19fb9e7-5d4a-4717-ae5b-7be2ea8f34ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:45.543876 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c19fb9e7-5d4a-4717-ae5b-7be2ea8f34ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:45.544395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c19fb9e7-5d4a-4717-ae5b-7be2ea8f34ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:45.544810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c19fb9e7-5d4a-4717-ae5b-7be2ea8f34ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:45.618876 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c19fb9e7-5d4a-4717-ae5b-7be2ea8f34ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:45.627958 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c19fb9e7-5d4a-4717-ae5b-7be2ea8f34ed tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.105225 Sep 05 17:30:45.628483 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1195/2541] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:45 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:45.777774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3780d541-fd2c-4921-9598-ab1314633941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:45.778386 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3780d541-fd2c-4921-9598-ab1314633941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:45.785711 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3780d541-fd2c-4921-9598-ab1314633941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:45.786196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3780d541-fd2c-4921-9598-ab1314633941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:45.786593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3780d541-fd2c-4921-9598-ab1314633941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:45.787334 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3780d541-fd2c-4921-9598-ab1314633941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:45.787760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3780d541-fd2c-4921-9598-ab1314633941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:45.788188 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3780d541-fd2c-4921-9598-ab1314633941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:45.921954 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3780d541-fd2c-4921-9598-ab1314633941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:45.930497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3780d541-fd2c-4921-9598-ab1314633941 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.158916 Sep 05 17:30:45.931070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1347/2542] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:45 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:46.654327 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-47bb6bbe-c68d-4d5b-93b0-db51fc8cbfec tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:46.654965 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-47bb6bbe-c68d-4d5b-93b0-db51fc8cbfec tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:46.663174 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47bb6bbe-c68d-4d5b-93b0-db51fc8cbfec tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:46.663737 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47bb6bbe-c68d-4d5b-93b0-db51fc8cbfec tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:46.664298 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47bb6bbe-c68d-4d5b-93b0-db51fc8cbfec tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:46.665098 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47bb6bbe-c68d-4d5b-93b0-db51fc8cbfec tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:46.665630 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47bb6bbe-c68d-4d5b-93b0-db51fc8cbfec tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:46.666117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-47bb6bbe-c68d-4d5b-93b0-db51fc8cbfec tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:46.731208 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-47bb6bbe-c68d-4d5b-93b0-db51fc8cbfec tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:46.739723 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-47bb6bbe-c68d-4d5b-93b0-db51fc8cbfec tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.091079 Sep 05 17:30:46.740374 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1196/2543] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:46 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:46.967216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-27466a8b-7427-4168-90af-d780973bf78a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:46.968112 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-27466a8b-7427-4168-90af-d780973bf78a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:46.979148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27466a8b-7427-4168-90af-d780973bf78a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:46.979678 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27466a8b-7427-4168-90af-d780973bf78a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:46.980201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27466a8b-7427-4168-90af-d780973bf78a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:46.981257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27466a8b-7427-4168-90af-d780973bf78a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:46.981763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27466a8b-7427-4168-90af-d780973bf78a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:46.982220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27466a8b-7427-4168-90af-d780973bf78a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:47.131478 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-27466a8b-7427-4168-90af-d780973bf78a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:47.140304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-27466a8b-7427-4168-90af-d780973bf78a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.180380 Sep 05 17:30:47.140879 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1348/2544] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:46 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:47.768021 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-dd30515c-aa9a-4dc9-a277-b1fca8a333f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:47.769040 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-dd30515c-aa9a-4dc9-a277-b1fca8a333f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:47.779681 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd30515c-aa9a-4dc9-a277-b1fca8a333f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:47.780540 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd30515c-aa9a-4dc9-a277-b1fca8a333f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:47.781251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd30515c-aa9a-4dc9-a277-b1fca8a333f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:47.782367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd30515c-aa9a-4dc9-a277-b1fca8a333f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:47.783128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd30515c-aa9a-4dc9-a277-b1fca8a333f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:47.783831 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd30515c-aa9a-4dc9-a277-b1fca8a333f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:47.849201 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-dd30515c-aa9a-4dc9-a277-b1fca8a333f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:47.858747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-dd30515c-aa9a-4dc9-a277-b1fca8a333f2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.097837 Sep 05 17:30:47.859344 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1197/2545] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:47 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:48.168288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-92c669c8-9a53-45ac-801f-b2dbf0cfcd2b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:48.169373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-92c669c8-9a53-45ac-801f-b2dbf0cfcd2b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:48.180693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92c669c8-9a53-45ac-801f-b2dbf0cfcd2b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:48.181535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92c669c8-9a53-45ac-801f-b2dbf0cfcd2b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:48.182279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92c669c8-9a53-45ac-801f-b2dbf0cfcd2b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:48.183465 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92c669c8-9a53-45ac-801f-b2dbf0cfcd2b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:48.183928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92c669c8-9a53-45ac-801f-b2dbf0cfcd2b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:48.184391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92c669c8-9a53-45ac-801f-b2dbf0cfcd2b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:48.330010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-92c669c8-9a53-45ac-801f-b2dbf0cfcd2b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:48.338932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-92c669c8-9a53-45ac-801f-b2dbf0cfcd2b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.178099 Sep 05 17:30:48.339514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1349/2546] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:48 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:48.886720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-59d98f66-6d5a-4cf8-a29b-67a4a802a013 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:48.887698 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-59d98f66-6d5a-4cf8-a29b-67a4a802a013 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:48.898575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59d98f66-6d5a-4cf8-a29b-67a4a802a013 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:48.899357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59d98f66-6d5a-4cf8-a29b-67a4a802a013 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:48.900061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59d98f66-6d5a-4cf8-a29b-67a4a802a013 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:48.901369 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59d98f66-6d5a-4cf8-a29b-67a4a802a013 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:48.902387 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59d98f66-6d5a-4cf8-a29b-67a4a802a013 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:48.902819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-59d98f66-6d5a-4cf8-a29b-67a4a802a013 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:48.978469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-59d98f66-6d5a-4cf8-a29b-67a4a802a013 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:48.987741 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-59d98f66-6d5a-4cf8-a29b-67a4a802a013 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.107682 Sep 05 17:30:48.988622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1198/2547] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:48 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:49.363204 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c192cfa1-8ce8-4209-a430-d6f9ee537df1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:49.363837 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c192cfa1-8ce8-4209-a430-d6f9ee537df1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:49.370974 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c192cfa1-8ce8-4209-a430-d6f9ee537df1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:49.371507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c192cfa1-8ce8-4209-a430-d6f9ee537df1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:49.371859 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c192cfa1-8ce8-4209-a430-d6f9ee537df1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:49.372631 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c192cfa1-8ce8-4209-a430-d6f9ee537df1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:49.373072 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c192cfa1-8ce8-4209-a430-d6f9ee537df1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:49.373468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c192cfa1-8ce8-4209-a430-d6f9ee537df1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:49.521689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c192cfa1-8ce8-4209-a430-d6f9ee537df1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:49.536953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c192cfa1-8ce8-4209-a430-d6f9ee537df1 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.177666 Sep 05 17:30:49.537555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1350/2548] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:49 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:50.017479 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3e91dbcc-2ec0-4015-806d-93667fab4890 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:50.018443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3e91dbcc-2ec0-4015-806d-93667fab4890 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:50.029683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3e91dbcc-2ec0-4015-806d-93667fab4890 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:50.030449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3e91dbcc-2ec0-4015-806d-93667fab4890 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:50.031195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3e91dbcc-2ec0-4015-806d-93667fab4890 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:50.032373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3e91dbcc-2ec0-4015-806d-93667fab4890 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:50.033130 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3e91dbcc-2ec0-4015-806d-93667fab4890 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:50.033832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3e91dbcc-2ec0-4015-806d-93667fab4890 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:50.119468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3e91dbcc-2ec0-4015-806d-93667fab4890 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:50.128363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3e91dbcc-2ec0-4015-806d-93667fab4890 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.118388 Sep 05 17:30:50.128945 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1199/2549] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:50 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:50.564231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e5b43ce0-6e60-4520-a3f8-cd4c6c262c7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:50.565188 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e5b43ce0-6e60-4520-a3f8-cd4c6c262c7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:50.575076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5b43ce0-6e60-4520-a3f8-cd4c6c262c7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:50.575550 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5b43ce0-6e60-4520-a3f8-cd4c6c262c7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:50.575976 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5b43ce0-6e60-4520-a3f8-cd4c6c262c7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:50.576694 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5b43ce0-6e60-4520-a3f8-cd4c6c262c7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:50.577145 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5b43ce0-6e60-4520-a3f8-cd4c6c262c7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:50.577562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5b43ce0-6e60-4520-a3f8-cd4c6c262c7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:50.715758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e5b43ce0-6e60-4520-a3f8-cd4c6c262c7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:50.728717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e5b43ce0-6e60-4520-a3f8-cd4c6c262c7b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.170429 Sep 05 17:30:50.729651 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1351/2550] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:50 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:51.155850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0d551b0b-94da-478f-bd4b-e7d1af81ca8d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:51.156639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0d551b0b-94da-478f-bd4b-e7d1af81ca8d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:51.167271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d551b0b-94da-478f-bd4b-e7d1af81ca8d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:51.168009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d551b0b-94da-478f-bd4b-e7d1af81ca8d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:51.168697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d551b0b-94da-478f-bd4b-e7d1af81ca8d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:51.169756 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d551b0b-94da-478f-bd4b-e7d1af81ca8d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:51.170456 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d551b0b-94da-478f-bd4b-e7d1af81ca8d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:51.170979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d551b0b-94da-478f-bd4b-e7d1af81ca8d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:51.238240 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0d551b0b-94da-478f-bd4b-e7d1af81ca8d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:51.246661 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0d551b0b-94da-478f-bd4b-e7d1af81ca8d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.097401 Sep 05 17:30:51.247404 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1200/2551] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:51 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:51.756965 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2724f7c7-9ee3-4050-a9d3-0deae77fd510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:51.758008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2724f7c7-9ee3-4050-a9d3-0deae77fd510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:51.769109 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2724f7c7-9ee3-4050-a9d3-0deae77fd510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:51.769952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2724f7c7-9ee3-4050-a9d3-0deae77fd510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:51.770682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2724f7c7-9ee3-4050-a9d3-0deae77fd510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:51.772061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2724f7c7-9ee3-4050-a9d3-0deae77fd510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:51.772912 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2724f7c7-9ee3-4050-a9d3-0deae77fd510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:51.773591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2724f7c7-9ee3-4050-a9d3-0deae77fd510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:51.910061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2724f7c7-9ee3-4050-a9d3-0deae77fd510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:51.918901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2724f7c7-9ee3-4050-a9d3-0deae77fd510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.168576 Sep 05 17:30:51.919479 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1352/2552] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:51 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:52.272101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fc687ecc-cd78-467e-a8f0-d643929f6d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:52.272923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fc687ecc-cd78-467e-a8f0-d643929f6d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:52.281875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fc687ecc-cd78-467e-a8f0-d643929f6d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:52.282501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fc687ecc-cd78-467e-a8f0-d643929f6d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:52.283092 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fc687ecc-cd78-467e-a8f0-d643929f6d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:52.284001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fc687ecc-cd78-467e-a8f0-d643929f6d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:52.284625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fc687ecc-cd78-467e-a8f0-d643929f6d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:52.285207 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fc687ecc-cd78-467e-a8f0-d643929f6d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:52.357177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fc687ecc-cd78-467e-a8f0-d643929f6d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:52.365969 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fc687ecc-cd78-467e-a8f0-d643929f6d52 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.099054 Sep 05 17:30:52.366546 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1201/2553] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:52 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:52.946576 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-09da7159-9e05-4ced-b93c-13f4e8ccdcfc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:52.947560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-09da7159-9e05-4ced-b93c-13f4e8ccdcfc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:52.955033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09da7159-9e05-4ced-b93c-13f4e8ccdcfc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:52.955541 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09da7159-9e05-4ced-b93c-13f4e8ccdcfc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:52.955949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09da7159-9e05-4ced-b93c-13f4e8ccdcfc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:52.956673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09da7159-9e05-4ced-b93c-13f4e8ccdcfc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:52.957123 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09da7159-9e05-4ced-b93c-13f4e8ccdcfc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:52.957542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09da7159-9e05-4ced-b93c-13f4e8ccdcfc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:53.099224 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-09da7159-9e05-4ced-b93c-13f4e8ccdcfc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:53.107807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-09da7159-9e05-4ced-b93c-13f4e8ccdcfc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.167869 Sep 05 17:30:53.108398 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1353/2554] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:52 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:53.393771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-94a2b5f7-5930-4281-b56c-019625e69ad0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:53.394477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-94a2b5f7-5930-4281-b56c-019625e69ad0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:53.402992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-94a2b5f7-5930-4281-b56c-019625e69ad0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:53.403476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-94a2b5f7-5930-4281-b56c-019625e69ad0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:53.403906 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-94a2b5f7-5930-4281-b56c-019625e69ad0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:53.404632 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-94a2b5f7-5930-4281-b56c-019625e69ad0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:53.405082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-94a2b5f7-5930-4281-b56c-019625e69ad0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:53.405502 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-94a2b5f7-5930-4281-b56c-019625e69ad0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:53.477764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-94a2b5f7-5930-4281-b56c-019625e69ad0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:53.486709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-94a2b5f7-5930-4281-b56c-019625e69ad0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.101895 Sep 05 17:30:53.487196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1202/2555] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:53 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:54.135216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fe2af26d-f380-4f31-8291-427c19aebbd6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:54.136543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fe2af26d-f380-4f31-8291-427c19aebbd6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:54.147455 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe2af26d-f380-4f31-8291-427c19aebbd6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:54.148304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe2af26d-f380-4f31-8291-427c19aebbd6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:54.149073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe2af26d-f380-4f31-8291-427c19aebbd6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:54.151164 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe2af26d-f380-4f31-8291-427c19aebbd6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:54.152063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe2af26d-f380-4f31-8291-427c19aebbd6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:54.152749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe2af26d-f380-4f31-8291-427c19aebbd6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:54.287148 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fe2af26d-f380-4f31-8291-427c19aebbd6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:54.295578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fe2af26d-f380-4f31-8291-427c19aebbd6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.167158 Sep 05 17:30:54.296177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1354/2556] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:54 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:54.513374 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-882dd97a-0faa-40b2-af33-3451c2ec7512 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:54.514048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-882dd97a-0faa-40b2-af33-3451c2ec7512 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:54.522529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-882dd97a-0faa-40b2-af33-3451c2ec7512 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:54.523130 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-882dd97a-0faa-40b2-af33-3451c2ec7512 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:54.523700 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-882dd97a-0faa-40b2-af33-3451c2ec7512 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:54.524638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-882dd97a-0faa-40b2-af33-3451c2ec7512 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:54.525203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-882dd97a-0faa-40b2-af33-3451c2ec7512 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:54.525890 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-882dd97a-0faa-40b2-af33-3451c2ec7512 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:54.591126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-882dd97a-0faa-40b2-af33-3451c2ec7512 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:54.599726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-882dd97a-0faa-40b2-af33-3451c2ec7512 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.092495 Sep 05 17:30:54.600337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1203/2557] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:54 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:55.322113 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b9aec295-4a39-496a-a6f9-a4ce765c5806 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:55.323151 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b9aec295-4a39-496a-a6f9-a4ce765c5806 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:55.330462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9aec295-4a39-496a-a6f9-a4ce765c5806 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:55.330938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9aec295-4a39-496a-a6f9-a4ce765c5806 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:55.331364 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9aec295-4a39-496a-a6f9-a4ce765c5806 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:55.332053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9aec295-4a39-496a-a6f9-a4ce765c5806 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:55.332530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9aec295-4a39-496a-a6f9-a4ce765c5806 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:55.332950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9aec295-4a39-496a-a6f9-a4ce765c5806 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:55.480836 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b9aec295-4a39-496a-a6f9-a4ce765c5806 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:55.489775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b9aec295-4a39-496a-a6f9-a4ce765c5806 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.174281 Sep 05 17:30:55.490323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1355/2558] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:55 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:55.623192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3d2af42b-35f6-4127-867a-18836ade50b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:55.623800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3d2af42b-35f6-4127-867a-18836ade50b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:55.630763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d2af42b-35f6-4127-867a-18836ade50b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:55.631244 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d2af42b-35f6-4127-867a-18836ade50b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:55.631676 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d2af42b-35f6-4127-867a-18836ade50b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:55.632418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d2af42b-35f6-4127-867a-18836ade50b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:55.632870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d2af42b-35f6-4127-867a-18836ade50b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:55.633292 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d2af42b-35f6-4127-867a-18836ade50b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:55.708318 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3d2af42b-35f6-4127-867a-18836ade50b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:55.719985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3d2af42b-35f6-4127-867a-18836ade50b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.100719 Sep 05 17:30:55.720850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1204/2559] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:55 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:56.517856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9a85a60d-9905-4c41-8aa0-002613fd03b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:56.518937 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9a85a60d-9905-4c41-8aa0-002613fd03b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:56.530272 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a85a60d-9905-4c41-8aa0-002613fd03b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:56.531078 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a85a60d-9905-4c41-8aa0-002613fd03b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:56.531800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a85a60d-9905-4c41-8aa0-002613fd03b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:56.533024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a85a60d-9905-4c41-8aa0-002613fd03b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:56.533788 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a85a60d-9905-4c41-8aa0-002613fd03b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:56.534492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a85a60d-9905-4c41-8aa0-002613fd03b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:56.668137 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9a85a60d-9905-4c41-8aa0-002613fd03b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:56.676990 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9a85a60d-9905-4c41-8aa0-002613fd03b2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.166266 Sep 05 17:30:56.677532 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1356/2560] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:56 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:56.743781 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6ab8d82b-9d17-4c58-ade5-743aa8aa863d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:56.744421 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6ab8d82b-9d17-4c58-ade5-743aa8aa863d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:56.751236 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ab8d82b-9d17-4c58-ade5-743aa8aa863d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:56.751709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ab8d82b-9d17-4c58-ade5-743aa8aa863d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:56.752131 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ab8d82b-9d17-4c58-ade5-743aa8aa863d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:56.752854 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ab8d82b-9d17-4c58-ade5-743aa8aa863d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:56.753272 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ab8d82b-9d17-4c58-ade5-743aa8aa863d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:56.753682 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ab8d82b-9d17-4c58-ade5-743aa8aa863d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:56.814743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6ab8d82b-9d17-4c58-ade5-743aa8aa863d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:56.823148 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6ab8d82b-9d17-4c58-ade5-743aa8aa863d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.083338 Sep 05 17:30:56.823831 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1205/2561] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:56 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:57.705337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0beccd12-7e4f-402d-8d9e-f004cbf5f822 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:57.706127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0beccd12-7e4f-402d-8d9e-f004cbf5f822 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:57.716429 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0beccd12-7e4f-402d-8d9e-f004cbf5f822 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:57.716930 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0beccd12-7e4f-402d-8d9e-f004cbf5f822 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:57.717342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0beccd12-7e4f-402d-8d9e-f004cbf5f822 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:57.718033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0beccd12-7e4f-402d-8d9e-f004cbf5f822 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:57.718477 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0beccd12-7e4f-402d-8d9e-f004cbf5f822 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:57.718895 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0beccd12-7e4f-402d-8d9e-f004cbf5f822 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:57.846699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-38c7a73d-4257-4021-aa44-6eadd58114c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:57.847346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-38c7a73d-4257-4021-aa44-6eadd58114c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:57.854099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38c7a73d-4257-4021-aa44-6eadd58114c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:57.854583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38c7a73d-4257-4021-aa44-6eadd58114c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:57.855664 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38c7a73d-4257-4021-aa44-6eadd58114c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:57.856454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38c7a73d-4257-4021-aa44-6eadd58114c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:57.856911 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38c7a73d-4257-4021-aa44-6eadd58114c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:57.857500 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38c7a73d-4257-4021-aa44-6eadd58114c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:57.874413 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:30:58.109624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0beccd12-7e4f-402d-8d9e-f004cbf5f822 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:58.118189 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0beccd12-7e4f-402d-8d9e-f004cbf5f822 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.420701 Sep 05 17:30:58.118737 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1357/2562] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:57 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:58.124763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-38c7a73d-4257-4021-aa44-6eadd58114c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:58.133323 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-38c7a73d-4257-4021-aa44-6eadd58114c3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.290868 Sep 05 17:30:58.133920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1206/2563] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:57 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:59.143914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-99b3112b-2d54-4b48-aa3e-abb1fcc1749f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:59.145137 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-99b3112b-2d54-4b48-aa3e-abb1fcc1749f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:59.152356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99b3112b-2d54-4b48-aa3e-abb1fcc1749f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:59.152869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99b3112b-2d54-4b48-aa3e-abb1fcc1749f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:59.153301 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99b3112b-2d54-4b48-aa3e-abb1fcc1749f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:59.154576 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99b3112b-2d54-4b48-aa3e-abb1fcc1749f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:59.155033 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99b3112b-2d54-4b48-aa3e-abb1fcc1749f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:59.155457 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99b3112b-2d54-4b48-aa3e-abb1fcc1749f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:59.163072 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-912ecc57-2f69-4088-99d7-bd3274671a30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:30:59.163707 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-912ecc57-2f69-4088-99d7-bd3274671a30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:30:59.171236 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-912ecc57-2f69-4088-99d7-bd3274671a30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:59.172476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-912ecc57-2f69-4088-99d7-bd3274671a30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:59.173237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-912ecc57-2f69-4088-99d7-bd3274671a30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:59.174005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-912ecc57-2f69-4088-99d7-bd3274671a30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:30:59.174501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-912ecc57-2f69-4088-99d7-bd3274671a30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:30:59.175181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-912ecc57-2f69-4088-99d7-bd3274671a30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:30:59.254011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-912ecc57-2f69-4088-99d7-bd3274671a30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:59.262505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-912ecc57-2f69-4088-99d7-bd3274671a30 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.103329 Sep 05 17:30:59.263232 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1207/2564] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:59 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:30:59.321267 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-99b3112b-2d54-4b48-aa3e-abb1fcc1749f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:30:59.329733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-99b3112b-2d54-4b48-aa3e-abb1fcc1749f tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.191721 Sep 05 17:30:59.330292 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1358/2565] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:30:59 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:00.290155 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-99f76f8a-c167-4470-857b-26ea36ef1185 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:00.291140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-99f76f8a-c167-4470-857b-26ea36ef1185 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:00.299444 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99f76f8a-c167-4470-857b-26ea36ef1185 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:00.299924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99f76f8a-c167-4470-857b-26ea36ef1185 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:00.300396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99f76f8a-c167-4470-857b-26ea36ef1185 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:00.301080 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99f76f8a-c167-4470-857b-26ea36ef1185 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:00.301532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99f76f8a-c167-4470-857b-26ea36ef1185 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:00.301948 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-99f76f8a-c167-4470-857b-26ea36ef1185 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:00.353971 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6fa292ae-f257-4d03-99f0-bfbb52580c52 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:00.354598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6fa292ae-f257-4d03-99f0-bfbb52580c52 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:00.360913 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fa292ae-f257-4d03-99f0-bfbb52580c52 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:00.361391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fa292ae-f257-4d03-99f0-bfbb52580c52 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:00.361820 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fa292ae-f257-4d03-99f0-bfbb52580c52 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:00.362506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fa292ae-f257-4d03-99f0-bfbb52580c52 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:00.362953 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fa292ae-f257-4d03-99f0-bfbb52580c52 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:00.363372 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fa292ae-f257-4d03-99f0-bfbb52580c52 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:00.379154 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-99f76f8a-c167-4470-857b-26ea36ef1185 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:00.387975 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-99f76f8a-c167-4470-857b-26ea36ef1185 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.104264 Sep 05 17:31:00.388811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1208/2566] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:00 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:00.495280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6fa292ae-f257-4d03-99f0-bfbb52580c52 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:00.503872 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6fa292ae-f257-4d03-99f0-bfbb52580c52 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.153909 Sep 05 17:31:00.504477 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1359/2567] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:00 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:01.411160 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-431d0db5-8e29-4284-a0c7-d6d79f58fc40 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:01.411771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-431d0db5-8e29-4284-a0c7-d6d79f58fc40 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:01.414139 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=54 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:31:01.419372 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-431d0db5-8e29-4284-a0c7-d6d79f58fc40 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:01.419851 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-431d0db5-8e29-4284-a0c7-d6d79f58fc40 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:01.420304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-431d0db5-8e29-4284-a0c7-d6d79f58fc40 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:01.420986 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-431d0db5-8e29-4284-a0c7-d6d79f58fc40 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:01.421433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-431d0db5-8e29-4284-a0c7-d6d79f58fc40 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:01.421846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-431d0db5-8e29-4284-a0c7-d6d79f58fc40 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:01.483295 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-431d0db5-8e29-4284-a0c7-d6d79f58fc40 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:01.491929 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-431d0db5-8e29-4284-a0c7-d6d79f58fc40 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.084692 Sep 05 17:31:01.492560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1209/2568] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:01 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:01.527403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3eb6b646-7f7e-4798-9d0e-c38a2f2d6db7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:01.527966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3eb6b646-7f7e-4798-9d0e-c38a2f2d6db7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:01.534802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3eb6b646-7f7e-4798-9d0e-c38a2f2d6db7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:01.535280 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3eb6b646-7f7e-4798-9d0e-c38a2f2d6db7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:01.535707 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3eb6b646-7f7e-4798-9d0e-c38a2f2d6db7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:01.536433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3eb6b646-7f7e-4798-9d0e-c38a2f2d6db7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:01.536881 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3eb6b646-7f7e-4798-9d0e-c38a2f2d6db7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:01.537294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3eb6b646-7f7e-4798-9d0e-c38a2f2d6db7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:01.680408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3eb6b646-7f7e-4798-9d0e-c38a2f2d6db7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:01.689988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3eb6b646-7f7e-4798-9d0e-c38a2f2d6db7 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.166849 Sep 05 17:31:01.690577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1360/2569] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:01 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:02.515418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-619724fa-ab07-411d-80fa-6f16bd655b44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:02.516028 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-619724fa-ab07-411d-80fa-6f16bd655b44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:02.522650 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-619724fa-ab07-411d-80fa-6f16bd655b44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:02.523125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-619724fa-ab07-411d-80fa-6f16bd655b44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:02.523552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-619724fa-ab07-411d-80fa-6f16bd655b44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:02.524252 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-619724fa-ab07-411d-80fa-6f16bd655b44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:02.524702 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-619724fa-ab07-411d-80fa-6f16bd655b44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:02.525109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-619724fa-ab07-411d-80fa-6f16bd655b44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:02.586024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-619724fa-ab07-411d-80fa-6f16bd655b44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:02.595349 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-619724fa-ab07-411d-80fa-6f16bd655b44 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.084176 Sep 05 17:31:02.595918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1210/2570] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:02 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:02.719359 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b5f662c4-b175-4187-bbc8-31ef80eba259 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:02.720331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b5f662c4-b175-4187-bbc8-31ef80eba259 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:02.724215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=50 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:31:02.733968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5f662c4-b175-4187-bbc8-31ef80eba259 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:02.734470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5f662c4-b175-4187-bbc8-31ef80eba259 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:02.734910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5f662c4-b175-4187-bbc8-31ef80eba259 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:02.735614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5f662c4-b175-4187-bbc8-31ef80eba259 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:02.736054 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5f662c4-b175-4187-bbc8-31ef80eba259 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:02.736501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5f662c4-b175-4187-bbc8-31ef80eba259 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:02.739244 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:31:02.871009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b5f662c4-b175-4187-bbc8-31ef80eba259 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:02.880060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b5f662c4-b175-4187-bbc8-31ef80eba259 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.168716 Sep 05 17:31:02.880669 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1361/2571] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:02 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:03.622443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e172bf7b-f31b-4bda-aac4-6b28f6332ed9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:03.623446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e172bf7b-f31b-4bda-aac4-6b28f6332ed9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:03.630591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e172bf7b-f31b-4bda-aac4-6b28f6332ed9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:03.630998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e172bf7b-f31b-4bda-aac4-6b28f6332ed9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:03.631419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e172bf7b-f31b-4bda-aac4-6b28f6332ed9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:03.632091 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e172bf7b-f31b-4bda-aac4-6b28f6332ed9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:03.632573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e172bf7b-f31b-4bda-aac4-6b28f6332ed9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:03.633038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e172bf7b-f31b-4bda-aac4-6b28f6332ed9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:03.694931 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e172bf7b-f31b-4bda-aac4-6b28f6332ed9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:03.703278 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e172bf7b-f31b-4bda-aac4-6b28f6332ed9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.087390 Sep 05 17:31:03.703838 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1211/2572] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:03 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:03.903353 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-da473217-0322-4613-b505-2ee6ceace14e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:03.903978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-da473217-0322-4613-b505-2ee6ceace14e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:03.911797 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da473217-0322-4613-b505-2ee6ceace14e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:03.912397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da473217-0322-4613-b505-2ee6ceace14e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:03.912823 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da473217-0322-4613-b505-2ee6ceace14e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:03.913513 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da473217-0322-4613-b505-2ee6ceace14e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:03.913955 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da473217-0322-4613-b505-2ee6ceace14e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:03.914367 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da473217-0322-4613-b505-2ee6ceace14e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:04.047611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-da473217-0322-4613-b505-2ee6ceace14e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:04.056481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-da473217-0322-4613-b505-2ee6ceace14e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.157093 Sep 05 17:31:04.057065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1362/2573] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:03 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:04.735083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8d75e513-b4c6-4d72-b59e-b04916f6e901 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:04.735842 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8d75e513-b4c6-4d72-b59e-b04916f6e901 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:04.744365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d75e513-b4c6-4d72-b59e-b04916f6e901 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:04.744973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d75e513-b4c6-4d72-b59e-b04916f6e901 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:04.745513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d75e513-b4c6-4d72-b59e-b04916f6e901 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:04.746373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d75e513-b4c6-4d72-b59e-b04916f6e901 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:04.746942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d75e513-b4c6-4d72-b59e-b04916f6e901 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:04.747461 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8d75e513-b4c6-4d72-b59e-b04916f6e901 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:04.812669 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8d75e513-b4c6-4d72-b59e-b04916f6e901 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:04.821452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8d75e513-b4c6-4d72-b59e-b04916f6e901 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.093086 Sep 05 17:31:04.822044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1212/2574] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:04 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:05.083331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-36824120-e410-4a0e-8859-72f23dfb36a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:05.084354 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-36824120-e410-4a0e-8859-72f23dfb36a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:05.094724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36824120-e410-4a0e-8859-72f23dfb36a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:05.095202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36824120-e410-4a0e-8859-72f23dfb36a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:05.095633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36824120-e410-4a0e-8859-72f23dfb36a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:05.096360 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36824120-e410-4a0e-8859-72f23dfb36a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:05.096809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36824120-e410-4a0e-8859-72f23dfb36a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:05.097226 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36824120-e410-4a0e-8859-72f23dfb36a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:05.239326 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-36824120-e410-4a0e-8859-72f23dfb36a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:05.248307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-36824120-e410-4a0e-8859-72f23dfb36a0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.171552 Sep 05 17:31:05.248999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1363/2575] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:05 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:05.846848 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2f87b069-ccc6-4bf5-8d07-93ff827367c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:05.847434 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2f87b069-ccc6-4bf5-8d07-93ff827367c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:05.854469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f87b069-ccc6-4bf5-8d07-93ff827367c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:05.854952 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f87b069-ccc6-4bf5-8d07-93ff827367c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:05.855381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f87b069-ccc6-4bf5-8d07-93ff827367c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:05.856076 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f87b069-ccc6-4bf5-8d07-93ff827367c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:05.856563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f87b069-ccc6-4bf5-8d07-93ff827367c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:05.856989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2f87b069-ccc6-4bf5-8d07-93ff827367c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:05.919834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2f87b069-ccc6-4bf5-8d07-93ff827367c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:05.928407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2f87b069-ccc6-4bf5-8d07-93ff827367c4 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.085855 Sep 05 17:31:05.928955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1213/2576] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:05 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:06.276565 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4a9210f9-b877-4dbf-bd4b-97ca2464d965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:06.277580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4a9210f9-b877-4dbf-bd4b-97ca2464d965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:06.288757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a9210f9-b877-4dbf-bd4b-97ca2464d965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:06.289548 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a9210f9-b877-4dbf-bd4b-97ca2464d965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:06.290250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a9210f9-b877-4dbf-bd4b-97ca2464d965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:06.291368 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a9210f9-b877-4dbf-bd4b-97ca2464d965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:06.292102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a9210f9-b877-4dbf-bd4b-97ca2464d965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:06.292838 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a9210f9-b877-4dbf-bd4b-97ca2464d965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:06.432627 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4a9210f9-b877-4dbf-bd4b-97ca2464d965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:06.446888 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4a9210f9-b877-4dbf-bd4b-97ca2464d965 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.177283 Sep 05 17:31:06.447708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1364/2577] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:06 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:06.954837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7449eb57-b1ef-429d-a866-1e46b7af42e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:06.955649 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7449eb57-b1ef-429d-a866-1e46b7af42e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:06.963914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7449eb57-b1ef-429d-a866-1e46b7af42e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:06.964545 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7449eb57-b1ef-429d-a866-1e46b7af42e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:06.965440 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7449eb57-b1ef-429d-a866-1e46b7af42e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:06.966277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7449eb57-b1ef-429d-a866-1e46b7af42e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:06.966910 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7449eb57-b1ef-429d-a866-1e46b7af42e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:06.967903 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7449eb57-b1ef-429d-a866-1e46b7af42e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:07.033575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7449eb57-b1ef-429d-a866-1e46b7af42e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:07.042124 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7449eb57-b1ef-429d-a866-1e46b7af42e3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.093093 Sep 05 17:31:07.042718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1214/2578] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:06 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:07.474024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b6b115d4-fcb3-491f-a1ef-1d25f9375745 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:07.474832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b6b115d4-fcb3-491f-a1ef-1d25f9375745 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:07.483704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b115d4-fcb3-491f-a1ef-1d25f9375745 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:07.484407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b115d4-fcb3-491f-a1ef-1d25f9375745 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:07.484974 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b115d4-fcb3-491f-a1ef-1d25f9375745 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:07.485945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b115d4-fcb3-491f-a1ef-1d25f9375745 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:07.486509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b115d4-fcb3-491f-a1ef-1d25f9375745 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:07.487065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b115d4-fcb3-491f-a1ef-1d25f9375745 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:07.624135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b6b115d4-fcb3-491f-a1ef-1d25f9375745 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:07.632947 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b6b115d4-fcb3-491f-a1ef-1d25f9375745 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.164417 Sep 05 17:31:07.633436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1365/2579] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:07 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:08.070459 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d5f2ea81-9084-4e16-97d5-7fbbefbdb4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:08.071313 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d5f2ea81-9084-4e16-97d5-7fbbefbdb4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:08.082548 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5f2ea81-9084-4e16-97d5-7fbbefbdb4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:08.083394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5f2ea81-9084-4e16-97d5-7fbbefbdb4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:08.084109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5f2ea81-9084-4e16-97d5-7fbbefbdb4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:08.085289 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5f2ea81-9084-4e16-97d5-7fbbefbdb4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:08.086039 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5f2ea81-9084-4e16-97d5-7fbbefbdb4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:08.086742 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5f2ea81-9084-4e16-97d5-7fbbefbdb4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:08.153330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d5f2ea81-9084-4e16-97d5-7fbbefbdb4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:08.162405 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d5f2ea81-9084-4e16-97d5-7fbbefbdb4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.098677 Sep 05 17:31:08.162979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1215/2580] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:08 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:08.660776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-968aa2d4-fe8e-413c-94e0-e738781d09ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:08.661688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-968aa2d4-fe8e-413c-94e0-e738781d09ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:08.672244 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-968aa2d4-fe8e-413c-94e0-e738781d09ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:08.672716 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-968aa2d4-fe8e-413c-94e0-e738781d09ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:08.673144 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-968aa2d4-fe8e-413c-94e0-e738781d09ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:08.673822 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-968aa2d4-fe8e-413c-94e0-e738781d09ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:08.674270 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-968aa2d4-fe8e-413c-94e0-e738781d09ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:08.674691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-968aa2d4-fe8e-413c-94e0-e738781d09ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:08.816262 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-968aa2d4-fe8e-413c-94e0-e738781d09ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:08.825154 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-968aa2d4-fe8e-413c-94e0-e738781d09ff tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.171648 Sep 05 17:31:08.825782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1366/2581] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:08 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:09.189434 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-577db1f1-ef1f-4925-9d53-f41d36eca4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:09.190418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-577db1f1-ef1f-4925-9d53-f41d36eca4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:09.201394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-577db1f1-ef1f-4925-9d53-f41d36eca4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:09.202363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-577db1f1-ef1f-4925-9d53-f41d36eca4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:09.202849 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-577db1f1-ef1f-4925-9d53-f41d36eca4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:09.203468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-577db1f1-ef1f-4925-9d53-f41d36eca4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:09.203919 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-577db1f1-ef1f-4925-9d53-f41d36eca4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:09.204373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-577db1f1-ef1f-4925-9d53-f41d36eca4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:09.267743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-577db1f1-ef1f-4925-9d53-f41d36eca4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:09.276472 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-577db1f1-ef1f-4925-9d53-f41d36eca4f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.093821 Sep 05 17:31:09.277040 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1216/2582] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:09 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:09.853225 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7ba91102-226d-43e1-a629-3685913ed510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:09.854236 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7ba91102-226d-43e1-a629-3685913ed510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:09.865248 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ba91102-226d-43e1-a629-3685913ed510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:09.866044 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ba91102-226d-43e1-a629-3685913ed510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:09.866769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ba91102-226d-43e1-a629-3685913ed510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:09.867958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ba91102-226d-43e1-a629-3685913ed510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:09.868757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ba91102-226d-43e1-a629-3685913ed510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:09.869455 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ba91102-226d-43e1-a629-3685913ed510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:10.014749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7ba91102-226d-43e1-a629-3685913ed510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:10.028110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7ba91102-226d-43e1-a629-3685913ed510 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.181127 Sep 05 17:31:10.028906 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1367/2583] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:09 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:10.301205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-48964db7-3608-46b9-a9a0-21063b033960 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:10.301850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-48964db7-3608-46b9-a9a0-21063b033960 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:10.309669 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-48964db7-3608-46b9-a9a0-21063b033960 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:10.310235 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-48964db7-3608-46b9-a9a0-21063b033960 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:10.310735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-48964db7-3608-46b9-a9a0-21063b033960 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:10.311684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-48964db7-3608-46b9-a9a0-21063b033960 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:10.312584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-48964db7-3608-46b9-a9a0-21063b033960 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:10.313012 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-48964db7-3608-46b9-a9a0-21063b033960 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:10.383689 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-48964db7-3608-46b9-a9a0-21063b033960 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:10.392792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-48964db7-3608-46b9-a9a0-21063b033960 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.096873 Sep 05 17:31:10.393365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1217/2584] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:10 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:11.062772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-175c499c-6ab1-4eb0-8647-c15967f3a766 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:11.063581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-175c499c-6ab1-4eb0-8647-c15967f3a766 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:11.071988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-175c499c-6ab1-4eb0-8647-c15967f3a766 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:11.072635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-175c499c-6ab1-4eb0-8647-c15967f3a766 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:11.073176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-175c499c-6ab1-4eb0-8647-c15967f3a766 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:11.074028 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-175c499c-6ab1-4eb0-8647-c15967f3a766 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:11.074591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-175c499c-6ab1-4eb0-8647-c15967f3a766 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:11.075133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-175c499c-6ab1-4eb0-8647-c15967f3a766 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:11.230893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-175c499c-6ab1-4eb0-8647-c15967f3a766 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:11.239634 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-175c499c-6ab1-4eb0-8647-c15967f3a766 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.183383 Sep 05 17:31:11.240241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1368/2585] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:11 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:11.419317 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-70e53a5f-54dd-4824-8c22-f631e124129d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:11.419938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-70e53a5f-54dd-4824-8c22-f631e124129d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:11.426961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-70e53a5f-54dd-4824-8c22-f631e124129d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:11.427446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-70e53a5f-54dd-4824-8c22-f631e124129d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:11.427880 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-70e53a5f-54dd-4824-8c22-f631e124129d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:11.428605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-70e53a5f-54dd-4824-8c22-f631e124129d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:11.429055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-70e53a5f-54dd-4824-8c22-f631e124129d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:11.429480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-70e53a5f-54dd-4824-8c22-f631e124129d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:11.499786 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-70e53a5f-54dd-4824-8c22-f631e124129d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:11.508804 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-70e53a5f-54dd-4824-8c22-f631e124129d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.093483 Sep 05 17:31:11.509375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1218/2586] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:11 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:12.263361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fbbc5609-7e0c-4705-9aa1-cc6ea69b71af tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:12.264026 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fbbc5609-7e0c-4705-9aa1-cc6ea69b71af tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:12.271005 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbbc5609-7e0c-4705-9aa1-cc6ea69b71af tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:12.271485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbbc5609-7e0c-4705-9aa1-cc6ea69b71af tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:12.271907 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbbc5609-7e0c-4705-9aa1-cc6ea69b71af tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:12.272640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbbc5609-7e0c-4705-9aa1-cc6ea69b71af tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:12.273095 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbbc5609-7e0c-4705-9aa1-cc6ea69b71af tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:12.273532 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbbc5609-7e0c-4705-9aa1-cc6ea69b71af tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:12.420483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fbbc5609-7e0c-4705-9aa1-cc6ea69b71af tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:12.429718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fbbc5609-7e0c-4705-9aa1-cc6ea69b71af tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.170325 Sep 05 17:31:12.430296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1369/2587] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:12 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:12.532716 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5df07f2b-965f-49b8-9451-c5f5a45204e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:12.533284 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5df07f2b-965f-49b8-9451-c5f5a45204e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:12.540114 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5df07f2b-965f-49b8-9451-c5f5a45204e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:12.540631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5df07f2b-965f-49b8-9451-c5f5a45204e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:12.541064 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5df07f2b-965f-49b8-9451-c5f5a45204e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:12.541790 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5df07f2b-965f-49b8-9451-c5f5a45204e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:12.542241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5df07f2b-965f-49b8-9451-c5f5a45204e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:12.542667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5df07f2b-965f-49b8-9451-c5f5a45204e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:12.605084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5df07f2b-965f-49b8-9451-c5f5a45204e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:12.614206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5df07f2b-965f-49b8-9451-c5f5a45204e2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.086309 Sep 05 17:31:12.614764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1219/2588] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:12 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:13.453785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-df98dec8-be48-4942-b191-f1ba6763c11c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:13.454372 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-df98dec8-be48-4942-b191-f1ba6763c11c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:13.461727 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df98dec8-be48-4942-b191-f1ba6763c11c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:13.462203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df98dec8-be48-4942-b191-f1ba6763c11c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:13.462629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df98dec8-be48-4942-b191-f1ba6763c11c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:13.463312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df98dec8-be48-4942-b191-f1ba6763c11c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:13.463758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df98dec8-be48-4942-b191-f1ba6763c11c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:13.464198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df98dec8-be48-4942-b191-f1ba6763c11c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:13.604034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-df98dec8-be48-4942-b191-f1ba6763c11c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:13.616752 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-df98dec8-be48-4942-b191-f1ba6763c11c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.167021 Sep 05 17:31:13.617567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1370/2589] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:13 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:13.642680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-82bf540c-2858-435f-bd97-c2a2ae76812b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:13.643222 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-82bf540c-2858-435f-bd97-c2a2ae76812b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:13.649334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-82bf540c-2858-435f-bd97-c2a2ae76812b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:13.649818 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-82bf540c-2858-435f-bd97-c2a2ae76812b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:13.650242 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-82bf540c-2858-435f-bd97-c2a2ae76812b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:13.650918 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-82bf540c-2858-435f-bd97-c2a2ae76812b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:13.651360 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-82bf540c-2858-435f-bd97-c2a2ae76812b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:13.651770 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-82bf540c-2858-435f-bd97-c2a2ae76812b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:13.720532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-82bf540c-2858-435f-bd97-c2a2ae76812b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:13.728765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-82bf540c-2858-435f-bd97-c2a2ae76812b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.092064 Sep 05 17:31:13.729329 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1220/2590] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:13 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:14.642569 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-016a84f7-3f54-4631-8871-2d3fcc1ed8c4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:14.643211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-016a84f7-3f54-4631-8871-2d3fcc1ed8c4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:14.650344 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-016a84f7-3f54-4631-8871-2d3fcc1ed8c4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:14.650852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-016a84f7-3f54-4631-8871-2d3fcc1ed8c4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:14.651304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-016a84f7-3f54-4631-8871-2d3fcc1ed8c4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:14.652029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-016a84f7-3f54-4631-8871-2d3fcc1ed8c4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:14.652543 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-016a84f7-3f54-4631-8871-2d3fcc1ed8c4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:14.652992 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-016a84f7-3f54-4631-8871-2d3fcc1ed8c4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:14.753769 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-51ad06c3-d5dc-44b4-950f-afedb3177a08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:14.754364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-51ad06c3-d5dc-44b4-950f-afedb3177a08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:14.760491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51ad06c3-d5dc-44b4-950f-afedb3177a08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:14.760969 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51ad06c3-d5dc-44b4-950f-afedb3177a08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:14.761400 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51ad06c3-d5dc-44b4-950f-afedb3177a08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:14.762088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51ad06c3-d5dc-44b4-950f-afedb3177a08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:14.762532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51ad06c3-d5dc-44b4-950f-afedb3177a08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:14.762947 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-51ad06c3-d5dc-44b4-950f-afedb3177a08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:14.786356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-016a84f7-3f54-4631-8871-2d3fcc1ed8c4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:14.794516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-016a84f7-3f54-4631-8871-2d3fcc1ed8c4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.157408 Sep 05 17:31:14.795287 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1371/2591] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:14 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:14.825689 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-51ad06c3-d5dc-44b4-950f-afedb3177a08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:14.834361 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-51ad06c3-d5dc-44b4-950f-afedb3177a08 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.085617 Sep 05 17:31:14.834934 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1221/2592] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:14 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:31:15.819432 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f9089dd0-8899-4511-99fa-30e8caee2bae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:15.820058 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f9089dd0-8899-4511-99fa-30e8caee2bae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:15.827572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9089dd0-8899-4511-99fa-30e8caee2bae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:15.828338 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9089dd0-8899-4511-99fa-30e8caee2bae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:15.828798 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9089dd0-8899-4511-99fa-30e8caee2bae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:15.829519 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9089dd0-8899-4511-99fa-30e8caee2bae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:15.829988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9089dd0-8899-4511-99fa-30e8caee2bae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:15.830439 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9089dd0-8899-4511-99fa-30e8caee2bae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:15.858221 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b18b9ba3-36c6-4613-8ea0-ea9e834a4b50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:15.859789 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b18b9ba3-36c6-4613-8ea0-ea9e834a4b50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:15.866697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b18b9ba3-36c6-4613-8ea0-ea9e834a4b50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:15.867179 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b18b9ba3-36c6-4613-8ea0-ea9e834a4b50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:15.867607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b18b9ba3-36c6-4613-8ea0-ea9e834a4b50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:15.868319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b18b9ba3-36c6-4613-8ea0-ea9e834a4b50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:15.868770 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b18b9ba3-36c6-4613-8ea0-ea9e834a4b50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:15.869183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b18b9ba3-36c6-4613-8ea0-ea9e834a4b50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:15.945338 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b18b9ba3-36c6-4613-8ea0-ea9e834a4b50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:15.953997 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b18b9ba3-36c6-4613-8ea0-ea9e834a4b50 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.099785 Sep 05 17:31:15.954827 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1222/2593] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:15 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:15.982433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f9089dd0-8899-4511-99fa-30e8caee2bae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:15.991432 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f9089dd0-8899-4511-99fa-30e8caee2bae tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.176312 Sep 05 17:31:15.991968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1372/2594] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:15 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:16.981727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-093f011e-cc0d-451d-aaee-959a62dc74c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:16.982706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-093f011e-cc0d-451d-aaee-959a62dc74c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:16.990193 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-093f011e-cc0d-451d-aaee-959a62dc74c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:16.990711 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-093f011e-cc0d-451d-aaee-959a62dc74c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:16.991135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-093f011e-cc0d-451d-aaee-959a62dc74c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:16.991819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-093f011e-cc0d-451d-aaee-959a62dc74c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:16.992297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-093f011e-cc0d-451d-aaee-959a62dc74c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:16.992718 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-093f011e-cc0d-451d-aaee-959a62dc74c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:16.995277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:31:17.014643 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a5859c96-67c7-4209-917a-ae5bd30608b3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:17.015242 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a5859c96-67c7-4209-917a-ae5bd30608b3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:17.022088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5859c96-67c7-4209-917a-ae5bd30608b3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:17.022576 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5859c96-67c7-4209-917a-ae5bd30608b3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:17.023010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5859c96-67c7-4209-917a-ae5bd30608b3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:17.023737 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5859c96-67c7-4209-917a-ae5bd30608b3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:17.024192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5859c96-67c7-4209-917a-ae5bd30608b3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:17.024632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5859c96-67c7-4209-917a-ae5bd30608b3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:17.056522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-093f011e-cc0d-451d-aaee-959a62dc74c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:17.065366 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-093f011e-cc0d-451d-aaee-959a62dc74c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.090368 Sep 05 17:31:17.065930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1223/2595] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:16 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:17.167625 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a5859c96-67c7-4209-917a-ae5bd30608b3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:17.176997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a5859c96-67c7-4209-917a-ae5bd30608b3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.166407 Sep 05 17:31:17.177605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1373/2596] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:17 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:18.092086 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4f51776e-7d1e-4251-90c3-d6215bdfa299 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:18.093121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4f51776e-7d1e-4251-90c3-d6215bdfa299 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:18.100183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f51776e-7d1e-4251-90c3-d6215bdfa299 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:18.100696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f51776e-7d1e-4251-90c3-d6215bdfa299 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:18.101146 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f51776e-7d1e-4251-90c3-d6215bdfa299 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:18.101854 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f51776e-7d1e-4251-90c3-d6215bdfa299 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:18.102326 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f51776e-7d1e-4251-90c3-d6215bdfa299 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:18.102761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4f51776e-7d1e-4251-90c3-d6215bdfa299 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:18.166367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4f51776e-7d1e-4251-90c3-d6215bdfa299 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:18.175347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4f51776e-7d1e-4251-90c3-d6215bdfa299 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.090158 Sep 05 17:31:18.175912 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1224/2597] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:18 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:18.200621 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-60a97077-d502-4c1a-9a4c-2fe316c9dde4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:18.201210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-60a97077-d502-4c1a-9a4c-2fe316c9dde4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:18.207979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60a97077-d502-4c1a-9a4c-2fe316c9dde4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:18.208492 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60a97077-d502-4c1a-9a4c-2fe316c9dde4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:18.208924 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60a97077-d502-4c1a-9a4c-2fe316c9dde4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:18.209603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60a97077-d502-4c1a-9a4c-2fe316c9dde4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:18.210022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60a97077-d502-4c1a-9a4c-2fe316c9dde4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:18.210437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60a97077-d502-4c1a-9a4c-2fe316c9dde4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:18.347701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-60a97077-d502-4c1a-9a4c-2fe316c9dde4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:18.359375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-60a97077-d502-4c1a-9a4c-2fe316c9dde4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.162992 Sep 05 17:31:18.359949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1374/2598] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:18 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:19.201979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-38d7b95d-8183-4b3e-9062-1b173e28890f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:19.202854 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-38d7b95d-8183-4b3e-9062-1b173e28890f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:19.210041 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38d7b95d-8183-4b3e-9062-1b173e28890f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:19.210524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38d7b95d-8183-4b3e-9062-1b173e28890f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:19.210949 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38d7b95d-8183-4b3e-9062-1b173e28890f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:19.211773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38d7b95d-8183-4b3e-9062-1b173e28890f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:19.212573 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38d7b95d-8183-4b3e-9062-1b173e28890f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:19.213271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-38d7b95d-8183-4b3e-9062-1b173e28890f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:19.288007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-38d7b95d-8183-4b3e-9062-1b173e28890f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:19.297449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-38d7b95d-8183-4b3e-9062-1b173e28890f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.101707 Sep 05 17:31:19.298024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1225/2599] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:19 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:19.383687 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-df9bdd3b-7f4a-4dc5-b94a-016a27f30ff6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:19.384288 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-df9bdd3b-7f4a-4dc5-b94a-016a27f30ff6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:19.392309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df9bdd3b-7f4a-4dc5-b94a-016a27f30ff6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:19.392803 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df9bdd3b-7f4a-4dc5-b94a-016a27f30ff6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:19.393241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df9bdd3b-7f4a-4dc5-b94a-016a27f30ff6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:19.393985 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df9bdd3b-7f4a-4dc5-b94a-016a27f30ff6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:19.394441 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df9bdd3b-7f4a-4dc5-b94a-016a27f30ff6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:19.394844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df9bdd3b-7f4a-4dc5-b94a-016a27f30ff6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:19.530600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-df9bdd3b-7f4a-4dc5-b94a-016a27f30ff6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:19.539195 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-df9bdd3b-7f4a-4dc5-b94a-016a27f30ff6 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.160177 Sep 05 17:31:19.539776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1375/2600] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:19 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:20.330923 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9eb2dd08-5ee4-45d3-9c15-200b1873596b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:20.331901 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9eb2dd08-5ee4-45d3-9c15-200b1873596b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:20.343464 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9eb2dd08-5ee4-45d3-9c15-200b1873596b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:20.343978 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9eb2dd08-5ee4-45d3-9c15-200b1873596b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:20.344434 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9eb2dd08-5ee4-45d3-9c15-200b1873596b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:20.345192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9eb2dd08-5ee4-45d3-9c15-200b1873596b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:20.345639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9eb2dd08-5ee4-45d3-9c15-200b1873596b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:20.346060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9eb2dd08-5ee4-45d3-9c15-200b1873596b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:20.414493 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9eb2dd08-5ee4-45d3-9c15-200b1873596b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:20.423500 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9eb2dd08-5ee4-45d3-9c15-200b1873596b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.099763 Sep 05 17:31:20.424085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1226/2601] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:20 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:20.566620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-53675c4e-ed49-4a99-97d7-5ffceb22330d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:20.567551 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-53675c4e-ed49-4a99-97d7-5ffceb22330d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:20.578404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53675c4e-ed49-4a99-97d7-5ffceb22330d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:20.578923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53675c4e-ed49-4a99-97d7-5ffceb22330d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:20.579347 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53675c4e-ed49-4a99-97d7-5ffceb22330d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:20.580031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53675c4e-ed49-4a99-97d7-5ffceb22330d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:20.580514 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53675c4e-ed49-4a99-97d7-5ffceb22330d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:20.580999 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53675c4e-ed49-4a99-97d7-5ffceb22330d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:20.719291 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-53675c4e-ed49-4a99-97d7-5ffceb22330d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:20.732225 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-53675c4e-ed49-4a99-97d7-5ffceb22330d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.172000 Sep 05 17:31:20.733161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1376/2602] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:20 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:21.446832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e8d95c82-9461-4113-9443-59fdc04d78e5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:21.447421 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e8d95c82-9461-4113-9443-59fdc04d78e5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:21.455291 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8d95c82-9461-4113-9443-59fdc04d78e5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:21.455728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8d95c82-9461-4113-9443-59fdc04d78e5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:21.456183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8d95c82-9461-4113-9443-59fdc04d78e5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:21.456905 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8d95c82-9461-4113-9443-59fdc04d78e5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:21.457357 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8d95c82-9461-4113-9443-59fdc04d78e5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:21.457776 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e8d95c82-9461-4113-9443-59fdc04d78e5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:21.523403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e8d95c82-9461-4113-9443-59fdc04d78e5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:21.532566 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e8d95c82-9461-4113-9443-59fdc04d78e5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.089705 Sep 05 17:31:21.533138 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1227/2603] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:21 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:21.756644 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c29f2242-539c-41b1-9f98-5062b67f402d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:21.757240 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c29f2242-539c-41b1-9f98-5062b67f402d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:21.764516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c29f2242-539c-41b1-9f98-5062b67f402d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:21.765186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c29f2242-539c-41b1-9f98-5062b67f402d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:21.765622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c29f2242-539c-41b1-9f98-5062b67f402d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:21.766328 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c29f2242-539c-41b1-9f98-5062b67f402d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:21.766782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c29f2242-539c-41b1-9f98-5062b67f402d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:21.767202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c29f2242-539c-41b1-9f98-5062b67f402d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:21.914106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c29f2242-539c-41b1-9f98-5062b67f402d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:21.916337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:31:21.924470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c29f2242-539c-41b1-9f98-5062b67f402d tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.171849 Sep 05 17:31:21.925037 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1377/2604] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:21 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:22.559959 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-abe1ced9-3b11-44fd-9981-b45f90b6bf20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:22.560988 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-abe1ced9-3b11-44fd-9981-b45f90b6bf20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:22.568950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-abe1ced9-3b11-44fd-9981-b45f90b6bf20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:22.569424 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-abe1ced9-3b11-44fd-9981-b45f90b6bf20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:22.569849 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-abe1ced9-3b11-44fd-9981-b45f90b6bf20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:22.570524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-abe1ced9-3b11-44fd-9981-b45f90b6bf20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:22.570964 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-abe1ced9-3b11-44fd-9981-b45f90b6bf20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:22.571376 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-abe1ced9-3b11-44fd-9981-b45f90b6bf20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:22.636388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-abe1ced9-3b11-44fd-9981-b45f90b6bf20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:22.644837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-abe1ced9-3b11-44fd-9981-b45f90b6bf20 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.091455 Sep 05 17:31:22.645407 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1228/2605] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:22 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:22.952131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e1183ff4-1563-4654-b31c-e420454b76b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:22.953092 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e1183ff4-1563-4654-b31c-e420454b76b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:22.960895 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1183ff4-1563-4654-b31c-e420454b76b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:22.961360 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1183ff4-1563-4654-b31c-e420454b76b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:22.961809 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1183ff4-1563-4654-b31c-e420454b76b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:22.962495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1183ff4-1563-4654-b31c-e420454b76b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:22.962941 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1183ff4-1563-4654-b31c-e420454b76b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:22.963366 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1183ff4-1563-4654-b31c-e420454b76b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:23.097764 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e1183ff4-1563-4654-b31c-e420454b76b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:23.108606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e1183ff4-1563-4654-b31c-e420454b76b4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.162773 Sep 05 17:31:23.109529 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1378/2606] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:22 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:23.680829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fa60c1fa-48e7-4e77-9307-6977c22423bf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:23.681771 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fa60c1fa-48e7-4e77-9307-6977c22423bf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:23.695009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa60c1fa-48e7-4e77-9307-6977c22423bf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:23.695794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa60c1fa-48e7-4e77-9307-6977c22423bf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:23.696567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa60c1fa-48e7-4e77-9307-6977c22423bf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:23.697686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa60c1fa-48e7-4e77-9307-6977c22423bf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:23.698426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa60c1fa-48e7-4e77-9307-6977c22423bf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:23.699118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fa60c1fa-48e7-4e77-9307-6977c22423bf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:23.778297 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-fa60c1fa-48e7-4e77-9307-6977c22423bf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:23.787768 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fa60c1fa-48e7-4e77-9307-6977c22423bf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.113493 Sep 05 17:31:23.788377 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1229/2607] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:23 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:24.142507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2c26e447-4d54-4d41-81eb-8cebb0206659 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:24.143232 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2c26e447-4d54-4d41-81eb-8cebb0206659 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:24.151791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c26e447-4d54-4d41-81eb-8cebb0206659 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:24.152443 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c26e447-4d54-4d41-81eb-8cebb0206659 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:24.152975 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c26e447-4d54-4d41-81eb-8cebb0206659 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:24.153831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c26e447-4d54-4d41-81eb-8cebb0206659 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:24.154397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c26e447-4d54-4d41-81eb-8cebb0206659 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:24.154924 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c26e447-4d54-4d41-81eb-8cebb0206659 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:24.299366 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2c26e447-4d54-4d41-81eb-8cebb0206659 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:24.308271 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2c26e447-4d54-4d41-81eb-8cebb0206659 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.172365 Sep 05 17:31:24.308824 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1379/2608] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:24 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:24.811622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e4ffb916-86e3-4713-8ca5-8fa19e87fbc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:24.812311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e4ffb916-86e3-4713-8ca5-8fa19e87fbc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:24.819491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4ffb916-86e3-4713-8ca5-8fa19e87fbc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:24.819966 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4ffb916-86e3-4713-8ca5-8fa19e87fbc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:24.820420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4ffb916-86e3-4713-8ca5-8fa19e87fbc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:24.821101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4ffb916-86e3-4713-8ca5-8fa19e87fbc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:24.821548 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4ffb916-86e3-4713-8ca5-8fa19e87fbc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:24.821963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e4ffb916-86e3-4713-8ca5-8fa19e87fbc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:24.887031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e4ffb916-86e3-4713-8ca5-8fa19e87fbc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:24.897237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e4ffb916-86e3-4713-8ca5-8fa19e87fbc0 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.089557 Sep 05 17:31:24.897811 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1230/2609] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:24 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:25.343313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5ae3e9c7-4cc5-441b-b58c-02533bc72727 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:25.344591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5ae3e9c7-4cc5-441b-b58c-02533bc72727 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:25.355592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ae3e9c7-4cc5-441b-b58c-02533bc72727 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:25.356601 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ae3e9c7-4cc5-441b-b58c-02533bc72727 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:25.357213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ae3e9c7-4cc5-441b-b58c-02533bc72727 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:25.358362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ae3e9c7-4cc5-441b-b58c-02533bc72727 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:25.359118 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ae3e9c7-4cc5-441b-b58c-02533bc72727 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:25.359828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ae3e9c7-4cc5-441b-b58c-02533bc72727 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:25.501029 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5ae3e9c7-4cc5-441b-b58c-02533bc72727 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:25.510114 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5ae3e9c7-4cc5-441b-b58c-02533bc72727 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.173801 Sep 05 17:31:25.510666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1380/2610] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:25 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:25.924859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-20d624b7-0335-4e62-861f-19da4982e130 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:25.925509 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-20d624b7-0335-4e62-861f-19da4982e130 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:25.933416 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-20d624b7-0335-4e62-861f-19da4982e130 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:25.933952 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-20d624b7-0335-4e62-861f-19da4982e130 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:25.934489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-20d624b7-0335-4e62-861f-19da4982e130 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:25.935336 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-20d624b7-0335-4e62-861f-19da4982e130 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:25.935868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-20d624b7-0335-4e62-861f-19da4982e130 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:25.936410 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-20d624b7-0335-4e62-861f-19da4982e130 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:26.017171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-20d624b7-0335-4e62-861f-19da4982e130 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:26.030076 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-20d624b7-0335-4e62-861f-19da4982e130 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.111069 Sep 05 17:31:26.030848 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1231/2611] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:25 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:26.545218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2a0db2dd-1eec-4f9b-b29e-6c3eb093e1e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:26.546216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2a0db2dd-1eec-4f9b-b29e-6c3eb093e1e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:26.553969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a0db2dd-1eec-4f9b-b29e-6c3eb093e1e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:26.554444 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a0db2dd-1eec-4f9b-b29e-6c3eb093e1e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:26.554868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a0db2dd-1eec-4f9b-b29e-6c3eb093e1e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:26.555609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a0db2dd-1eec-4f9b-b29e-6c3eb093e1e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:26.556057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a0db2dd-1eec-4f9b-b29e-6c3eb093e1e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:26.556527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a0db2dd-1eec-4f9b-b29e-6c3eb093e1e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:26.689806 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2a0db2dd-1eec-4f9b-b29e-6c3eb093e1e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:26.702260 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2a0db2dd-1eec-4f9b-b29e-6c3eb093e1e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.163333 Sep 05 17:31:26.703034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1381/2612] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:26 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:27.056993 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6bd0be22-c3b5-489e-ab47-e9ebba0bbf71 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:27.057896 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6bd0be22-c3b5-489e-ab47-e9ebba0bbf71 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:27.067095 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bd0be22-c3b5-489e-ab47-e9ebba0bbf71 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:27.067568 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bd0be22-c3b5-489e-ab47-e9ebba0bbf71 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:27.067992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bd0be22-c3b5-489e-ab47-e9ebba0bbf71 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:27.068709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bd0be22-c3b5-489e-ab47-e9ebba0bbf71 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:27.069152 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bd0be22-c3b5-489e-ab47-e9ebba0bbf71 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:27.069558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6bd0be22-c3b5-489e-ab47-e9ebba0bbf71 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:27.133247 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6bd0be22-c3b5-489e-ab47-e9ebba0bbf71 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:27.141922 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6bd0be22-c3b5-489e-ab47-e9ebba0bbf71 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.091505 Sep 05 17:31:27.145641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1232/2613] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:27 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:27.726933 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-adce9e49-31f6-406e-a36a-f941b98eb658 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:27.727542 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-adce9e49-31f6-406e-a36a-f941b98eb658 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:27.734632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adce9e49-31f6-406e-a36a-f941b98eb658 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:27.735133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adce9e49-31f6-406e-a36a-f941b98eb658 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:27.735564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adce9e49-31f6-406e-a36a-f941b98eb658 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:27.736507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adce9e49-31f6-406e-a36a-f941b98eb658 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:27.737001 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adce9e49-31f6-406e-a36a-f941b98eb658 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:27.737438 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-adce9e49-31f6-406e-a36a-f941b98eb658 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:27.875791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-adce9e49-31f6-406e-a36a-f941b98eb658 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:27.885391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-adce9e49-31f6-406e-a36a-f941b98eb658 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.162776 Sep 05 17:31:27.885979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1382/2614] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:27 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:28.169089 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-32455f8f-b5e1-418b-810e-f2a4d1668559 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:28.170022 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-32455f8f-b5e1-418b-810e-f2a4d1668559 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:28.178332 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32455f8f-b5e1-418b-810e-f2a4d1668559 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:28.178805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32455f8f-b5e1-418b-810e-f2a4d1668559 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:28.179227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32455f8f-b5e1-418b-810e-f2a4d1668559 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:28.179903 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32455f8f-b5e1-418b-810e-f2a4d1668559 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:28.180391 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32455f8f-b5e1-418b-810e-f2a4d1668559 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:28.180812 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32455f8f-b5e1-418b-810e-f2a4d1668559 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:28.245662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-32455f8f-b5e1-418b-810e-f2a4d1668559 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:28.256541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-32455f8f-b5e1-418b-810e-f2a4d1668559 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.094060 Sep 05 17:31:28.257162 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1233/2615] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:28 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:28.915621 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-da10e52d-f74e-44fa-b121-627e8e43dfee tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:28.916653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-da10e52d-f74e-44fa-b121-627e8e43dfee tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:28.926076 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da10e52d-f74e-44fa-b121-627e8e43dfee tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:28.926559 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da10e52d-f74e-44fa-b121-627e8e43dfee tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:28.926989 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da10e52d-f74e-44fa-b121-627e8e43dfee tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:28.927672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da10e52d-f74e-44fa-b121-627e8e43dfee tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:28.928128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da10e52d-f74e-44fa-b121-627e8e43dfee tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:28.928591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da10e52d-f74e-44fa-b121-627e8e43dfee tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:29.063413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-da10e52d-f74e-44fa-b121-627e8e43dfee tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:29.071967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-da10e52d-f74e-44fa-b121-627e8e43dfee tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.162907 Sep 05 17:31:29.072537 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1383/2616] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:28 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:29.283784 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3a9bf901-4694-4374-8c41-c1fdd4a059e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:29.284443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3a9bf901-4694-4374-8c41-c1fdd4a059e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:29.291550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3a9bf901-4694-4374-8c41-c1fdd4a059e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:29.292036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3a9bf901-4694-4374-8c41-c1fdd4a059e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:29.292638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3a9bf901-4694-4374-8c41-c1fdd4a059e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:29.293335 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3a9bf901-4694-4374-8c41-c1fdd4a059e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:29.293782 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3a9bf901-4694-4374-8c41-c1fdd4a059e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:29.294204 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3a9bf901-4694-4374-8c41-c1fdd4a059e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:29.361287 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3a9bf901-4694-4374-8c41-c1fdd4a059e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:29.369761 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3a9bf901-4694-4374-8c41-c1fdd4a059e1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.091875 Sep 05 17:31:29.370345 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1234/2617] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:29 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:30.099420 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-671475ea-f93c-4f3e-8a02-f5e5447abd59 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:30.100446 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-671475ea-f93c-4f3e-8a02-f5e5447abd59 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:30.111162 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-671475ea-f93c-4f3e-8a02-f5e5447abd59 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:30.111756 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-671475ea-f93c-4f3e-8a02-f5e5447abd59 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:30.112192 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-671475ea-f93c-4f3e-8a02-f5e5447abd59 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:30.112875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-671475ea-f93c-4f3e-8a02-f5e5447abd59 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:30.113345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-671475ea-f93c-4f3e-8a02-f5e5447abd59 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:30.113770 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-671475ea-f93c-4f3e-8a02-f5e5447abd59 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:30.248428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-671475ea-f93c-4f3e-8a02-f5e5447abd59 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:30.261386 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-671475ea-f93c-4f3e-8a02-f5e5447abd59 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.168173 Sep 05 17:31:30.262173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1384/2618] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:30 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:30.395465 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-bef18168-d49f-4cf0-a185-fddb5a4d5d13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:30.396191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-bef18168-d49f-4cf0-a185-fddb5a4d5d13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:30.403480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bef18168-d49f-4cf0-a185-fddb5a4d5d13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:30.403955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bef18168-d49f-4cf0-a185-fddb5a4d5d13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:30.404423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bef18168-d49f-4cf0-a185-fddb5a4d5d13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:30.405116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bef18168-d49f-4cf0-a185-fddb5a4d5d13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:30.405590 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bef18168-d49f-4cf0-a185-fddb5a4d5d13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:30.406006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bef18168-d49f-4cf0-a185-fddb5a4d5d13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:30.469284 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bef18168-d49f-4cf0-a185-fddb5a4d5d13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:30.478308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-bef18168-d49f-4cf0-a185-fddb5a4d5d13 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.087830 Sep 05 17:31:30.478880 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1235/2619] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:30 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:31.287652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b4d6211e-8d3e-4193-8636-068c1f74e8e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:31.288293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b4d6211e-8d3e-4193-8636-068c1f74e8e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:31.294821 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4d6211e-8d3e-4193-8636-068c1f74e8e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:31.295293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4d6211e-8d3e-4193-8636-068c1f74e8e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:31.295719 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4d6211e-8d3e-4193-8636-068c1f74e8e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:31.296422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4d6211e-8d3e-4193-8636-068c1f74e8e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:31.296875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4d6211e-8d3e-4193-8636-068c1f74e8e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:31.297296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4d6211e-8d3e-4193-8636-068c1f74e8e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:31.438319 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b4d6211e-8d3e-4193-8636-068c1f74e8e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:31.450967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b4d6211e-8d3e-4193-8636-068c1f74e8e8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.167877 Sep 05 17:31:31.451713 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1385/2620] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:31 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:31.501443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-dd48fe7f-6b04-4119-b5b7-4f6a383ce251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:31.502119 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-dd48fe7f-6b04-4119-b5b7-4f6a383ce251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:31.504370 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=54 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:31:31.509626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd48fe7f-6b04-4119-b5b7-4f6a383ce251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:31.510097 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd48fe7f-6b04-4119-b5b7-4f6a383ce251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:31.510522 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd48fe7f-6b04-4119-b5b7-4f6a383ce251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:31.511191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd48fe7f-6b04-4119-b5b7-4f6a383ce251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:31.511630 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd48fe7f-6b04-4119-b5b7-4f6a383ce251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:31.512039 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dd48fe7f-6b04-4119-b5b7-4f6a383ce251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:31.582950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-dd48fe7f-6b04-4119-b5b7-4f6a383ce251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:31.592734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-dd48fe7f-6b04-4119-b5b7-4f6a383ce251 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.095282 Sep 05 17:31:31.593303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1236/2621] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:31 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:31:32.486899 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-50191d4f-9c8b-494c-8667-5beb7438b709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:32.487701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-50191d4f-9c8b-494c-8667-5beb7438b709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:32.494392 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50191d4f-9c8b-494c-8667-5beb7438b709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:32.494991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50191d4f-9c8b-494c-8667-5beb7438b709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:32.495462 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50191d4f-9c8b-494c-8667-5beb7438b709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:32.497141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50191d4f-9c8b-494c-8667-5beb7438b709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:32.497653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50191d4f-9c8b-494c-8667-5beb7438b709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:32.498086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50191d4f-9c8b-494c-8667-5beb7438b709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:32.616469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a7a5520e-345f-421b-aae9-0781ad63310a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:32.617083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a7a5520e-345f-421b-aae9-0781ad63310a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:32.623692 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7a5520e-345f-421b-aae9-0781ad63310a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:32.624184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7a5520e-345f-421b-aae9-0781ad63310a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:32.624630 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7a5520e-345f-421b-aae9-0781ad63310a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:32.625320 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7a5520e-345f-421b-aae9-0781ad63310a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:32.625767 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7a5520e-345f-421b-aae9-0781ad63310a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:32.626188 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a7a5520e-345f-421b-aae9-0781ad63310a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:32.638497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-50191d4f-9c8b-494c-8667-5beb7438b709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:32.647831 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-50191d4f-9c8b-494c-8667-5beb7438b709 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.168516 Sep 05 17:31:32.648451 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1386/2622] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:32 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:32.692845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a7a5520e-345f-421b-aae9-0781ad63310a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:32.706069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a7a5520e-345f-421b-aae9-0781ad63310a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.093495 Sep 05 17:31:32.707015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1237/2623] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:32 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:33.675336 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-66d376e6-6704-41ad-be07-e681e3952fea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:33.676490 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-66d376e6-6704-41ad-be07-e681e3952fea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:33.680115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=52 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:31:33.688994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66d376e6-6704-41ad-be07-e681e3952fea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:33.689481 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66d376e6-6704-41ad-be07-e681e3952fea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:33.689911 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66d376e6-6704-41ad-be07-e681e3952fea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:33.690603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66d376e6-6704-41ad-be07-e681e3952fea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:33.691053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66d376e6-6704-41ad-be07-e681e3952fea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:33.691473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66d376e6-6704-41ad-be07-e681e3952fea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:33.734658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-26549abd-f5f5-417a-b8da-b3244c5c6eaf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:33.735397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-26549abd-f5f5-417a-b8da-b3244c5c6eaf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:33.742377 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26549abd-f5f5-417a-b8da-b3244c5c6eaf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:33.742861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26549abd-f5f5-417a-b8da-b3244c5c6eaf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:33.743287 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26549abd-f5f5-417a-b8da-b3244c5c6eaf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:33.744045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26549abd-f5f5-417a-b8da-b3244c5c6eaf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:33.744534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26549abd-f5f5-417a-b8da-b3244c5c6eaf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:33.744946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-26549abd-f5f5-417a-b8da-b3244c5c6eaf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:33.815329 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-26549abd-f5f5-417a-b8da-b3244c5c6eaf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:33.823745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-26549abd-f5f5-417a-b8da-b3244c5c6eaf tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.092925 Sep 05 17:31:33.824363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1238/2624] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:33 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:33.845266 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-66d376e6-6704-41ad-be07-e681e3952fea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:33.853580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-66d376e6-6704-41ad-be07-e681e3952fea tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.184982 Sep 05 17:31:33.854143 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1387/2625] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:33 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:34.850940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-093f0b20-1454-4930-8999-2490c904eeba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:34.851958 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-093f0b20-1454-4930-8999-2490c904eeba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:34.863039 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-093f0b20-1454-4930-8999-2490c904eeba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:34.863514 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-093f0b20-1454-4930-8999-2490c904eeba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:34.863938 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-093f0b20-1454-4930-8999-2490c904eeba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:34.864720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-093f0b20-1454-4930-8999-2490c904eeba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:34.865166 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-093f0b20-1454-4930-8999-2490c904eeba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:34.865576 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-093f0b20-1454-4930-8999-2490c904eeba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:34.879795 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5fc125d8-1ef6-44c3-a449-652a8097f554 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:34.880406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5fc125d8-1ef6-44c3-a449-652a8097f554 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:34.887305 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fc125d8-1ef6-44c3-a449-652a8097f554 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:34.887783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fc125d8-1ef6-44c3-a449-652a8097f554 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:34.888239 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fc125d8-1ef6-44c3-a449-652a8097f554 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:34.888924 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fc125d8-1ef6-44c3-a449-652a8097f554 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:34.889371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fc125d8-1ef6-44c3-a449-652a8097f554 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:34.889786 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fc125d8-1ef6-44c3-a449-652a8097f554 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:34.929103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-093f0b20-1454-4930-8999-2490c904eeba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:34.931291 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:31:34.939053 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-093f0b20-1454-4930-8999-2490c904eeba tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.094760 Sep 05 17:31:34.939649 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1239/2626] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:34 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:35.024633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5fc125d8-1ef6-44c3-a449-652a8097f554 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:35.033254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5fc125d8-1ef6-44c3-a449-652a8097f554 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.157320 Sep 05 17:31:35.033851 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1388/2627] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:34 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:35.963009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-29d10f38-b729-4667-8d90-7fc0a172ce39 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:35.963734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-29d10f38-b729-4667-8d90-7fc0a172ce39 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:35.971826 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-29d10f38-b729-4667-8d90-7fc0a172ce39 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:35.972347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-29d10f38-b729-4667-8d90-7fc0a172ce39 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:35.972782 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-29d10f38-b729-4667-8d90-7fc0a172ce39 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:35.973480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-29d10f38-b729-4667-8d90-7fc0a172ce39 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:35.973931 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-29d10f38-b729-4667-8d90-7fc0a172ce39 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:35.974350 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-29d10f38-b729-4667-8d90-7fc0a172ce39 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:36.046641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-29d10f38-b729-4667-8d90-7fc0a172ce39 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:36.056389 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-29d10f38-b729-4667-8d90-7fc0a172ce39 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.098002 Sep 05 17:31:36.056710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-584a76d5-2e9f-404a-806d-e2987b090e5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:36.057282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1240/2628] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:35 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:36.057409 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-584a76d5-2e9f-404a-806d-e2987b090e5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:36.064116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-584a76d5-2e9f-404a-806d-e2987b090e5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:36.064650 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-584a76d5-2e9f-404a-806d-e2987b090e5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:36.065235 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-584a76d5-2e9f-404a-806d-e2987b090e5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:36.065982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-584a76d5-2e9f-404a-806d-e2987b090e5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:36.066435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-584a76d5-2e9f-404a-806d-e2987b090e5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:36.066856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-584a76d5-2e9f-404a-806d-e2987b090e5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:36.198320 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-584a76d5-2e9f-404a-806d-e2987b090e5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:36.207284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-584a76d5-2e9f-404a-806d-e2987b090e5b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.154601 Sep 05 17:31:36.207891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1389/2629] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:36 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:37.082704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-dfee31a7-7585-4dc4-964e-6476a9e8b168 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:37.083338 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-dfee31a7-7585-4dc4-964e-6476a9e8b168 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:37.090865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dfee31a7-7585-4dc4-964e-6476a9e8b168 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:37.091346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dfee31a7-7585-4dc4-964e-6476a9e8b168 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:37.091775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dfee31a7-7585-4dc4-964e-6476a9e8b168 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:37.092497 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dfee31a7-7585-4dc4-964e-6476a9e8b168 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:37.092946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dfee31a7-7585-4dc4-964e-6476a9e8b168 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:37.093366 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-dfee31a7-7585-4dc4-964e-6476a9e8b168 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:37.159641 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-dfee31a7-7585-4dc4-964e-6476a9e8b168 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:37.168595 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-dfee31a7-7585-4dc4-964e-6476a9e8b168 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.092107 Sep 05 17:31:37.169179 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1241/2630] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:37 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:37.230631 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4a3504ed-bba6-4f8e-aac9-80141845147c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:37.231234 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4a3504ed-bba6-4f8e-aac9-80141845147c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:37.238317 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a3504ed-bba6-4f8e-aac9-80141845147c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:37.238790 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a3504ed-bba6-4f8e-aac9-80141845147c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:37.239242 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a3504ed-bba6-4f8e-aac9-80141845147c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:37.239923 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a3504ed-bba6-4f8e-aac9-80141845147c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:37.240406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a3504ed-bba6-4f8e-aac9-80141845147c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:37.240819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a3504ed-bba6-4f8e-aac9-80141845147c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:37.385346 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4a3504ed-bba6-4f8e-aac9-80141845147c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:37.393783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4a3504ed-bba6-4f8e-aac9-80141845147c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.167132 Sep 05 17:31:37.394355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1390/2631] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:37 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:38.195490 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f0b2ce13-3f0f-40a3-af16-8959a0360450 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:38.196529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f0b2ce13-3f0f-40a3-af16-8959a0360450 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:38.207533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0b2ce13-3f0f-40a3-af16-8959a0360450 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:38.208379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0b2ce13-3f0f-40a3-af16-8959a0360450 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:38.209100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0b2ce13-3f0f-40a3-af16-8959a0360450 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:38.210222 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0b2ce13-3f0f-40a3-af16-8959a0360450 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:38.210964 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0b2ce13-3f0f-40a3-af16-8959a0360450 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:38.211675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0b2ce13-3f0f-40a3-af16-8959a0360450 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:38.278566 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f0b2ce13-3f0f-40a3-af16-8959a0360450 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:38.287095 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f0b2ce13-3f0f-40a3-af16-8959a0360450 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.098306 Sep 05 17:31:38.287660 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1242/2632] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:38 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:38.417469 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f1726569-8ae5-4151-81bd-f6df385fa9e4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:38.418116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f1726569-8ae5-4151-81bd-f6df385fa9e4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:38.426580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1726569-8ae5-4151-81bd-f6df385fa9e4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:38.428916 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1726569-8ae5-4151-81bd-f6df385fa9e4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:38.429376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1726569-8ae5-4151-81bd-f6df385fa9e4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:38.430144 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1726569-8ae5-4151-81bd-f6df385fa9e4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:38.430720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1726569-8ae5-4151-81bd-f6df385fa9e4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:38.431162 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1726569-8ae5-4151-81bd-f6df385fa9e4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:38.578450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f1726569-8ae5-4151-81bd-f6df385fa9e4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:38.587719 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f1726569-8ae5-4151-81bd-f6df385fa9e4 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.174463 Sep 05 17:31:38.588323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1391/2633] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:38 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:39.313210 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ed00cfc4-0368-48bd-a163-68f4ccedb943 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:39.313850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ed00cfc4-0368-48bd-a163-68f4ccedb943 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:39.323652 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ed00cfc4-0368-48bd-a163-68f4ccedb943 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:39.324139 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ed00cfc4-0368-48bd-a163-68f4ccedb943 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:39.324677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ed00cfc4-0368-48bd-a163-68f4ccedb943 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:39.325687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ed00cfc4-0368-48bd-a163-68f4ccedb943 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:39.326289 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ed00cfc4-0368-48bd-a163-68f4ccedb943 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:39.326858 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ed00cfc4-0368-48bd-a163-68f4ccedb943 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:39.402462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ed00cfc4-0368-48bd-a163-68f4ccedb943 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:39.412085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ed00cfc4-0368-48bd-a163-68f4ccedb943 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.105182 Sep 05 17:31:39.412940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1243/2634] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:39 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:39.614594 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3c203af2-be7c-44f4-aad6-818cfe4d8961 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:39.615535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3c203af2-be7c-44f4-aad6-818cfe4d8961 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:39.625757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c203af2-be7c-44f4-aad6-818cfe4d8961 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:39.626489 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c203af2-be7c-44f4-aad6-818cfe4d8961 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:39.627178 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c203af2-be7c-44f4-aad6-818cfe4d8961 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:39.628086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c203af2-be7c-44f4-aad6-818cfe4d8961 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:39.628568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c203af2-be7c-44f4-aad6-818cfe4d8961 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:39.628987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c203af2-be7c-44f4-aad6-818cfe4d8961 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:39.770664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3c203af2-be7c-44f4-aad6-818cfe4d8961 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:39.779371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3c203af2-be7c-44f4-aad6-818cfe4d8961 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.171183 Sep 05 17:31:39.779946 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1392/2635] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:39 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:40.439154 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4703b883-0af6-475d-a4de-813bca0b4946 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:40.439809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4703b883-0af6-475d-a4de-813bca0b4946 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:40.446970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4703b883-0af6-475d-a4de-813bca0b4946 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:40.447448 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4703b883-0af6-475d-a4de-813bca0b4946 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:40.447869 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4703b883-0af6-475d-a4de-813bca0b4946 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:40.448588 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4703b883-0af6-475d-a4de-813bca0b4946 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:40.449029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4703b883-0af6-475d-a4de-813bca0b4946 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:40.449442 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4703b883-0af6-475d-a4de-813bca0b4946 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:40.522589 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-4703b883-0af6-475d-a4de-813bca0b4946 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:40.531161 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4703b883-0af6-475d-a4de-813bca0b4946 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.096014 Sep 05 17:31:40.531727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1244/2636] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:40 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:40.807008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3ad8ab4f-5a8e-4b80-8580-fba15fb5a73c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:40.807944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3ad8ab4f-5a8e-4b80-8580-fba15fb5a73c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:40.818611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ad8ab4f-5a8e-4b80-8580-fba15fb5a73c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:40.819400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ad8ab4f-5a8e-4b80-8580-fba15fb5a73c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:40.820106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ad8ab4f-5a8e-4b80-8580-fba15fb5a73c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:40.821286 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ad8ab4f-5a8e-4b80-8580-fba15fb5a73c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:40.822024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ad8ab4f-5a8e-4b80-8580-fba15fb5a73c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:40.822718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ad8ab4f-5a8e-4b80-8580-fba15fb5a73c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:40.959044 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3ad8ab4f-5a8e-4b80-8580-fba15fb5a73c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:40.967720 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3ad8ab4f-5a8e-4b80-8580-fba15fb5a73c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.167778 Sep 05 17:31:40.968316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1393/2637] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:40 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:41.554957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-09b57637-dc99-421b-a941-30301b6388b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:41.555534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-09b57637-dc99-421b-a941-30301b6388b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:41.562451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09b57637-dc99-421b-a941-30301b6388b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:41.562920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09b57637-dc99-421b-a941-30301b6388b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:41.563340 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09b57637-dc99-421b-a941-30301b6388b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:41.565679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09b57637-dc99-421b-a941-30301b6388b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:41.565679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09b57637-dc99-421b-a941-30301b6388b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:41.565679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-09b57637-dc99-421b-a941-30301b6388b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:41.626612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-09b57637-dc99-421b-a941-30301b6388b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:41.634939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-09b57637-dc99-421b-a941-30301b6388b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.084068 Sep 05 17:31:41.635525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1245/2638] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:41 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:41.995915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7a6d7da2-c362-438f-8695-df85f91cae2a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:41.996897 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7a6d7da2-c362-438f-8695-df85f91cae2a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:42.006116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a6d7da2-c362-438f-8695-df85f91cae2a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:42.006596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a6d7da2-c362-438f-8695-df85f91cae2a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:42.007020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a6d7da2-c362-438f-8695-df85f91cae2a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:42.007700 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a6d7da2-c362-438f-8695-df85f91cae2a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:42.008143 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a6d7da2-c362-438f-8695-df85f91cae2a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:42.008603 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7a6d7da2-c362-438f-8695-df85f91cae2a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:42.025327 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:31:42.143215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7a6d7da2-c362-438f-8695-df85f91cae2a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:42.152184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7a6d7da2-c362-438f-8695-df85f91cae2a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.162872 Sep 05 17:31:42.152791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1394/2639] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:41 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:42.666305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e38a7c04-5588-4188-b842-6d2c3fc02809 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:42.667215 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e38a7c04-5588-4188-b842-6d2c3fc02809 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:42.677634 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e38a7c04-5588-4188-b842-6d2c3fc02809 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:42.678363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e38a7c04-5588-4188-b842-6d2c3fc02809 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:42.679110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e38a7c04-5588-4188-b842-6d2c3fc02809 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:42.680210 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e38a7c04-5588-4188-b842-6d2c3fc02809 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:42.680988 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e38a7c04-5588-4188-b842-6d2c3fc02809 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:42.681675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e38a7c04-5588-4188-b842-6d2c3fc02809 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:42.746989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e38a7c04-5588-4188-b842-6d2c3fc02809 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:42.756122 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e38a7c04-5588-4188-b842-6d2c3fc02809 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.097736 Sep 05 17:31:42.756731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1246/2640] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:42 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:43.179269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3b9b9575-3516-4072-bfd5-72e5714967b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:43.180316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3b9b9575-3516-4072-bfd5-72e5714967b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:43.190960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b9b9575-3516-4072-bfd5-72e5714967b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:43.191636 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b9b9575-3516-4072-bfd5-72e5714967b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:43.192075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b9b9575-3516-4072-bfd5-72e5714967b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:43.193074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b9b9575-3516-4072-bfd5-72e5714967b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:43.193523 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b9b9575-3516-4072-bfd5-72e5714967b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:43.193938 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b9b9575-3516-4072-bfd5-72e5714967b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:43.331890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3b9b9575-3516-4072-bfd5-72e5714967b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:43.345377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3b9b9575-3516-4072-bfd5-72e5714967b0 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.172457 Sep 05 17:31:43.346228 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1395/2641] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:43 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:43.783489 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-55b4f3ea-a8f7-4fa2-ac99-c8e9d000ed09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:43.784508 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-55b4f3ea-a8f7-4fa2-ac99-c8e9d000ed09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:43.794880 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55b4f3ea-a8f7-4fa2-ac99-c8e9d000ed09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:43.795668 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55b4f3ea-a8f7-4fa2-ac99-c8e9d000ed09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:43.796432 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55b4f3ea-a8f7-4fa2-ac99-c8e9d000ed09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:43.797549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55b4f3ea-a8f7-4fa2-ac99-c8e9d000ed09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:43.798284 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55b4f3ea-a8f7-4fa2-ac99-c8e9d000ed09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:43.798973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-55b4f3ea-a8f7-4fa2-ac99-c8e9d000ed09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:43.875532 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-55b4f3ea-a8f7-4fa2-ac99-c8e9d000ed09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:43.884525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-55b4f3ea-a8f7-4fa2-ac99-c8e9d000ed09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.107760 Sep 05 17:31:43.885100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1247/2642] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:43 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:44.373620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5f151d24-a29b-43d3-aeff-d02f71055528 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:44.374610 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5f151d24-a29b-43d3-aeff-d02f71055528 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:44.385901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f151d24-a29b-43d3-aeff-d02f71055528 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:44.386707 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f151d24-a29b-43d3-aeff-d02f71055528 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:44.387613 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f151d24-a29b-43d3-aeff-d02f71055528 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:44.388825 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f151d24-a29b-43d3-aeff-d02f71055528 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:44.389579 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f151d24-a29b-43d3-aeff-d02f71055528 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:44.390289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f151d24-a29b-43d3-aeff-d02f71055528 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:44.527484 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f151d24-a29b-43d3-aeff-d02f71055528 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:44.538620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5f151d24-a29b-43d3-aeff-d02f71055528 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.171324 Sep 05 17:31:44.539343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1396/2643] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:44 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:44.920942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a03cbeee-cfcc-429f-b556-73db83627cf3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:44.922120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a03cbeee-cfcc-429f-b556-73db83627cf3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:44.933085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a03cbeee-cfcc-429f-b556-73db83627cf3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:44.933855 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a03cbeee-cfcc-429f-b556-73db83627cf3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:44.934577 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a03cbeee-cfcc-429f-b556-73db83627cf3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:44.935698 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a03cbeee-cfcc-429f-b556-73db83627cf3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:44.936527 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a03cbeee-cfcc-429f-b556-73db83627cf3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:44.937212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a03cbeee-cfcc-429f-b556-73db83627cf3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:45.001270 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a03cbeee-cfcc-429f-b556-73db83627cf3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:45.009979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a03cbeee-cfcc-429f-b556-73db83627cf3 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.095437 Sep 05 17:31:45.010590 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1248/2644] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:44 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:45.567610 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9fc6030c-7a85-4e1c-b30b-1ea61124f9c8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:45.568262 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9fc6030c-7a85-4e1c-b30b-1ea61124f9c8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:45.575222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fc6030c-7a85-4e1c-b30b-1ea61124f9c8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:45.575704 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fc6030c-7a85-4e1c-b30b-1ea61124f9c8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:45.576134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fc6030c-7a85-4e1c-b30b-1ea61124f9c8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:45.576861 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fc6030c-7a85-4e1c-b30b-1ea61124f9c8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:45.577312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fc6030c-7a85-4e1c-b30b-1ea61124f9c8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:45.577734 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9fc6030c-7a85-4e1c-b30b-1ea61124f9c8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:45.717267 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9fc6030c-7a85-4e1c-b30b-1ea61124f9c8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:45.726144 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9fc6030c-7a85-4e1c-b30b-1ea61124f9c8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.164268 Sep 05 17:31:45.726724 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1397/2645] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:45 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:46.039026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5d2caf9d-d823-4cfa-8f02-960de7b6456d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:46.039919 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5d2caf9d-d823-4cfa-8f02-960de7b6456d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:46.050685 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d2caf9d-d823-4cfa-8f02-960de7b6456d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:46.051157 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d2caf9d-d823-4cfa-8f02-960de7b6456d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:46.051575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d2caf9d-d823-4cfa-8f02-960de7b6456d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:46.052284 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d2caf9d-d823-4cfa-8f02-960de7b6456d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:46.052730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d2caf9d-d823-4cfa-8f02-960de7b6456d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:46.053141 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d2caf9d-d823-4cfa-8f02-960de7b6456d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:46.123750 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5d2caf9d-d823-4cfa-8f02-960de7b6456d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:46.132327 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5d2caf9d-d823-4cfa-8f02-960de7b6456d tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.100113 Sep 05 17:31:46.132895 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1249/2646] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:46 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:46.749422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1b4810ec-0376-46e1-bd3a-4f108eb845ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:46.750046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1b4810ec-0376-46e1-bd3a-4f108eb845ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:46.757330 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b4810ec-0376-46e1-bd3a-4f108eb845ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:46.757812 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b4810ec-0376-46e1-bd3a-4f108eb845ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:46.758244 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b4810ec-0376-46e1-bd3a-4f108eb845ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:46.758936 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b4810ec-0376-46e1-bd3a-4f108eb845ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:46.759386 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b4810ec-0376-46e1-bd3a-4f108eb845ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:46.759808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b4810ec-0376-46e1-bd3a-4f108eb845ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:46.892700 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1b4810ec-0376-46e1-bd3a-4f108eb845ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:46.902092 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1b4810ec-0376-46e1-bd3a-4f108eb845ad tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.156665 Sep 05 17:31:46.902664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1398/2647] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:46 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:31:47.159365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d5a29f85-2607-4f2c-86dc-f3f5a9f2c1c5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:47.160293 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d5a29f85-2607-4f2c-86dc-f3f5a9f2c1c5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:47.167051 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5a29f85-2607-4f2c-86dc-f3f5a9f2c1c5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:47.167554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5a29f85-2607-4f2c-86dc-f3f5a9f2c1c5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:47.167987 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5a29f85-2607-4f2c-86dc-f3f5a9f2c1c5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:47.168873 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5a29f85-2607-4f2c-86dc-f3f5a9f2c1c5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:47.169328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5a29f85-2607-4f2c-86dc-f3f5a9f2c1c5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:47.169747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5a29f85-2607-4f2c-86dc-f3f5a9f2c1c5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:47.235688 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d5a29f85-2607-4f2c-86dc-f3f5a9f2c1c5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:47.244445 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d5a29f85-2607-4f2c-86dc-f3f5a9f2c1c5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.091474 Sep 05 17:31:47.245019 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1250/2648] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:47 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:47.925954 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8ea829c7-6a0d-4c5a-9e05-63ff6af8c792 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:47.926633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8ea829c7-6a0d-4c5a-9e05-63ff6af8c792 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:47.933630 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ea829c7-6a0d-4c5a-9e05-63ff6af8c792 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:47.934133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ea829c7-6a0d-4c5a-9e05-63ff6af8c792 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:47.934560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ea829c7-6a0d-4c5a-9e05-63ff6af8c792 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:47.935258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ea829c7-6a0d-4c5a-9e05-63ff6af8c792 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:47.935715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ea829c7-6a0d-4c5a-9e05-63ff6af8c792 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:47.936171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ea829c7-6a0d-4c5a-9e05-63ff6af8c792 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:48.075718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8ea829c7-6a0d-4c5a-9e05-63ff6af8c792 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:48.084037 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8ea829c7-6a0d-4c5a-9e05-63ff6af8c792 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.162400 Sep 05 17:31:48.084714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1399/2649] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:47 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:48.281542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3f8afc2f-64d9-4857-9321-d4ad4558d40c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:48.282413 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3f8afc2f-64d9-4857-9321-d4ad4558d40c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:48.293825 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3f8afc2f-64d9-4857-9321-d4ad4558d40c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:48.294607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3f8afc2f-64d9-4857-9321-d4ad4558d40c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:48.295316 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3f8afc2f-64d9-4857-9321-d4ad4558d40c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:48.296507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3f8afc2f-64d9-4857-9321-d4ad4558d40c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:48.297256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3f8afc2f-64d9-4857-9321-d4ad4558d40c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:48.297952 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3f8afc2f-64d9-4857-9321-d4ad4558d40c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:48.368704 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3f8afc2f-64d9-4857-9321-d4ad4558d40c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:48.377386 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3f8afc2f-64d9-4857-9321-d4ad4558d40c tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.102454 Sep 05 17:31:48.377978 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1251/2650] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:48 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:49.111295 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1d674d3a-2eee-4f69-8faf-134cf60a7414 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:49.112393 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1d674d3a-2eee-4f69-8faf-134cf60a7414 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:49.123849 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d674d3a-2eee-4f69-8faf-134cf60a7414 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:49.124702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d674d3a-2eee-4f69-8faf-134cf60a7414 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:49.125428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d674d3a-2eee-4f69-8faf-134cf60a7414 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:49.126570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d674d3a-2eee-4f69-8faf-134cf60a7414 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:49.127322 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d674d3a-2eee-4f69-8faf-134cf60a7414 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:49.128062 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d674d3a-2eee-4f69-8faf-134cf60a7414 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:49.286245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1d674d3a-2eee-4f69-8faf-134cf60a7414 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:49.295255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1d674d3a-2eee-4f69-8faf-134cf60a7414 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.190653 Sep 05 17:31:49.295804 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1400/2651] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:49 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:49.401475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-938f199e-9906-47a8-b771-98feff5440fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:49.402047 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-938f199e-9906-47a8-b771-98feff5440fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:49.409038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-938f199e-9906-47a8-b771-98feff5440fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:49.409525 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-938f199e-9906-47a8-b771-98feff5440fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:49.409951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-938f199e-9906-47a8-b771-98feff5440fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:49.410636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-938f199e-9906-47a8-b771-98feff5440fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:49.411084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-938f199e-9906-47a8-b771-98feff5440fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:49.411504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-938f199e-9906-47a8-b771-98feff5440fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:49.473956 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-938f199e-9906-47a8-b771-98feff5440fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:49.482398 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-938f199e-9906-47a8-b771-98feff5440fa tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.084844 Sep 05 17:31:49.482961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1252/2652] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:49 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:50.323060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-87e00977-9cac-474a-bf77-960c71275678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:50.324053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-87e00977-9cac-474a-bf77-960c71275678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:50.334777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87e00977-9cac-474a-bf77-960c71275678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:50.335360 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87e00977-9cac-474a-bf77-960c71275678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:50.335782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87e00977-9cac-474a-bf77-960c71275678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:50.336504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87e00977-9cac-474a-bf77-960c71275678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:50.336951 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87e00977-9cac-474a-bf77-960c71275678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:50.337369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87e00977-9cac-474a-bf77-960c71275678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:50.490858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-87e00977-9cac-474a-bf77-960c71275678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:50.499827 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-87e00977-9cac-474a-bf77-960c71275678 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.183418 Sep 05 17:31:50.500647 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1401/2653] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:50 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:50.505864 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2c4f42d6-5cd9-48e6-ba45-936de9f449c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:50.506589 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2c4f42d6-5cd9-48e6-ba45-936de9f449c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:50.513282 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c4f42d6-5cd9-48e6-ba45-936de9f449c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:50.513759 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c4f42d6-5cd9-48e6-ba45-936de9f449c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:50.514189 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c4f42d6-5cd9-48e6-ba45-936de9f449c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:50.514871 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c4f42d6-5cd9-48e6-ba45-936de9f449c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:50.515397 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c4f42d6-5cd9-48e6-ba45-936de9f449c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:50.515901 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2c4f42d6-5cd9-48e6-ba45-936de9f449c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:50.582575 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-2c4f42d6-5cd9-48e6-ba45-936de9f449c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:50.595264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2c4f42d6-5cd9-48e6-ba45-936de9f449c9 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.093040 Sep 05 17:31:50.596015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1253/2654] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:50 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:51.528185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-06faeae4-21af-4e15-8c5f-3c05743b6c93 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:51.529214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-06faeae4-21af-4e15-8c5f-3c05743b6c93 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:51.539737 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06faeae4-21af-4e15-8c5f-3c05743b6c93 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:51.540258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06faeae4-21af-4e15-8c5f-3c05743b6c93 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:51.540664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06faeae4-21af-4e15-8c5f-3c05743b6c93 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:51.541385 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06faeae4-21af-4e15-8c5f-3c05743b6c93 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:51.541833 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06faeae4-21af-4e15-8c5f-3c05743b6c93 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:51.542224 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06faeae4-21af-4e15-8c5f-3c05743b6c93 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:51.619889 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3cdab299-3285-4617-881a-e6cf95b87918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:51.620558 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3cdab299-3285-4617-881a-e6cf95b87918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:51.627309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cdab299-3285-4617-881a-e6cf95b87918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:51.627792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cdab299-3285-4617-881a-e6cf95b87918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:51.628343 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cdab299-3285-4617-881a-e6cf95b87918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:51.628968 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cdab299-3285-4617-881a-e6cf95b87918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:51.629393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cdab299-3285-4617-881a-e6cf95b87918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:51.630057 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3cdab299-3285-4617-881a-e6cf95b87918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:51.702443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3cdab299-3285-4617-881a-e6cf95b87918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:51.705708 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-06faeae4-21af-4e15-8c5f-3c05743b6c93 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:51.711803 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3cdab299-3285-4617-881a-e6cf95b87918 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.096509 Sep 05 17:31:51.712452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1254/2655] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:51 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:51.714962 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-06faeae4-21af-4e15-8c5f-3c05743b6c93 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.193848 Sep 05 17:31:51.715501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1402/2656] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:51 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:52.739366 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-87cd2f4a-2eca-4125-870c-3b9c86ec178a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:52.740299 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-87cd2f4a-2eca-4125-870c-3b9c86ec178a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:52.742060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b64cd97e-5f67-4dd4-8baf-e02998b256f3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:52.742667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b64cd97e-5f67-4dd4-8baf-e02998b256f3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:52.747595 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87cd2f4a-2eca-4125-870c-3b9c86ec178a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:52.748084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87cd2f4a-2eca-4125-870c-3b9c86ec178a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:52.748551 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87cd2f4a-2eca-4125-870c-3b9c86ec178a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:52.749273 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87cd2f4a-2eca-4125-870c-3b9c86ec178a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:52.749578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b64cd97e-5f67-4dd4-8baf-e02998b256f3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:52.749744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87cd2f4a-2eca-4125-870c-3b9c86ec178a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:52.750066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b64cd97e-5f67-4dd4-8baf-e02998b256f3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:52.750239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-87cd2f4a-2eca-4125-870c-3b9c86ec178a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:52.750498 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b64cd97e-5f67-4dd4-8baf-e02998b256f3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:52.751178 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b64cd97e-5f67-4dd4-8baf-e02998b256f3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:52.751623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b64cd97e-5f67-4dd4-8baf-e02998b256f3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:52.752035 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b64cd97e-5f67-4dd4-8baf-e02998b256f3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:52.818195 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-87cd2f4a-2eca-4125-870c-3b9c86ec178a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:52.826986 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-87cd2f4a-2eca-4125-870c-3b9c86ec178a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.094289 Sep 05 17:31:52.827577 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1255/2657] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:52 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:52.911282 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b64cd97e-5f67-4dd4-8baf-e02998b256f3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:52.920087 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b64cd97e-5f67-4dd4-8baf-e02998b256f3 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.183777 Sep 05 17:31:52.920701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1403/2658] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:52 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:53.852554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f169e420-e02a-4aec-9f9e-05662baeb5d5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:53.853186 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f169e420-e02a-4aec-9f9e-05662baeb5d5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:53.860094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f169e420-e02a-4aec-9f9e-05662baeb5d5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:53.860613 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f169e420-e02a-4aec-9f9e-05662baeb5d5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:53.861049 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f169e420-e02a-4aec-9f9e-05662baeb5d5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:53.861738 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f169e420-e02a-4aec-9f9e-05662baeb5d5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:53.862192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f169e420-e02a-4aec-9f9e-05662baeb5d5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:53.862615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f169e420-e02a-4aec-9f9e-05662baeb5d5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:53.877660 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:31:53.930422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f169e420-e02a-4aec-9f9e-05662baeb5d5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:53.942766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f169e420-e02a-4aec-9f9e-05662baeb5d5 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.094697 Sep 05 17:31:53.943804 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1256/2659] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:53 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:53.946792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3b81e8e1-f852-450f-9a33-99d4f2daef34 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:53.947406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3b81e8e1-f852-450f-9a33-99d4f2daef34 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:53.954201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b81e8e1-f852-450f-9a33-99d4f2daef34 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:53.954733 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b81e8e1-f852-450f-9a33-99d4f2daef34 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:53.955166 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b81e8e1-f852-450f-9a33-99d4f2daef34 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:53.955855 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b81e8e1-f852-450f-9a33-99d4f2daef34 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:53.956340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b81e8e1-f852-450f-9a33-99d4f2daef34 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:53.956769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b81e8e1-f852-450f-9a33-99d4f2daef34 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:54.101909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3b81e8e1-f852-450f-9a33-99d4f2daef34 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:54.110729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3b81e8e1-f852-450f-9a33-99d4f2daef34 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.169715 Sep 05 17:31:54.111222 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1404/2660] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:53 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:54.970339 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8c74de48-c613-4a4f-9f98-0baadcb9b807 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:54.971137 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8c74de48-c613-4a4f-9f98-0baadcb9b807 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:54.980783 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c74de48-c613-4a4f-9f98-0baadcb9b807 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:54.981476 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c74de48-c613-4a4f-9f98-0baadcb9b807 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:54.982100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c74de48-c613-4a4f-9f98-0baadcb9b807 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:54.983087 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c74de48-c613-4a4f-9f98-0baadcb9b807 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:54.983765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c74de48-c613-4a4f-9f98-0baadcb9b807 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:54.984458 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8c74de48-c613-4a4f-9f98-0baadcb9b807 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:55.053394 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8c74de48-c613-4a4f-9f98-0baadcb9b807 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:55.061882 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8c74de48-c613-4a4f-9f98-0baadcb9b807 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.097871 Sep 05 17:31:55.062445 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1257/2661] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:54 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:55.135413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2392ea63-afb7-441f-93c8-1c7c534f6d1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:55.136257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2392ea63-afb7-441f-93c8-1c7c534f6d1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:55.145717 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2392ea63-afb7-441f-93c8-1c7c534f6d1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:55.146411 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2392ea63-afb7-441f-93c8-1c7c534f6d1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:55.147031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2392ea63-afb7-441f-93c8-1c7c534f6d1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:55.148323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2392ea63-afb7-441f-93c8-1c7c534f6d1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:55.148980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2392ea63-afb7-441f-93c8-1c7c534f6d1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:55.149590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2392ea63-afb7-441f-93c8-1c7c534f6d1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:55.291664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2392ea63-afb7-441f-93c8-1c7c534f6d1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:55.304619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2392ea63-afb7-441f-93c8-1c7c534f6d1e tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.174115 Sep 05 17:31:55.305505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1405/2662] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:55 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:56.089110 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-994ee8f6-8d29-4fec-be52-6c892dc82b76 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:56.090463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-994ee8f6-8d29-4fec-be52-6c892dc82b76 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:56.100829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-994ee8f6-8d29-4fec-be52-6c892dc82b76 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:56.101310 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-994ee8f6-8d29-4fec-be52-6c892dc82b76 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:56.101736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-994ee8f6-8d29-4fec-be52-6c892dc82b76 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:56.102420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-994ee8f6-8d29-4fec-be52-6c892dc82b76 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:56.102867 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-994ee8f6-8d29-4fec-be52-6c892dc82b76 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:56.103288 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-994ee8f6-8d29-4fec-be52-6c892dc82b76 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:56.174446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-994ee8f6-8d29-4fec-be52-6c892dc82b76 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:56.183103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-994ee8f6-8d29-4fec-be52-6c892dc82b76 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.100834 Sep 05 17:31:56.183682 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1258/2663] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:56 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:56.336901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cc734c80-2a25-40bb-adb6-76c80842a240 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:56.337535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cc734c80-2a25-40bb-adb6-76c80842a240 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:56.344700 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc734c80-2a25-40bb-adb6-76c80842a240 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:56.345125 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc734c80-2a25-40bb-adb6-76c80842a240 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:56.345560 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc734c80-2a25-40bb-adb6-76c80842a240 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:56.346257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc734c80-2a25-40bb-adb6-76c80842a240 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:56.346710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc734c80-2a25-40bb-adb6-76c80842a240 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:56.347134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc734c80-2a25-40bb-adb6-76c80842a240 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:56.402055 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:31:56.402300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:31:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 (ip 10.222.0.23) !!! Sep 05 17:31:56.488185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cc734c80-2a25-40bb-adb6-76c80842a240 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:56.497850 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cc734c80-2a25-40bb-adb6-76c80842a240 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.166567 Sep 05 17:31:56.498427 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1406/2664] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:56 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:57.205877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1c18f998-2525-4fc4-836d-f29fbf319342 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:57.206477 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1c18f998-2525-4fc4-836d-f29fbf319342 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:57.208973 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:31:57.209130 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:31:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca (ip 10.222.0.23) !!! Sep 05 17:31:57.215702 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c18f998-2525-4fc4-836d-f29fbf319342 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:57.216184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c18f998-2525-4fc4-836d-f29fbf319342 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:57.216643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c18f998-2525-4fc4-836d-f29fbf319342 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:57.217333 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c18f998-2525-4fc4-836d-f29fbf319342 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:57.217786 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c18f998-2525-4fc4-836d-f29fbf319342 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:57.218205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1c18f998-2525-4fc4-836d-f29fbf319342 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:57.280897 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1c18f998-2525-4fc4-836d-f29fbf319342 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:57.293688 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1c18f998-2525-4fc4-836d-f29fbf319342 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.091738 Sep 05 17:31:57.294310 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1259/2665] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:57 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:57.527030 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6a6d102a-7846-4c4f-bafb-1296360444cf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:57.527961 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6a6d102a-7846-4c4f-bafb-1296360444cf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:57.538384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a6d102a-7846-4c4f-bafb-1296360444cf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:57.538893 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a6d102a-7846-4c4f-bafb-1296360444cf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:57.539323 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a6d102a-7846-4c4f-bafb-1296360444cf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:57.540015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a6d102a-7846-4c4f-bafb-1296360444cf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:57.540500 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a6d102a-7846-4c4f-bafb-1296360444cf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:57.540925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a6d102a-7846-4c4f-bafb-1296360444cf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:57.673890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6a6d102a-7846-4c4f-bafb-1296360444cf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:57.682474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6a6d102a-7846-4c4f-bafb-1296360444cf tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.163110 Sep 05 17:31:57.683040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1407/2666] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:57 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:58.319548 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e6e8a7af-1426-4f8b-b51a-f244ea16619b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:58.320380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e6e8a7af-1426-4f8b-b51a-f244ea16619b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:58.328872 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6e8a7af-1426-4f8b-b51a-f244ea16619b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:58.329467 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6e8a7af-1426-4f8b-b51a-f244ea16619b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:58.329996 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6e8a7af-1426-4f8b-b51a-f244ea16619b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:58.330837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6e8a7af-1426-4f8b-b51a-f244ea16619b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:58.331388 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6e8a7af-1426-4f8b-b51a-f244ea16619b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:58.331901 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e6e8a7af-1426-4f8b-b51a-f244ea16619b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:58.400487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e6e8a7af-1426-4f8b-b51a-f244ea16619b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:58.409153 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e6e8a7af-1426-4f8b-b51a-f244ea16619b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.095918 Sep 05 17:31:58.409699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1260/2667] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:58 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:58.710234 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-330853ee-2866-49c8-8870-fe27d328d4e5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:58.710986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-330853ee-2866-49c8-8870-fe27d328d4e5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:58.719339 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-330853ee-2866-49c8-8870-fe27d328d4e5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:58.719929 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-330853ee-2866-49c8-8870-fe27d328d4e5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:58.720508 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-330853ee-2866-49c8-8870-fe27d328d4e5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:58.721350 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-330853ee-2866-49c8-8870-fe27d328d4e5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:58.721905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-330853ee-2866-49c8-8870-fe27d328d4e5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:58.722428 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-330853ee-2866-49c8-8870-fe27d328d4e5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:58.856779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-330853ee-2866-49c8-8870-fe27d328d4e5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:58.869019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-330853ee-2866-49c8-8870-fe27d328d4e5 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.165120 Sep 05 17:31:58.869772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1408/2668] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:58 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:59.434432 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1613b4f8-79c3-4196-9c03-1fd12e43afd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:59.435064 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1613b4f8-79c3-4196-9c03-1fd12e43afd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:59.442141 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1613b4f8-79c3-4196-9c03-1fd12e43afd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:59.442616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1613b4f8-79c3-4196-9c03-1fd12e43afd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:59.443061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1613b4f8-79c3-4196-9c03-1fd12e43afd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:59.444104 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1613b4f8-79c3-4196-9c03-1fd12e43afd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:59.444308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1613b4f8-79c3-4196-9c03-1fd12e43afd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:59.444621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1613b4f8-79c3-4196-9c03-1fd12e43afd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:59.513744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1613b4f8-79c3-4196-9c03-1fd12e43afd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:31:59.524972 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1613b4f8-79c3-4196-9c03-1fd12e43afd2 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.094579 Sep 05 17:31:59.525548 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1261/2669] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:59 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:31:59.900667 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e898e002-4a64-4f70-984d-0f9763d7b616 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:31:59.901629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e898e002-4a64-4f70-984d-0f9763d7b616 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:31:59.912581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e898e002-4a64-4f70-984d-0f9763d7b616 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:59.913074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e898e002-4a64-4f70-984d-0f9763d7b616 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:59.913509 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e898e002-4a64-4f70-984d-0f9763d7b616 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:31:59.914210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e898e002-4a64-4f70-984d-0f9763d7b616 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:31:59.914661 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e898e002-4a64-4f70-984d-0f9763d7b616 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:31:59.915088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e898e002-4a64-4f70-984d-0f9763d7b616 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:00.051010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e898e002-4a64-4f70-984d-0f9763d7b616 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:00.059841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e898e002-4a64-4f70-984d-0f9763d7b616 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.165724 Sep 05 17:32:00.060420 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1409/2670] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:31:59 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:00.561024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-45a4bbe2-cc49-49b2-a76d-128bc0417346 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:00.561951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-45a4bbe2-cc49-49b2-a76d-128bc0417346 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:00.571460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-45a4bbe2-cc49-49b2-a76d-128bc0417346 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:00.571941 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-45a4bbe2-cc49-49b2-a76d-128bc0417346 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:00.572414 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-45a4bbe2-cc49-49b2-a76d-128bc0417346 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:00.573109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-45a4bbe2-cc49-49b2-a76d-128bc0417346 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:00.573561 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-45a4bbe2-cc49-49b2-a76d-128bc0417346 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:00.573986 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-45a4bbe2-cc49-49b2-a76d-128bc0417346 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:00.641099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-45a4bbe2-cc49-49b2-a76d-128bc0417346 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:00.649618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-45a4bbe2-cc49-49b2-a76d-128bc0417346 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.095376 Sep 05 17:32:00.650197 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1262/2671] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:00 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:01.087459 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2e5fd9b5-b32e-45aa-b4c9-d727e68fe296 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:01.088525 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2e5fd9b5-b32e-45aa-b4c9-d727e68fe296 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:01.100020 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e5fd9b5-b32e-45aa-b4c9-d727e68fe296 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:01.100652 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e5fd9b5-b32e-45aa-b4c9-d727e68fe296 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:01.101083 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e5fd9b5-b32e-45aa-b4c9-d727e68fe296 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:01.101765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e5fd9b5-b32e-45aa-b4c9-d727e68fe296 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:01.102213 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e5fd9b5-b32e-45aa-b4c9-d727e68fe296 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:01.102630 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e5fd9b5-b32e-45aa-b4c9-d727e68fe296 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:01.244749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2e5fd9b5-b32e-45aa-b4c9-d727e68fe296 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:01.253475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2e5fd9b5-b32e-45aa-b4c9-d727e68fe296 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.172619 Sep 05 17:32:01.254075 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1410/2672] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:01 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:01.677002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-beb11b30-626a-444a-801e-f93ec190084e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:01.678146 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-beb11b30-626a-444a-801e-f93ec190084e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:01.680987 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=54 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:32:01.687521 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-beb11b30-626a-444a-801e-f93ec190084e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:01.688100 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-beb11b30-626a-444a-801e-f93ec190084e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:01.688631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-beb11b30-626a-444a-801e-f93ec190084e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:01.689436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-beb11b30-626a-444a-801e-f93ec190084e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:01.689949 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-beb11b30-626a-444a-801e-f93ec190084e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:01.690438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-beb11b30-626a-444a-801e-f93ec190084e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:01.767311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-beb11b30-626a-444a-801e-f93ec190084e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:01.776083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-beb11b30-626a-444a-801e-f93ec190084e tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.105870 Sep 05 17:32:01.776712 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1263/2673] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:01 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:02.283000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2715dd74-32eb-4439-a42c-eefbd75afea8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:02.284250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2715dd74-32eb-4439-a42c-eefbd75afea8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:02.296422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2715dd74-32eb-4439-a42c-eefbd75afea8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:02.297214 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2715dd74-32eb-4439-a42c-eefbd75afea8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:02.297922 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2715dd74-32eb-4439-a42c-eefbd75afea8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:02.299049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2715dd74-32eb-4439-a42c-eefbd75afea8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:02.299792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2715dd74-32eb-4439-a42c-eefbd75afea8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:02.300546 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2715dd74-32eb-4439-a42c-eefbd75afea8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:02.304371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:32:02.454623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2715dd74-32eb-4439-a42c-eefbd75afea8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:02.463513 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2715dd74-32eb-4439-a42c-eefbd75afea8 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.188186 Sep 05 17:32:02.464095 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1411/2674] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:02 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:02.803090 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6273ab26-e940-4f98-aeee-365be087644f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:02.804222 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6273ab26-e940-4f98-aeee-365be087644f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:02.814875 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6273ab26-e940-4f98-aeee-365be087644f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:02.815680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6273ab26-e940-4f98-aeee-365be087644f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:02.816510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6273ab26-e940-4f98-aeee-365be087644f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:02.817648 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6273ab26-e940-4f98-aeee-365be087644f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:02.818498 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6273ab26-e940-4f98-aeee-365be087644f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:02.818984 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6273ab26-e940-4f98-aeee-365be087644f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:02.881692 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6273ab26-e940-4f98-aeee-365be087644f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:02.895433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6273ab26-e940-4f98-aeee-365be087644f tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.098712 Sep 05 17:32:02.896246 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1264/2675] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:02 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:03.487997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2c0a4a44-c4f0-419d-ab13-9af0b3a71e77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:03.488584 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2c0a4a44-c4f0-419d-ab13-9af0b3a71e77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:03.495835 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c0a4a44-c4f0-419d-ab13-9af0b3a71e77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:03.496370 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c0a4a44-c4f0-419d-ab13-9af0b3a71e77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:03.496808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c0a4a44-c4f0-419d-ab13-9af0b3a71e77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:03.497505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c0a4a44-c4f0-419d-ab13-9af0b3a71e77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:03.497939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c0a4a44-c4f0-419d-ab13-9af0b3a71e77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:03.498389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c0a4a44-c4f0-419d-ab13-9af0b3a71e77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:03.632332 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2c0a4a44-c4f0-419d-ab13-9af0b3a71e77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:03.641050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2c0a4a44-c4f0-419d-ab13-9af0b3a71e77 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.157413 Sep 05 17:32:03.641629 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1412/2676] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:03 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:03.928562 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d5a51313-a833-4607-a9f4-cef2a49949f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:03.929559 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d5a51313-a833-4607-a9f4-cef2a49949f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:03.938028 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5a51313-a833-4607-a9f4-cef2a49949f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:03.938638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5a51313-a833-4607-a9f4-cef2a49949f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:03.939180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5a51313-a833-4607-a9f4-cef2a49949f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:03.940084 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5a51313-a833-4607-a9f4-cef2a49949f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:03.940729 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5a51313-a833-4607-a9f4-cef2a49949f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:03.941252 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5a51313-a833-4607-a9f4-cef2a49949f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:04.006165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d5a51313-a833-4607-a9f4-cef2a49949f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:04.014517 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d5a51313-a833-4607-a9f4-cef2a49949f1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.092546 Sep 05 17:32:04.015083 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1265/2677] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:03 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:04.667390 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f0890207-ceb1-4386-bb19-254c6d65087c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:04.668179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f0890207-ceb1-4386-bb19-254c6d65087c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:04.671204 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=52 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:32:04.678586 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0890207-ceb1-4386-bb19-254c6d65087c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:04.679079 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0890207-ceb1-4386-bb19-254c6d65087c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:04.679521 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0890207-ceb1-4386-bb19-254c6d65087c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:04.680263 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0890207-ceb1-4386-bb19-254c6d65087c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:04.680707 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0890207-ceb1-4386-bb19-254c6d65087c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:04.681129 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0890207-ceb1-4386-bb19-254c6d65087c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:04.818315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f0890207-ceb1-4386-bb19-254c6d65087c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:04.826767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f0890207-ceb1-4386-bb19-254c6d65087c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.164877 Sep 05 17:32:04.827341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1413/2678] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:04 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:05.041868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f145bf13-c2f7-48a0-8613-235c9952d4b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:05.042517 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f145bf13-c2f7-48a0-8613-235c9952d4b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:05.050438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f145bf13-c2f7-48a0-8613-235c9952d4b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:05.051001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f145bf13-c2f7-48a0-8613-235c9952d4b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:05.051504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f145bf13-c2f7-48a0-8613-235c9952d4b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:05.052347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f145bf13-c2f7-48a0-8613-235c9952d4b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:05.053485 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f145bf13-c2f7-48a0-8613-235c9952d4b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:05.054024 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f145bf13-c2f7-48a0-8613-235c9952d4b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:05.248033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f145bf13-c2f7-48a0-8613-235c9952d4b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:05.262825 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f145bf13-c2f7-48a0-8613-235c9952d4b1 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.226799 Sep 05 17:32:05.263715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1266/2679] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:05 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:05.851289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a752138f-284a-45b5-b28d-77a77f61abf9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:05.851927 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a752138f-284a-45b5-b28d-77a77f61abf9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:05.858859 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a752138f-284a-45b5-b28d-77a77f61abf9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:05.859340 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a752138f-284a-45b5-b28d-77a77f61abf9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:05.859768 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a752138f-284a-45b5-b28d-77a77f61abf9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:05.860507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a752138f-284a-45b5-b28d-77a77f61abf9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:05.860951 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a752138f-284a-45b5-b28d-77a77f61abf9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:05.861356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a752138f-284a-45b5-b28d-77a77f61abf9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:06.057287 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a752138f-284a-45b5-b28d-77a77f61abf9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:06.065767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a752138f-284a-45b5-b28d-77a77f61abf9 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.218644 Sep 05 17:32:06.066385 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1414/2680] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:05 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:06.290199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-943f9871-f3e8-4592-9fea-b9a40002a736 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:06.290822 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-943f9871-f3e8-4592-9fea-b9a40002a736 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:06.297715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-943f9871-f3e8-4592-9fea-b9a40002a736 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:06.298198 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-943f9871-f3e8-4592-9fea-b9a40002a736 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:06.298627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-943f9871-f3e8-4592-9fea-b9a40002a736 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:06.299316 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-943f9871-f3e8-4592-9fea-b9a40002a736 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:06.299762 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-943f9871-f3e8-4592-9fea-b9a40002a736 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:06.300177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-943f9871-f3e8-4592-9fea-b9a40002a736 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:06.364816 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-943f9871-f3e8-4592-9fea-b9a40002a736 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:06.373685 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-943f9871-f3e8-4592-9fea-b9a40002a736 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.087868 Sep 05 17:32:06.374970 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1267/2681] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:06 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:07.094217 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-345e4cc2-9a0b-41f2-8194-e06a0fc790fa tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:07.095227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-345e4cc2-9a0b-41f2-8194-e06a0fc790fa tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:07.103850 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-345e4cc2-9a0b-41f2-8194-e06a0fc790fa tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:07.104380 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-345e4cc2-9a0b-41f2-8194-e06a0fc790fa tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:07.104814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-345e4cc2-9a0b-41f2-8194-e06a0fc790fa tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:07.105510 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-345e4cc2-9a0b-41f2-8194-e06a0fc790fa tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:07.105966 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-345e4cc2-9a0b-41f2-8194-e06a0fc790fa tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:07.106402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-345e4cc2-9a0b-41f2-8194-e06a0fc790fa tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:07.238791 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-345e4cc2-9a0b-41f2-8194-e06a0fc790fa tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:07.247300 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-345e4cc2-9a0b-41f2-8194-e06a0fc790fa tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.160061 Sep 05 17:32:07.247871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1415/2682] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:07 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:07.397203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d800a8a9-e83b-4e5e-8dc9-dad221453321 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:07.397834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d800a8a9-e83b-4e5e-8dc9-dad221453321 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:07.405254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d800a8a9-e83b-4e5e-8dc9-dad221453321 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:07.405732 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d800a8a9-e83b-4e5e-8dc9-dad221453321 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:07.406156 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d800a8a9-e83b-4e5e-8dc9-dad221453321 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:07.406860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d800a8a9-e83b-4e5e-8dc9-dad221453321 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:07.407281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d800a8a9-e83b-4e5e-8dc9-dad221453321 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:07.407693 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d800a8a9-e83b-4e5e-8dc9-dad221453321 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:07.472731 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d800a8a9-e83b-4e5e-8dc9-dad221453321 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:07.484662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d800a8a9-e83b-4e5e-8dc9-dad221453321 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.091142 Sep 05 17:32:07.485366 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1268/2683] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:07 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:08.274366 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9632cffb-8acf-4e17-a544-c9734a44391c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:08.275131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9632cffb-8acf-4e17-a544-c9734a44391c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:08.283807 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9632cffb-8acf-4e17-a544-c9734a44391c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:08.284474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9632cffb-8acf-4e17-a544-c9734a44391c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:08.285015 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9632cffb-8acf-4e17-a544-c9734a44391c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:08.285873 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9632cffb-8acf-4e17-a544-c9734a44391c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:08.286435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9632cffb-8acf-4e17-a544-c9734a44391c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:08.286969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9632cffb-8acf-4e17-a544-c9734a44391c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:08.424324 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9632cffb-8acf-4e17-a544-c9734a44391c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:08.433331 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9632cffb-8acf-4e17-a544-c9734a44391c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.164797 Sep 05 17:32:08.433908 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1416/2684] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:08 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:08.511017 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-bb278d72-f453-4298-ac37-bd2257842a09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:08.511598 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-bb278d72-f453-4298-ac37-bd2257842a09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:08.519582 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bb278d72-f453-4298-ac37-bd2257842a09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:08.520043 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bb278d72-f453-4298-ac37-bd2257842a09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:08.520516 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bb278d72-f453-4298-ac37-bd2257842a09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:08.521656 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bb278d72-f453-4298-ac37-bd2257842a09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:08.522549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bb278d72-f453-4298-ac37-bd2257842a09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:08.522964 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bb278d72-f453-4298-ac37-bd2257842a09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:08.587930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bb278d72-f453-4298-ac37-bd2257842a09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:08.597130 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-bb278d72-f453-4298-ac37-bd2257842a09 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.091618 Sep 05 17:32:08.597710 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1269/2685] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:08 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:09.458359 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d32f0f06-b921-4b3f-81d2-f3d32573f46a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:09.459116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d32f0f06-b921-4b3f-81d2-f3d32573f46a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:09.467177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d32f0f06-b921-4b3f-81d2-f3d32573f46a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:09.467666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d32f0f06-b921-4b3f-81d2-f3d32573f46a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:09.468103 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d32f0f06-b921-4b3f-81d2-f3d32573f46a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:09.468835 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d32f0f06-b921-4b3f-81d2-f3d32573f46a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:09.469292 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d32f0f06-b921-4b3f-81d2-f3d32573f46a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:09.469715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d32f0f06-b921-4b3f-81d2-f3d32573f46a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:09.605072 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d32f0f06-b921-4b3f-81d2-f3d32573f46a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:09.613707 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d32f0f06-b921-4b3f-81d2-f3d32573f46a tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.159345 Sep 05 17:32:09.614274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1417/2686] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:09 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:09.620310 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ef6335e7-24df-47f5-913b-361589593c4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:09.620870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ef6335e7-24df-47f5-913b-361589593c4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:09.627631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef6335e7-24df-47f5-913b-361589593c4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:09.628122 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef6335e7-24df-47f5-913b-361589593c4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:09.628564 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef6335e7-24df-47f5-913b-361589593c4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:09.629330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef6335e7-24df-47f5-913b-361589593c4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:09.629713 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef6335e7-24df-47f5-913b-361589593c4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:09.630123 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ef6335e7-24df-47f5-913b-361589593c4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:09.692361 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ef6335e7-24df-47f5-913b-361589593c4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:09.705137 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ef6335e7-24df-47f5-913b-361589593c4b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.088494 Sep 05 17:32:09.705924 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1270/2687] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:09 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:10.641769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ac68ea9a-edb7-41b5-9d57-8e21641d6c62 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:10.642769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ac68ea9a-edb7-41b5-9d57-8e21641d6c62 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:10.651279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac68ea9a-edb7-41b5-9d57-8e21641d6c62 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:10.651760 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac68ea9a-edb7-41b5-9d57-8e21641d6c62 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:10.652174 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac68ea9a-edb7-41b5-9d57-8e21641d6c62 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:10.652904 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac68ea9a-edb7-41b5-9d57-8e21641d6c62 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:10.653349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac68ea9a-edb7-41b5-9d57-8e21641d6c62 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:10.653761 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac68ea9a-edb7-41b5-9d57-8e21641d6c62 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:10.734011 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8f351c4a-e718-4faa-a89c-606d31adb0d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:10.734618 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8f351c4a-e718-4faa-a89c-606d31adb0d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:10.741749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8f351c4a-e718-4faa-a89c-606d31adb0d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:10.742207 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8f351c4a-e718-4faa-a89c-606d31adb0d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:10.742654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8f351c4a-e718-4faa-a89c-606d31adb0d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:10.743354 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8f351c4a-e718-4faa-a89c-606d31adb0d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:10.743799 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8f351c4a-e718-4faa-a89c-606d31adb0d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:10.744218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8f351c4a-e718-4faa-a89c-606d31adb0d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:10.794742 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ac68ea9a-edb7-41b5-9d57-8e21641d6c62 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:10.803581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ac68ea9a-edb7-41b5-9d57-8e21641d6c62 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.168639 Sep 05 17:32:10.804485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1418/2688] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:10 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:10.810082 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8f351c4a-e718-4faa-a89c-606d31adb0d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:10.819199 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8f351c4a-e718-4faa-a89c-606d31adb0d7 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.088551 Sep 05 17:32:10.819770 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1271/2689] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:10 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:11.831096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-580ecfd5-e977-4b31-8660-ba13f359641c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:11.832092 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-580ecfd5-e977-4b31-8660-ba13f359641c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:11.843464 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-580ecfd5-e977-4b31-8660-ba13f359641c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:11.844243 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-580ecfd5-e977-4b31-8660-ba13f359641c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:11.845018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-580ecfd5-e977-4b31-8660-ba13f359641c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:11.846115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-580ecfd5-e977-4b31-8660-ba13f359641c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:11.846858 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-580ecfd5-e977-4b31-8660-ba13f359641c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:11.847525 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-580ecfd5-e977-4b31-8660-ba13f359641c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:11.855763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-85bce28e-8b61-485a-9465-d9f784642f6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:11.857062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-85bce28e-8b61-485a-9465-d9f784642f6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:11.864026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-85bce28e-8b61-485a-9465-d9f784642f6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:11.864659 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-85bce28e-8b61-485a-9465-d9f784642f6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:11.865749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-85bce28e-8b61-485a-9465-d9f784642f6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:11.866466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-85bce28e-8b61-485a-9465-d9f784642f6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:11.866941 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-85bce28e-8b61-485a-9465-d9f784642f6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:11.867345 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-85bce28e-8b61-485a-9465-d9f784642f6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:11.947673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-85bce28e-8b61-485a-9465-d9f784642f6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:11.956253 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-85bce28e-8b61-485a-9465-d9f784642f6a tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.107046 Sep 05 17:32:11.956817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1272/2690] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:11 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:12.005913 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-580ecfd5-e977-4b31-8660-ba13f359641c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:12.014442 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-580ecfd5-e977-4b31-8660-ba13f359641c tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.189966 Sep 05 17:32:12.015052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1419/2691] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:11 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:13.039156 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e7dd5062-1ce2-45dd-9db1-cadb9d816ec2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:13.039811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e7dd5062-1ce2-45dd-9db1-cadb9d816ec2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:13.046504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7dd5062-1ce2-45dd-9db1-cadb9d816ec2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:13.047008 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7dd5062-1ce2-45dd-9db1-cadb9d816ec2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:13.047429 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7dd5062-1ce2-45dd-9db1-cadb9d816ec2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:13.048128 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7dd5062-1ce2-45dd-9db1-cadb9d816ec2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:13.048608 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7dd5062-1ce2-45dd-9db1-cadb9d816ec2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:13.049024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7dd5062-1ce2-45dd-9db1-cadb9d816ec2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:13.101151 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3d9a5543-9211-4284-bd74-9a5ae7884f63 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:13.101774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3d9a5543-9211-4284-bd74-9a5ae7884f63 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:13.107882 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d9a5543-9211-4284-bd74-9a5ae7884f63 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:13.108408 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d9a5543-9211-4284-bd74-9a5ae7884f63 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:13.108837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d9a5543-9211-4284-bd74-9a5ae7884f63 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:13.109530 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d9a5543-9211-4284-bd74-9a5ae7884f63 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:13.109974 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d9a5543-9211-4284-bd74-9a5ae7884f63 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:13.110390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3d9a5543-9211-4284-bd74-9a5ae7884f63 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:13.112998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=100 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:32:13.185144 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3d9a5543-9211-4284-bd74-9a5ae7884f63 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:13.193948 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3d9a5543-9211-4284-bd74-9a5ae7884f63 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.215897 Sep 05 17:32:13.194820 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1273/2692] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:12 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:13.216232 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e7dd5062-1ce2-45dd-9db1-cadb9d816ec2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:13.226040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e7dd5062-1ce2-45dd-9db1-cadb9d816ec2 tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.190935 Sep 05 17:32:13.226783 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1420/2693] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:13 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:14.222764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e043bbd4-5f31-483e-a3f5-56aa7725e685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:14.223730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e043bbd4-5f31-483e-a3f5-56aa7725e685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:14.235066 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e043bbd4-5f31-483e-a3f5-56aa7725e685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:14.235855 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e043bbd4-5f31-483e-a3f5-56aa7725e685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:14.236628 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e043bbd4-5f31-483e-a3f5-56aa7725e685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:14.237757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e043bbd4-5f31-483e-a3f5-56aa7725e685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:14.238540 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e043bbd4-5f31-483e-a3f5-56aa7725e685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:14.239227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e043bbd4-5f31-483e-a3f5-56aa7725e685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:14.250945 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-66fcedb3-07d2-466b-88f9-c65ef6dce90b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:14.251576 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-66fcedb3-07d2-466b-88f9-c65ef6dce90b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:14.258769 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66fcedb3-07d2-466b-88f9-c65ef6dce90b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:14.259251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66fcedb3-07d2-466b-88f9-c65ef6dce90b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:14.259659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66fcedb3-07d2-466b-88f9-c65ef6dce90b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:14.260435 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66fcedb3-07d2-466b-88f9-c65ef6dce90b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:14.260886 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66fcedb3-07d2-466b-88f9-c65ef6dce90b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:14.261311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66fcedb3-07d2-466b-88f9-c65ef6dce90b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:14.303254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e043bbd4-5f31-483e-a3f5-56aa7725e685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:14.311868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e043bbd4-5f31-483e-a3f5-56aa7725e685 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.095635 Sep 05 17:32:14.312519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1274/2694] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:14 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:14.402040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-66fcedb3-07d2-466b-88f9-c65ef6dce90b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:14.410670 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-66fcedb3-07d2-466b-88f9-c65ef6dce90b tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.163637 Sep 05 17:32:14.411246 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1421/2695] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:14 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:15.339747 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-201c51d8-baa0-4a79-abe2-aec540e07d0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:15.340760 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-201c51d8-baa0-4a79-abe2-aec540e07d0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] [instance: c8c420ca-19c4-4f51-8091-e83672ea54ca] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:15.351488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-201c51d8-baa0-4a79-abe2-aec540e07d0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:15.351964 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-201c51d8-baa0-4a79-abe2-aec540e07d0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:15.352429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-201c51d8-baa0-4a79-abe2-aec540e07d0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:15.353118 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-201c51d8-baa0-4a79-abe2-aec540e07d0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:15.353567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-201c51d8-baa0-4a79-abe2-aec540e07d0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:15.353985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-201c51d8-baa0-4a79-abe2-aec540e07d0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:15.416018 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-201c51d8-baa0-4a79-abe2-aec540e07d0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b8aa2ae43a4d89ad579a5fdd87d564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2e9de2e0a64e67beb01dc673c653e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:15.424735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-201c51d8-baa0-4a79-abe2-aec540e07d0b tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca" status: 200 len: 1388 microversion: 2.1 time: 0.091947 Sep 05 17:32:15.429116 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1275/2696] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:15 2022] GET /compute/v2.1/servers/c8c420ca-19c4-4f51-8091-e83672ea54ca => generated 1388 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:15.434680 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8fe2ba6e-eed8-46af-8b05-eefe6c85cacc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:15.435193 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8fe2ba6e-eed8-46af-8b05-eefe6c85cacc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] [instance: cba4a1fa-a126-4e6b-9ac4-32290e275435] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:15.441939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fe2ba6e-eed8-46af-8b05-eefe6c85cacc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:15.442424 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fe2ba6e-eed8-46af-8b05-eefe6c85cacc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:15.442856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fe2ba6e-eed8-46af-8b05-eefe6c85cacc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:15.443597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fe2ba6e-eed8-46af-8b05-eefe6c85cacc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:15.444050 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fe2ba6e-eed8-46af-8b05-eefe6c85cacc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:15.444499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fe2ba6e-eed8-46af-8b05-eefe6c85cacc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:15.447994 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d5e0820f-ac31-474c-864b-124e6910ca72 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] Calling method '.version_select at 0x7f1d3ac7f310>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:15.469901 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d5e0820f-ac31-474c-864b-124e6910ca72 tempest-TestMinimumBasicScenario-1817762964 tempest-TestMinimumBasicScenario-1817762964-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-728167551" status: 202 len: 0 microversion: 2.1 time: 0.026596 Sep 05 17:32:15.470561 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1276/2697] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Sep 5 17:32:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-728167551 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:32:15.577581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8fe2ba6e-eed8-46af-8b05-eefe6c85cacc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc83779cc4e54be794873d62e3ac9061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375cd031a57847ed99991340bf65d3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:15.586140 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8fe2ba6e-eed8-46af-8b05-eefe6c85cacc tempest-VolumesSnapshotTestJSON-437066400 tempest-VolumesSnapshotTestJSON-437066400-project] 10.222.0.23 "GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435" status: 200 len: 1559 microversion: 2.1 time: 0.155422 Sep 05 17:32:15.586875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1422/2698] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:15 2022] GET /compute/v2.1/servers/cba4a1fa-a126-4e6b-9ac4-32290e275435 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:16.992666 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f1b47876-195f-44a6-ab18-863bad7072a5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:16.993245 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f1b47876-195f-44a6-ab18-863bad7072a5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:16.999495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1b47876-195f-44a6-ab18-863bad7072a5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:17.000016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1b47876-195f-44a6-ab18-863bad7072a5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:17.000717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1b47876-195f-44a6-ab18-863bad7072a5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:17.001608 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1b47876-195f-44a6-ab18-863bad7072a5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:17.002032 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1b47876-195f-44a6-ab18-863bad7072a5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:17.002633 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f1b47876-195f-44a6-ab18-863bad7072a5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:17.042934 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f1b47876-195f-44a6-ab18-863bad7072a5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Going to try to terminate instance {{(pid=120733) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:32:17.129311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f1b47876-195f-44a6-ab18-863bad7072a5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 204 len: 0 microversion: 2.1 time: 0.140310 Sep 05 17:32:17.130642 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1277/2699] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:32:16 2022] DELETE /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:32:17.141266 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fcc5a6c5-f8c2-4eb4-9f20-0faa04e36605 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:17.142844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fcc5a6c5-f8c2-4eb4-9f20-0faa04e36605 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:17.156006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcc5a6c5-f8c2-4eb4-9f20-0faa04e36605 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:17.157183 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcc5a6c5-f8c2-4eb4-9f20-0faa04e36605 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:17.158726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcc5a6c5-f8c2-4eb4-9f20-0faa04e36605 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:17.159995 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcc5a6c5-f8c2-4eb4-9f20-0faa04e36605 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:17.160917 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcc5a6c5-f8c2-4eb4-9f20-0faa04e36605 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:17.161546 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcc5a6c5-f8c2-4eb4-9f20-0faa04e36605 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:17.401779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fcc5a6c5-f8c2-4eb4-9f20-0faa04e36605 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:17.409609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fcc5a6c5-f8c2-4eb4-9f20-0faa04e36605 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 200 len: 1681 microversion: 2.1 time: 0.273183 Sep 05 17:32:17.410233 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1423/2700] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:17 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 1681 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:18.433734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-64c8ba54-8e07-453b-8097-f6249bfda635 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:18.435238 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-64c8ba54-8e07-453b-8097-f6249bfda635 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:18.442210 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64c8ba54-8e07-453b-8097-f6249bfda635 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:18.442942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64c8ba54-8e07-453b-8097-f6249bfda635 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:18.443600 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64c8ba54-8e07-453b-8097-f6249bfda635 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:18.445248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64c8ba54-8e07-453b-8097-f6249bfda635 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:18.445932 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64c8ba54-8e07-453b-8097-f6249bfda635 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:18.446567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-64c8ba54-8e07-453b-8097-f6249bfda635 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:18.645586 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-64c8ba54-8e07-453b-8097-f6249bfda635 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:18.655663 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-64c8ba54-8e07-453b-8097-f6249bfda635 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 200 len: 1681 microversion: 2.1 time: 0.226249 Sep 05 17:32:18.670183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1278/2701] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:18 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:19.107980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-6fd43fd6-2389-4b64-bcb8-59e4b1f4a469 req-3a7df0df-a80f-49a3-81fc-1e599b2785a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84a236f-3d97-4011-b0d9-0c42454895c1", "name": "network-vif-deleted", "tag": "df90783c-9a54-4fd7-a02c-14a305c048f7"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:32:19.124712 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-6fd43fd6-2389-4b64-bcb8-59e4b1f4a469 req-3a7df0df-a80f-49a3-81fc-1e599b2785a1 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:19.125202 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-6fd43fd6-2389-4b64-bcb8-59e4b1f4a469 req-3a7df0df-a80f-49a3-81fc-1e599b2785a1 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:19.125637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-6fd43fd6-2389-4b64-bcb8-59e4b1f4a469 req-3a7df0df-a80f-49a3-81fc-1e599b2785a1 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:19.155800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-6fd43fd6-2389-4b64-bcb8-59e4b1f4a469 req-3a7df0df-a80f-49a3-81fc-1e599b2785a1 service nova] Creating event network-vif-deleted:df90783c-9a54-4fd7-a02c-14a305c048f7 for instance b84a236f-3d97-4011-b0d9-0c42454895c1 on hv-cinder-85596 Sep 05 17:32:19.165303 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-6fd43fd6-2389-4b64-bcb8-59e4b1f4a469 req-3a7df0df-a80f-49a3-81fc-1e599b2785a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199306 Sep 05 17:32:19.166298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1424/2702] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:32:19.683376 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9f0f0612-d2bf-4bab-b60d-67ccdad7bd17 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:19.684675 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9f0f0612-d2bf-4bab-b60d-67ccdad7bd17 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:19.692623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9f0f0612-d2bf-4bab-b60d-67ccdad7bd17 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:19.693448 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9f0f0612-d2bf-4bab-b60d-67ccdad7bd17 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:19.694386 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9f0f0612-d2bf-4bab-b60d-67ccdad7bd17 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:19.695643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9f0f0612-d2bf-4bab-b60d-67ccdad7bd17 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:19.696386 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9f0f0612-d2bf-4bab-b60d-67ccdad7bd17 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:19.697122 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9f0f0612-d2bf-4bab-b60d-67ccdad7bd17 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:19.757702 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9f0f0612-d2bf-4bab-b60d-67ccdad7bd17 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:19.758513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9f0f0612-d2bf-4bab-b60d-67ccdad7bd17 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:19.770399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9f0f0612-d2bf-4bab-b60d-67ccdad7bd17 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:19.773936 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.objects.instance [None req-9f0f0612-d2bf-4bab-b60d-67ccdad7bd17 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lazy-loading 'fault' on Instance uuid b84a236f-3d97-4011-b0d9-0c42454895c1 {{(pid=120733) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:32:19.865303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9f0f0612-d2bf-4bab-b60d-67ccdad7bd17 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b81fb00b1b545308d01f74a55b7e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ed4f1f1246408099252ebea491832c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:32:19.882714 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9f0f0612-d2bf-4bab-b60d-67ccdad7bd17 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 200 len: 1331 microversion: 2.1 time: 0.203232 Sep 05 17:32:19.883763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1279/2703] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:19 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 1331 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:32:20.915052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9cd9e0b7-ed94-49eb-8c7f-f00e66daf7cc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:20.915736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9cd9e0b7-ed94-49eb-8c7f-f00e66daf7cc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:32:20.922471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cd9e0b7-ed94-49eb-8c7f-f00e66daf7cc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:20.922970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cd9e0b7-ed94-49eb-8c7f-f00e66daf7cc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:20.923385 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cd9e0b7-ed94-49eb-8c7f-f00e66daf7cc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:20.924095 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cd9e0b7-ed94-49eb-8c7f-f00e66daf7cc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:32:20.924583 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cd9e0b7-ed94-49eb-8c7f-f00e66daf7cc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:32:20.925006 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cd9e0b7-ed94-49eb-8c7f-f00e66daf7cc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:32:20.939771 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-9cd9e0b7-ed94-49eb-8c7f-f00e66daf7cc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] HTTP exception thrown: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9cd9e0b7-ed94-49eb-8c7f-f00e66daf7cc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Request method failure captured: Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 HTTP/1.1 Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFiv_u9Fbkzz4N4EnwLFTHdVgGIHyTWZLVadgHsx5DjzJc71ULzFynHZ-XPxUeQAMj5CK9TClkqesRSKhjnpIv2d__HUGj1wgdznOqyEZDFoYmO3imZ0m9_h8uFe0RLmxeR8bY4quUM556Rumoa232jhk_i2qgcsiqF_5KIfw8vmSWkU Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:32:20.941580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:32:20.943310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6ed4f1f1246408099252ebea491832c"}]}] Sep 05 17:32:20.943310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:32:20.943310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:32:20.943310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:32:20.943310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:32:20.943310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:32:20.943310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:32:20.943310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: 2b81fb00b1b545308d01f74a55b7e77b Sep 05 17:32:20.943310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:32:20.943310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:32:20.943310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. Sep 05 17:32:20.943310 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': 'b84a236f-3d97-4011-b0d9-0c42454895c1'} Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:32:20.944834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. Sep 05 17:32:20.947722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:32:20.950066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9cd9e0b7-ed94-49eb-8c7f-f00e66daf7cc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Returning 404 to user: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:32:20.950066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9cd9e0b7-ed94-49eb-8c7f-f00e66daf7cc tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 404 len: 111 microversion: 2.1 time: 0.034168 Sep 05 17:32:20.950066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1425/2704] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:32:20 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:32:20.952959 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-12040981-1ddc-4ac0-874e-862c7edba767 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '.version_select at 0x7f1d3aa52310>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:32:20.978360 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-12040981-1ddc-4ac0-874e-862c7edba767 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1012831540" status: 202 len: 0 microversion: 2.1 time: 0.028081 Sep 05 17:32:20.979207 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1280/2705] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Sep 5 17:32:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1012831540 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:36:18.443774 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed17db71-0dc9-4537-b54e-cdfd10e049bc] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 05 17:36:18.446016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=25 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:36:18.447882 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=81 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:36:18.448870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR oslo.messaging._drivers.impl_rabbit [-] [60ecb80f-af85-4d00-8c41-b5df5901a58b] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 05 17:36:18.449531 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:36:18.449852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:36:18.450219 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:36:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 (ip 10.222.0.23) !!! Sep 05 17:36:18.450536 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:36:18.453110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 05 17:36:18.453277 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:36:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 (ip 10.222.0.23) !!! Sep 05 17:36:18.455151 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 05 17:36:18.455289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 05 17:36:18.455431 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:36:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 (ip 10.222.0.23) !!! Sep 05 17:36:18.455975 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:36:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 (ip 10.222.0.23) !!! Sep 05 17:36:18.462679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 05 17:36:18.463409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:36:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 (ip 10.222.0.23) !!! Sep 05 17:36:18.465802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-221d96c3-ae42-4ee4-afa9-cd33ce2bee70 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:18.466133 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 05 17:36:18.466441 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:36:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 (ip 10.222.0.23) !!! Sep 05 17:36:18.467081 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-221d96c3-ae42-4ee4-afa9-cd33ce2bee70 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:18.481462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-22d459b2-c8b8-437c-9e21-caba91ea3fe5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:18.482475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-22d459b2-c8b8-437c-9e21-caba91ea3fe5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:18.497755 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22d459b2-c8b8-437c-9e21-caba91ea3fe5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:18.498261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-221d96c3-ae42-4ee4-afa9-cd33ce2bee70 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:18.498598 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22d459b2-c8b8-437c-9e21-caba91ea3fe5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:18.498751 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-221d96c3-ae42-4ee4-afa9-cd33ce2bee70 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:18.499177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22d459b2-c8b8-437c-9e21-caba91ea3fe5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:18.499309 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-221d96c3-ae42-4ee4-afa9-cd33ce2bee70 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:18.499891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-221d96c3-ae42-4ee4-afa9-cd33ce2bee70 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:18.500039 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22d459b2-c8b8-437c-9e21-caba91ea3fe5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:18.500362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-221d96c3-ae42-4ee4-afa9-cd33ce2bee70 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:18.500492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22d459b2-c8b8-437c-9e21-caba91ea3fe5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:18.500782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-221d96c3-ae42-4ee4-afa9-cd33ce2bee70 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:18.500901 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-22d459b2-c8b8-437c-9e21-caba91ea3fe5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:18.527338 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-221d96c3-ae42-4ee4-afa9-cd33ce2bee70 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:36:18.530249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-22d459b2-c8b8-437c-9e21-caba91ea3fe5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Going to try to terminate instance {{(pid=120733) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:36:18.613475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-22d459b2-c8b8-437c-9e21-caba91ea3fe5 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 204 len: 0 microversion: 2.20 time: 0.166548 Sep 05 17:36:18.617676 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1281/2706] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Sep 5 17:36:18 2022] DELETE /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 05 17:36:18.621342 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-221d96c3-ae42-4ee4-afa9-cd33ce2bee70 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 204 len: 0 microversion: 2.1 time: 0.179157 Sep 05 17:36:18.621963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1426/2707] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:36:18 2022] DELETE /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:36:18.626540 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-bec0d8c2-ac8b-4747-a01a-8173d0ea87e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:18.627278 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-bec0d8c2-ac8b-4747-a01a-8173d0ea87e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:18.631517 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b431dae7-118e-4bcf-a4e4-ed010d9a1aac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:18.632236 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b431dae7-118e-4bcf-a4e4-ed010d9a1aac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:18.633884 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bec0d8c2-ac8b-4747-a01a-8173d0ea87e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:18.634512 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bec0d8c2-ac8b-4747-a01a-8173d0ea87e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:18.634953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bec0d8c2-ac8b-4747-a01a-8173d0ea87e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:18.635817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bec0d8c2-ac8b-4747-a01a-8173d0ea87e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:18.636303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bec0d8c2-ac8b-4747-a01a-8173d0ea87e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:18.636728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-bec0d8c2-ac8b-4747-a01a-8173d0ea87e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:18.638196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b431dae7-118e-4bcf-a4e4-ed010d9a1aac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:18.638692 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b431dae7-118e-4bcf-a4e4-ed010d9a1aac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:18.639101 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b431dae7-118e-4bcf-a4e4-ed010d9a1aac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:18.639779 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b431dae7-118e-4bcf-a4e4-ed010d9a1aac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:18.640245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b431dae7-118e-4bcf-a4e4-ed010d9a1aac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:18.640663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b431dae7-118e-4bcf-a4e4-ed010d9a1aac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:18.833158 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bec0d8c2-ac8b-4747-a01a-8173d0ea87e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:18.838200 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b431dae7-118e-4bcf-a4e4-ed010d9a1aac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:18.843363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bec0d8c2-ac8b-4747-a01a-8173d0ea87e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:18.844876 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-bec0d8c2-ac8b-4747-a01a-8173d0ea87e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:18.846026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-bec0d8c2-ac8b-4747-a01a-8173d0ea87e6 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 200 len: 1722 microversion: 2.20 time: 0.227039 Sep 05 17:36:18.846474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b431dae7-118e-4bcf-a4e4-ed010d9a1aac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 200 len: 1672 microversion: 2.1 time: 0.219614 Sep 05 17:36:18.846650 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1282/2708] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:36:18 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 17:36:18.847044 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1427/2709] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:36:18 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 1672 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:36:19.870530 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a5cc77ec-0d7f-4f63-b0e5-f44a9521ae29 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:19.871963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5afce4da-19a0-42cf-842d-9dbe9cd77ed8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:19.872765 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a5cc77ec-0d7f-4f63-b0e5-f44a9521ae29 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:19.874308 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5afce4da-19a0-42cf-842d-9dbe9cd77ed8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:19.884097 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5cc77ec-0d7f-4f63-b0e5-f44a9521ae29 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:19.884359 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5afce4da-19a0-42cf-842d-9dbe9cd77ed8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:19.884929 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5cc77ec-0d7f-4f63-b0e5-f44a9521ae29 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:19.885094 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5afce4da-19a0-42cf-842d-9dbe9cd77ed8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:19.885483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5afce4da-19a0-42cf-842d-9dbe9cd77ed8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:19.885622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5cc77ec-0d7f-4f63-b0e5-f44a9521ae29 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:19.886508 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5afce4da-19a0-42cf-842d-9dbe9cd77ed8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:19.887032 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5cc77ec-0d7f-4f63-b0e5-f44a9521ae29 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:19.887692 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5cc77ec-0d7f-4f63-b0e5-f44a9521ae29 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:19.887850 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5afce4da-19a0-42cf-842d-9dbe9cd77ed8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:19.888205 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5afce4da-19a0-42cf-842d-9dbe9cd77ed8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:19.889251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5cc77ec-0d7f-4f63-b0e5-f44a9521ae29 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:19.919442 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] [60ecb80f-af85-4d00-8c41-b5df5901a58b] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38644. Sep 05 17:36:19.928120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed17db71-0dc9-4537-b54e-cdfd10e049bc] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38646. Sep 05 17:36:20.502099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a5cc77ec-0d7f-4f63-b0e5-f44a9521ae29 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:20.511624 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a5cc77ec-0d7f-4f63-b0e5-f44a9521ae29 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 200 len: 1672 microversion: 2.1 time: 0.645464 Sep 05 17:36:20.512134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1283/2710] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:36:19 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 1672 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:36:20.548265 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5afce4da-19a0-42cf-842d-9dbe9cd77ed8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:20.559902 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5afce4da-19a0-42cf-842d-9dbe9cd77ed8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:20.561404 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5afce4da-19a0-42cf-842d-9dbe9cd77ed8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c53ac49fbc054c01a5a1ef41e04bf253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e933bc308b31482a9db533a7e89aeb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:20.563097 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5afce4da-19a0-42cf-842d-9dbe9cd77ed8 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 200 len: 1722 microversion: 2.20 time: 0.695791 Sep 05 17:36:20.564475 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1428/2711] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:36:19 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 1722 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 17:36:20.605216 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-03e1319c-7869-4eb7-80d9-1fa3af3965a7 req-04f0765a-9974-4c61-958e-478235d3e28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a9521e-4081-4432-b0c7-c8e5fca8eb38", "name": "network-vif-deleted", "tag": "7d125039-8903-48e4-801f-49457fc5f7e4"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:36:20.616308 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-03e1319c-7869-4eb7-80d9-1fa3af3965a7 req-04f0765a-9974-4c61-958e-478235d3e28a service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:20.617833 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-03e1319c-7869-4eb7-80d9-1fa3af3965a7 req-04f0765a-9974-4c61-958e-478235d3e28a service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:20.617833 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-03e1319c-7869-4eb7-80d9-1fa3af3965a7 req-04f0765a-9974-4c61-958e-478235d3e28a service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:20.634903 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-03e1319c-7869-4eb7-80d9-1fa3af3965a7 req-04f0765a-9974-4c61-958e-478235d3e28a service nova] Creating event network-vif-deleted:7d125039-8903-48e4-801f-49457fc5f7e4 for instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 on hv-cinder-85596 Sep 05 17:36:20.641538 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-03e1319c-7869-4eb7-80d9-1fa3af3965a7 req-04f0765a-9974-4c61-958e-478235d3e28a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040099 Sep 05 17:36:20.642631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1284/2712] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:36:21.310772 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-8fd694a6-d8fa-45bd-93f0-42d845a8803f req-f654a58c-9334-4418-94a9-121e7f4ff6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6615b39c-c510-4c9b-8e33-08a489f85ec5", "name": "network-vif-deleted", "tag": "b928ce66-73e6-47fc-9a24-ccb86e20e2a4"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:36:21.323269 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-8fd694a6-d8fa-45bd-93f0-42d845a8803f req-f654a58c-9334-4418-94a9-121e7f4ff6c1 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:21.324258 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-8fd694a6-d8fa-45bd-93f0-42d845a8803f req-f654a58c-9334-4418-94a9-121e7f4ff6c1 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:21.324914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-8fd694a6-d8fa-45bd-93f0-42d845a8803f req-f654a58c-9334-4418-94a9-121e7f4ff6c1 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:21.339337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-8fd694a6-d8fa-45bd-93f0-42d845a8803f req-f654a58c-9334-4418-94a9-121e7f4ff6c1 service nova] Creating event network-vif-deleted:b928ce66-73e6-47fc-9a24-ccb86e20e2a4 for instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 on hv-cinder-85596 Sep 05 17:36:21.347552 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-8fd694a6-d8fa-45bd-93f0-42d845a8803f req-f654a58c-9334-4418-94a9-121e7f4ff6c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213667 Sep 05 17:36:21.348817 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1429/2713] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:36:21.535574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-409912ce-a228-46fc-9d7a-b37a23317ad6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:21.536509 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-409912ce-a228-46fc-9d7a-b37a23317ad6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:21.542721 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-409912ce-a228-46fc-9d7a-b37a23317ad6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:21.543517 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-409912ce-a228-46fc-9d7a-b37a23317ad6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:21.543943 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-409912ce-a228-46fc-9d7a-b37a23317ad6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:21.544663 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-409912ce-a228-46fc-9d7a-b37a23317ad6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:21.545227 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-409912ce-a228-46fc-9d7a-b37a23317ad6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:21.545722 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-409912ce-a228-46fc-9d7a-b37a23317ad6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:21.588200 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-409912ce-a228-46fc-9d7a-b37a23317ad6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:21.588702 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-409912ce-a228-46fc-9d7a-b37a23317ad6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:21.589145 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-409912ce-a228-46fc-9d7a-b37a23317ad6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:21.589593 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.objects.instance [None req-409912ce-a228-46fc-9d7a-b37a23317ad6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lazy-loading 'fault' on Instance uuid 6615b39c-c510-4c9b-8e33-08a489f85ec5 {{(pid=120733) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:36:21.593040 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f53c1bff-7e00-40ad-ba85-7c842f611291 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:21.593821 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f53c1bff-7e00-40ad-ba85-7c842f611291 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:21.609495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f53c1bff-7e00-40ad-ba85-7c842f611291 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:21.610088 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f53c1bff-7e00-40ad-ba85-7c842f611291 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:21.610660 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f53c1bff-7e00-40ad-ba85-7c842f611291 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:21.611896 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f53c1bff-7e00-40ad-ba85-7c842f611291 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:21.612530 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f53c1bff-7e00-40ad-ba85-7c842f611291 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:21.612963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f53c1bff-7e00-40ad-ba85-7c842f611291 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:21.628328 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-f53c1bff-7e00-40ad-ba85-7c842f611291 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] HTTP exception thrown: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f53c1bff-7e00-40ad-ba85-7c842f611291 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Request method failure captured: Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 HTTP/1.1 Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFitwWfs1eoGn1PxRIG11Wt03bDV9g56JxpIR6zL3zS6ommzT23LFKAHz3X30q1L_3eC5KN6CLXlYj9IPTX79SEd_OXUCZ9JsKzD3bEGHsihDAoCgSV2MfOvhIO0YY1xkYznidYRO3b1jn9_1rPHR8-MeDaZemOPww1T5YQlO8xLZFe8 Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: e933bc308b31482a9db533a7e89aeb4b Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720023600 Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:36:21.631091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:36:21.633210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e933bc308b31482a9db533a7e89aeb4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e933bc308b31482a9db533a7e89aeb4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e933bc308b31482a9db533a7e89aeb4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e933bc308b31482a9db533a7e89aeb4b"}]}] Sep 05 17:36:21.633210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720023600 Sep 05 17:36:21.633210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: e933bc308b31482a9db533a7e89aeb4b Sep 05 17:36:21.633210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720023600 Sep 05 17:36:21.633210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeShelveTestJSON-1720023600-project Sep 05 17:36:21.633210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:36:21.633210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:36:21.633210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: c53ac49fbc054c01a5a1ef41e04bf253 Sep 05 17:36:21.633210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720023600-project Sep 05 17:36:21.633210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:36:21.633210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. Sep 05 17:36:21.633210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': 'd4a9521e-4081-4432-b0c7-c8e5fca8eb38'} Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:36:21.634641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. Sep 05 17:36:21.636499 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:36:21.638147 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-409912ce-a228-46fc-9d7a-b37a23317ad6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:21.640932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f53c1bff-7e00-40ad-ba85-7c842f611291 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Returning 404 to user: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:36:21.640932 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f53c1bff-7e00-40ad-ba85-7c842f611291 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 404 len: 111 microversion: 2.20 time: 0.051985 Sep 05 17:36:21.641535 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1430/2714] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:36:21 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 05 17:36:21.644715 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-409912ce-a228-46fc-9d7a-b37a23317ad6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 200 len: 1327 microversion: 2.1 time: 0.113755 Sep 05 17:36:21.645701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1285/2715] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:36:21 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:36:21.649925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5a7ff3de-d351-4d38-acf9-a96e056f3a26 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '.version_select at 0x7f1d3ac4b310>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:21.675808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5a7ff3de-d351-4d38-acf9-a96e056f3a26 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-763857151" status: 204 len: 0 microversion: 2.20 time: 0.030801 Sep 05 17:36:21.676697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1431/2716] 10.222.0.23 () {60 vars in 1259 bytes} [Mon Sep 5 17:36:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-763857151 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 05 17:36:22.675249 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6b3ca471-d375-4342-b845-051cd5ca3152 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:22.676479 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6b3ca471-d375-4342-b845-051cd5ca3152 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:22.687929 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b3ca471-d375-4342-b845-051cd5ca3152 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:22.688773 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b3ca471-d375-4342-b845-051cd5ca3152 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:22.689475 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b3ca471-d375-4342-b845-051cd5ca3152 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:22.690595 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b3ca471-d375-4342-b845-051cd5ca3152 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:22.691335 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b3ca471-d375-4342-b845-051cd5ca3152 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:22.692026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b3ca471-d375-4342-b845-051cd5ca3152 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:22.705925 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-6b3ca471-d375-4342-b845-051cd5ca3152 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] HTTP exception thrown: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6b3ca471-d375-4342-b845-051cd5ca3152 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Request method failure captured: Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 HTTP/1.1 Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFjG_0N19IaKUIriip5QYY2WI9Q_i_iEsLOceUWM3ilt4afBVEnGHXQ72BldGLrcb0eOBBLwl2nXf7k4nQlSIzTNhgCjJb1KdNHVPm3I-2JtCq60qBcDi2xptR-XnyOnRp0Fa5v58R4Z_Kgs63Cis5F6yKqvBvvmqXi84IoffWPQnhII Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: f8dd08c068a5435c8c426d4a9a24b30d Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:36:22.707550 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:36:22.709430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8dd08c068a5435c8c426d4a9a24b30d"}]}] Sep 05 17:36:22.709430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:36:22.709430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: f8dd08c068a5435c8c426d4a9a24b30d Sep 05 17:36:22.709430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:36:22.709430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-AttachVolumeTestJSON-1448336597-project Sep 05 17:36:22.709430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:36:22.709430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:36:22.709430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: bb7767df40d849b8bb870ad090fead83 Sep 05 17:36:22.709430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-AttachVolumeTestJSON-1448336597-project Sep 05 17:36:22.709430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:36:22.709430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. Sep 05 17:36:22.709430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': '6615b39c-c510-4c9b-8e33-08a489f85ec5'} Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:36:22.710567 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. Sep 05 17:36:22.712260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:36:22.714214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6b3ca471-d375-4342-b845-051cd5ca3152 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Returning 404 to user: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:36:22.714214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6b3ca471-d375-4342-b845-051cd5ca3152 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 404 len: 111 microversion: 2.1 time: 0.040436 Sep 05 17:36:22.714214 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1286/2717] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:36:22 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:36:22.719001 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1f755d74-02c7-42c8-ad37-87698310b35c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '.version_select at 0x7f1d3abf2e50>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:22.741706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1f755d74-02c7-42c8-ad37-87698310b35c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-654426380" status: 202 len: 0 microversion: 2.1 time: 0.027110 Sep 05 17:36:22.742254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1432/2718] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Sep 5 17:36:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-654426380 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:36:23.378238 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-003bfbc1-46b0-4788-8436-e3795fba0894 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Action: 'create', calling method: .version_select at 0x7f1d3aa52c10>, body: {"keypair": {"name": "tempest-keypair-383671274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+wHChlM+CuNHKh/KZHpbHXRJnrgwD67aRxBIH89GROjCfbd9Vp1wudkBVR/cim+/UY+CBJRvysXQePUjdGZzzl3JdWSZ5FGdJvEDmFE9/4R6Hwi2FXmWQwfo6YQi8RTQ=="}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:36:23.397029 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-003bfbc1-46b0-4788-8436-e3795fba0894 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Getting quotas for project f8dd08c068a5435c8c426d4a9a24b30d. Resources: {'key_pairs'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:36:23.401507 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-003bfbc1-46b0-4788-8436-e3795fba0894 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Getting quotas for user bb7767df40d849b8bb870ad090fead83 and project f8dd08c068a5435c8c426d4a9a24b30d. Resources: {'key_pairs'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:36:23.431309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-003bfbc1-46b0-4788-8436-e3795fba0894 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057066 Sep 05 17:36:23.431911 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1287/2719] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Sep 5 17:36:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:36:24.877701 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-785663604", "imageRef": "c1a4f3d3-4d68-489a-a57b-bae7854beb29", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "780e697b-2582-4702-b4df-328cf21a430d"}], "security_groups": [{"name": "tempest-securitygroup--1348812208"}], "key_name": "tempest-keypair-383671274", "user_data": "}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:36:25.001004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] validate_networks() for [('780e697b-2582-4702-b4df-328cf21a430d', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:36:25.498232 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:36:25.498662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:36:25.499160 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:36:25.499595 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:36:25.500010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:36:25.509451 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:25.509859 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:25.510298 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:25.511017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:25.511470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:25.511888 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:25.528670 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Getting quotas for project f8dd08c068a5435c8c426d4a9a24b30d. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:36:25.533061 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Getting quotas for user bb7767df40d849b8bb870ad090fead83 and project f8dd08c068a5435c8c426d4a9a24b30d. Resources: {'ram', 'cores', 'instances'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:36:25.544696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:36:25.547017 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a4f3d3-4d68-489a-a57b-bae7854beb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:36:25.604739 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bb3f61fc-d161-45bf-9bfc-b76ab3ec8260 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.731752 Sep 05 17:36:25.605467 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1433/2720] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:36:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 17:36:25.617072 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-63f76cde-54e5-4c88-8118-feb6b0d1b5df tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:25.617670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-63f76cde-54e5-4c88-8118-feb6b0d1b5df tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:25.676409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-63f76cde-54e5-4c88-8118-feb6b0d1b5df tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:25.683954 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-63f76cde-54e5-4c88-8118-feb6b0d1b5df tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 200 len: 1236 microversion: 2.1 time: 0.070845 Sep 05 17:36:25.684582 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1288/2721] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:36:25 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:36:26.708592 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c6111402-a154-400c-905c-4883061641ab tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:26.709313 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c6111402-a154-400c-905c-4883061641ab tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:26.716950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6111402-a154-400c-905c-4883061641ab tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:26.717436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6111402-a154-400c-905c-4883061641ab tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:26.717892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6111402-a154-400c-905c-4883061641ab tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:26.718697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6111402-a154-400c-905c-4883061641ab tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:26.719149 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6111402-a154-400c-905c-4883061641ab tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:26.719562 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6111402-a154-400c-905c-4883061641ab tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:26.781642 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c6111402-a154-400c-905c-4883061641ab tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:26.789794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c6111402-a154-400c-905c-4883061641ab tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 200 len: 1288 microversion: 2.1 time: 0.086491 Sep 05 17:36:26.790600 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1434/2722] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:36:26 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:36:27.813271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6b955415-5c01-426a-99df-b0b28c2df3b8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:27.813992 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6b955415-5c01-426a-99df-b0b28c2df3b8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:27.820755 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b955415-5c01-426a-99df-b0b28c2df3b8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:27.821240 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b955415-5c01-426a-99df-b0b28c2df3b8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:27.821673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b955415-5c01-426a-99df-b0b28c2df3b8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:27.822362 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b955415-5c01-426a-99df-b0b28c2df3b8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:27.822780 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b955415-5c01-426a-99df-b0b28c2df3b8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:27.823443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6b955415-5c01-426a-99df-b0b28c2df3b8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:28.043680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6b955415-5c01-426a-99df-b0b28c2df3b8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:28.051860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6b955415-5c01-426a-99df-b0b28c2df3b8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 200 len: 1362 microversion: 2.1 time: 0.242535 Sep 05 17:36:28.052560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1289/2723] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:36:27 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:36:28.405034 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-ba48c072-3d02-4f99-8f38-f97fbac8d2ae req-114f240f-8e4a-4222-9fc9-9191e4ae65f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d44dddc-7dd2-48fa-9410-adc8e7112416", "tag": "9a7d1594-8b9a-4bb0-ba9e-0179f1921c1c"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:36:28.416338 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ba48c072-3d02-4f99-8f38-f97fbac8d2ae req-114f240f-8e4a-4222-9fc9-9191e4ae65f9 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:28.416925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ba48c072-3d02-4f99-8f38-f97fbac8d2ae req-114f240f-8e4a-4222-9fc9-9191e4ae65f9 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:28.417353 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ba48c072-3d02-4f99-8f38-f97fbac8d2ae req-114f240f-8e4a-4222-9fc9-9191e4ae65f9 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:28.429375 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-ba48c072-3d02-4f99-8f38-f97fbac8d2ae req-114f240f-8e4a-4222-9fc9-9191e4ae65f9 service nova] Creating event network-changed:9a7d1594-8b9a-4bb0-ba9e-0179f1921c1c for instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 on hv-cinder-85596 Sep 05 17:36:28.434596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-ba48c072-3d02-4f99-8f38-f97fbac8d2ae req-114f240f-8e4a-4222-9fc9-9191e4ae65f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033370 Sep 05 17:36:28.435171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1435/2724] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:36:29.075506 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6ccd6df2-6b12-49d7-b771-f465cca4944c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:29.076134 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6ccd6df2-6b12-49d7-b771-f465cca4944c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:29.083160 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ccd6df2-6b12-49d7-b771-f465cca4944c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:29.083683 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ccd6df2-6b12-49d7-b771-f465cca4944c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:29.084113 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ccd6df2-6b12-49d7-b771-f465cca4944c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:29.084834 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ccd6df2-6b12-49d7-b771-f465cca4944c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:29.085280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ccd6df2-6b12-49d7-b771-f465cca4944c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:29.085696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6ccd6df2-6b12-49d7-b771-f465cca4944c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:29.223178 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-6ccd6df2-6b12-49d7-b771-f465cca4944c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:29.231288 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6ccd6df2-6b12-49d7-b771-f465cca4944c tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 200 len: 1362 microversion: 2.1 time: 0.159837 Sep 05 17:36:29.231860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1290/2725] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:36:29 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:36:30.268289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-097c404c-01cb-4e02-9887-c36f78636ebc tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:30.269445 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-097c404c-01cb-4e02-9887-c36f78636ebc tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:30.276702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-097c404c-01cb-4e02-9887-c36f78636ebc tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:30.277201 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-097c404c-01cb-4e02-9887-c36f78636ebc tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:30.277632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-097c404c-01cb-4e02-9887-c36f78636ebc tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:30.278316 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-097c404c-01cb-4e02-9887-c36f78636ebc tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:30.278786 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-097c404c-01cb-4e02-9887-c36f78636ebc tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:30.279215 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-097c404c-01cb-4e02-9887-c36f78636ebc tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:30.431253 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-097c404c-01cb-4e02-9887-c36f78636ebc tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:30.443982 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-097c404c-01cb-4e02-9887-c36f78636ebc tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 200 len: 1362 microversion: 2.1 time: 0.182496 Sep 05 17:36:30.444789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1436/2726] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:36:30 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:36:31.471380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a4d5f542-fa87-4c51-9d7f-1e686ea8403b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:31.471989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a4d5f542-fa87-4c51-9d7f-1e686ea8403b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:31.479373 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4d5f542-fa87-4c51-9d7f-1e686ea8403b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:31.479867 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4d5f542-fa87-4c51-9d7f-1e686ea8403b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:31.480343 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4d5f542-fa87-4c51-9d7f-1e686ea8403b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:31.481055 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4d5f542-fa87-4c51-9d7f-1e686ea8403b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:31.481519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4d5f542-fa87-4c51-9d7f-1e686ea8403b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:31.481941 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a4d5f542-fa87-4c51-9d7f-1e686ea8403b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:31.681678 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a4d5f542-fa87-4c51-9d7f-1e686ea8403b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:31.689913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a4d5f542-fa87-4c51-9d7f-1e686ea8403b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 200 len: 1362 microversion: 2.1 time: 0.222637 Sep 05 17:36:31.690473 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1291/2727] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:36:31 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:36:32.718780 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bc1de1a4-6831-4d4f-b797-bc60a15eabd8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:32.720245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bc1de1a4-6831-4d4f-b797-bc60a15eabd8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:32.732358 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc1de1a4-6831-4d4f-b797-bc60a15eabd8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:32.733191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc1de1a4-6831-4d4f-b797-bc60a15eabd8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:32.733906 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc1de1a4-6831-4d4f-b797-bc60a15eabd8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:32.735163 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc1de1a4-6831-4d4f-b797-bc60a15eabd8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:32.735911 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc1de1a4-6831-4d4f-b797-bc60a15eabd8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:32.736633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc1de1a4-6831-4d4f-b797-bc60a15eabd8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:32.878723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bc1de1a4-6831-4d4f-b797-bc60a15eabd8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:32.887709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bc1de1a4-6831-4d4f-b797-bc60a15eabd8 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 200 len: 1362 microversion: 2.1 time: 0.177133 Sep 05 17:36:32.888315 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1437/2728] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:36:32 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:36:33.914250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-71a89d0c-7d1b-4a72-b91e-65419493ded9 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:33.914880 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-71a89d0c-7d1b-4a72-b91e-65419493ded9 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:33.922696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71a89d0c-7d1b-4a72-b91e-65419493ded9 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:33.923258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71a89d0c-7d1b-4a72-b91e-65419493ded9 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:33.923756 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71a89d0c-7d1b-4a72-b91e-65419493ded9 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:33.924587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71a89d0c-7d1b-4a72-b91e-65419493ded9 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:33.925121 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71a89d0c-7d1b-4a72-b91e-65419493ded9 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:33.925610 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-71a89d0c-7d1b-4a72-b91e-65419493ded9 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:34.065418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-71a89d0c-7d1b-4a72-b91e-65419493ded9 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:34.077859 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-71a89d0c-7d1b-4a72-b91e-65419493ded9 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 200 len: 1362 microversion: 2.1 time: 0.169476 Sep 05 17:36:34.078568 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1292/2729] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:36:33 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:36:34.440691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-70c4f941-2ec3-47d5-8385-8db05fe846ec req-453779d1-82fc-41df-9015-46345c69933e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d44dddc-7dd2-48fa-9410-adc8e7112416", "name": "network-vif-plugged", "status": "completed", "tag": "9a7d1594-8b9a-4bb0-ba9e-0179f1921c1c"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:36:34.450980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-70c4f941-2ec3-47d5-8385-8db05fe846ec req-453779d1-82fc-41df-9015-46345c69933e service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:34.451450 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-70c4f941-2ec3-47d5-8385-8db05fe846ec req-453779d1-82fc-41df-9015-46345c69933e service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:34.451877 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-70c4f941-2ec3-47d5-8385-8db05fe846ec req-453779d1-82fc-41df-9015-46345c69933e service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:34.464224 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-70c4f941-2ec3-47d5-8385-8db05fe846ec req-453779d1-82fc-41df-9015-46345c69933e service nova] Creating event network-vif-plugged:9a7d1594-8b9a-4bb0-ba9e-0179f1921c1c for instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 on hv-cinder-85596 Sep 05 17:36:34.469785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-70c4f941-2ec3-47d5-8385-8db05fe846ec req-453779d1-82fc-41df-9015-46345c69933e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095884 Sep 05 17:36:34.470365 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1438/2730] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:36:35.106774 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-d5492fa8-84ca-48ff-938a-d8dfa75602a4 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:35.107730 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-d5492fa8-84ca-48ff-938a-d8dfa75602a4 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:35.117396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5492fa8-84ca-48ff-938a-d8dfa75602a4 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:35.117876 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5492fa8-84ca-48ff-938a-d8dfa75602a4 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:35.118304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5492fa8-84ca-48ff-938a-d8dfa75602a4 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:35.118983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5492fa8-84ca-48ff-938a-d8dfa75602a4 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:35.119426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5492fa8-84ca-48ff-938a-d8dfa75602a4 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:35.119838 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-d5492fa8-84ca-48ff-938a-d8dfa75602a4 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:35.256549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-d5492fa8-84ca-48ff-938a-d8dfa75602a4 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:35.264791 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-d5492fa8-84ca-48ff-938a-d8dfa75602a4 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 200 len: 1362 microversion: 2.1 time: 0.163900 Sep 05 17:36:35.265361 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1293/2731] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:36:35 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:36:36.287827 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:36:36.289232 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=6 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:36:36.296105 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7890fc41-a93e-4720-9e46-0421cc9701bb tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:36.297304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7890fc41-a93e-4720-9e46-0421cc9701bb tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:36.306707 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7890fc41-a93e-4720-9e46-0421cc9701bb tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:36.307186 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7890fc41-a93e-4720-9e46-0421cc9701bb tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:36.307627 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7890fc41-a93e-4720-9e46-0421cc9701bb tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:36.308350 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7890fc41-a93e-4720-9e46-0421cc9701bb tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:36.308802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7890fc41-a93e-4720-9e46-0421cc9701bb tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:36.309227 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7890fc41-a93e-4720-9e46-0421cc9701bb tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:36.460672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7890fc41-a93e-4720-9e46-0421cc9701bb tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:36.470365 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7890fc41-a93e-4720-9e46-0421cc9701bb tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 200 len: 1362 microversion: 2.1 time: 0.185541 Sep 05 17:36:36.470930 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1439/2732] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:36:36 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:36:37.497605 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5e9e9e11-ca5f-4b58-b162-e89ea658f191 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:37.498533 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5e9e9e11-ca5f-4b58-b162-e89ea658f191 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:37.501689 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=6 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:36:37.510095 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5e9e9e11-ca5f-4b58-b162-e89ea658f191 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:37.510555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5e9e9e11-ca5f-4b58-b162-e89ea658f191 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:37.510979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5e9e9e11-ca5f-4b58-b162-e89ea658f191 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:37.511651 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5e9e9e11-ca5f-4b58-b162-e89ea658f191 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:37.512094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5e9e9e11-ca5f-4b58-b162-e89ea658f191 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:37.512529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5e9e9e11-ca5f-4b58-b162-e89ea658f191 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:37.652007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5e9e9e11-ca5f-4b58-b162-e89ea658f191 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:36:37.660412 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5e9e9e11-ca5f-4b58-b162-e89ea658f191 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 200 len: 1548 microversion: 2.1 time: 0.170171 Sep 05 17:36:37.660977 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1294/2733] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:36:37 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:36:37.682697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-217be8d8-348b-446d-a5b4-d154984684f3 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:36:37.683254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-217be8d8-348b-446d-a5b4-d154984684f3 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:36:37.690153 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-217be8d8-348b-446d-a5b4-d154984684f3 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:37.690638 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-217be8d8-348b-446d-a5b4-d154984684f3 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:37.691091 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-217be8d8-348b-446d-a5b4-d154984684f3 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:37.691775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-217be8d8-348b-446d-a5b4-d154984684f3 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:37.692259 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-217be8d8-348b-446d-a5b4-d154984684f3 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:37.692705 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-217be8d8-348b-446d-a5b4-d154984684f3 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:37.773440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-217be8d8-348b-446d-a5b4-d154984684f3 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094858 Sep 05 17:36:37.774046 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1440/2734] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Sep 5 17:36:37 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:36:38.739139 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-9889f88a-6cdc-4f6b-a7a3-9f6f1438e943 req-3b6d6efd-fe06-4e87-a25e-dc2e028edcd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d44dddc-7dd2-48fa-9410-adc8e7112416", "tag": "9a7d1594-8b9a-4bb0-ba9e-0179f1921c1c"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:36:38.749182 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-9889f88a-6cdc-4f6b-a7a3-9f6f1438e943 req-3b6d6efd-fe06-4e87-a25e-dc2e028edcd1 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:36:38.749633 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-9889f88a-6cdc-4f6b-a7a3-9f6f1438e943 req-3b6d6efd-fe06-4e87-a25e-dc2e028edcd1 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:36:38.750050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-9889f88a-6cdc-4f6b-a7a3-9f6f1438e943 req-3b6d6efd-fe06-4e87-a25e-dc2e028edcd1 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:36:38.761018 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-9889f88a-6cdc-4f6b-a7a3-9f6f1438e943 req-3b6d6efd-fe06-4e87-a25e-dc2e028edcd1 service nova] Creating event network-changed:9a7d1594-8b9a-4bb0-ba9e-0179f1921c1c for instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 on hv-cinder-85596 Sep 05 17:36:38.766303 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-9889f88a-6cdc-4f6b-a7a3-9f6f1438e943 req-3b6d6efd-fe06-4e87-a25e-dc2e028edcd1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030832 Sep 05 17:36:38.766951 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1295/2735] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:37:53.724080 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:37:53.724875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:37:53.729588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1cd148a8-1918-4251-8e45-342923796928 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:37:53.730136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1cd148a8-1918-4251-8e45-342923796928 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:37:53.739018 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cd148a8-1918-4251-8e45-342923796928 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:37:53.739558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cd148a8-1918-4251-8e45-342923796928 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:37:53.739986 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cd148a8-1918-4251-8e45-342923796928 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:37:53.740691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cd148a8-1918-4251-8e45-342923796928 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:37:53.741172 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cd148a8-1918-4251-8e45-342923796928 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:37:53.741591 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cd148a8-1918-4251-8e45-342923796928 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:37:53.768032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1cd148a8-1918-4251-8e45-342923796928 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/ips" status: 200 len: 145 microversion: 2.1 time: 0.045876 Sep 05 17:37:53.768626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1441/2736] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Sep 5 17:37:53 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:38:15.282963 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:38:15.283728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:38:15.289046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cf145595-72a6-4f2a-8d79-9d0a59c3f737 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:15.289626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-cf145595-72a6-4f2a-8d79-9d0a59c3f737 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:15.302800 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf145595-72a6-4f2a-8d79-9d0a59c3f737 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:15.303365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf145595-72a6-4f2a-8d79-9d0a59c3f737 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:15.303853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf145595-72a6-4f2a-8d79-9d0a59c3f737 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:15.304690 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf145595-72a6-4f2a-8d79-9d0a59c3f737 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:15.305135 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf145595-72a6-4f2a-8d79-9d0a59c3f737 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:15.305548 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-cf145595-72a6-4f2a-8d79-9d0a59c3f737 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:15.320638 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-cf145595-72a6-4f2a-8d79-9d0a59c3f737 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] HTTP exception thrown: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cf145595-72a6-4f2a-8d79-9d0a59c3f737 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Request method failure captured: Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: DELETE /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 HTTP/1.1 Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFitwWfs1eoGn1PxRIG11Wt03bDV9g56JxpIR6zL3zS6ommzT23LFKAHz3X30q1L_3eC5KN6CLXlYj9IPTX79SEd_OXUCZ9JsKzD3bEGHsihDAoCgSV2MfOvhIO0YY1xkYznidYRO3b1jn9_1rPHR8-MeDaZemOPww1T5YQlO8xLZFe8 Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: e933bc308b31482a9db533a7e89aeb4b Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720023600 Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:38:15.322309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:38:15.324304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e933bc308b31482a9db533a7e89aeb4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e933bc308b31482a9db533a7e89aeb4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e933bc308b31482a9db533a7e89aeb4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e933bc308b31482a9db533a7e89aeb4b"}]}] Sep 05 17:38:15.324304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720023600 Sep 05 17:38:15.324304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: e933bc308b31482a9db533a7e89aeb4b Sep 05 17:38:15.324304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720023600 Sep 05 17:38:15.324304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-AttachVolumeShelveTestJSON-1720023600-project Sep 05 17:38:15.324304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:38:15.324304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:38:15.324304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: c53ac49fbc054c01a5a1ef41e04bf253 Sep 05 17:38:15.324304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720023600-project Sep 05 17:38:15.324304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:38:15.324304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. Sep 05 17:38:15.324304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': 'd4a9521e-4081-4432-b0c7-c8e5fca8eb38'} Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:38:15.325809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. Sep 05 17:38:15.327430 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:15.329136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-cf145595-72a6-4f2a-8d79-9d0a59c3f737 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Returning 404 to user: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:38:15.329136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-cf145595-72a6-4f2a-8d79-9d0a59c3f737 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 404 len: 111 microversion: 2.20 time: 0.043192 Sep 05 17:38:15.329136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1296/2737] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Sep 5 17:38:15 2022] DELETE /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 17:38:15.333181 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5166a1d8-695d-406b-9c39-556f289a08ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:15.333787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5166a1d8-695d-406b-9c39-556f289a08ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: d4a9521e-4081-4432-b0c7-c8e5fca8eb38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:15.337039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=4 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:38:15.338295 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:38:15.345451 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5166a1d8-695d-406b-9c39-556f289a08ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:15.345860 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5166a1d8-695d-406b-9c39-556f289a08ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:15.346295 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5166a1d8-695d-406b-9c39-556f289a08ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:15.346963 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5166a1d8-695d-406b-9c39-556f289a08ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:15.347406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5166a1d8-695d-406b-9c39-556f289a08ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:15.347819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5166a1d8-695d-406b-9c39-556f289a08ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:15.361958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-5166a1d8-695d-406b-9c39-556f289a08ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] HTTP exception thrown: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5166a1d8-695d-406b-9c39-556f289a08ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Request method failure captured: Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 HTTP/1.1 Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFitwWfs1eoGn1PxRIG11Wt03bDV9g56JxpIR6zL3zS6ommzT23LFKAHz3X30q1L_3eC5KN6CLXlYj9IPTX79SEd_OXUCZ9JsKzD3bEGHsihDAoCgSV2MfOvhIO0YY1xkYznidYRO3b1jn9_1rPHR8-MeDaZemOPww1T5YQlO8xLZFe8 Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: e933bc308b31482a9db533a7e89aeb4b Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720023600 Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:38:15.363623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:38:15.365437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e933bc308b31482a9db533a7e89aeb4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e933bc308b31482a9db533a7e89aeb4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e933bc308b31482a9db533a7e89aeb4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e933bc308b31482a9db533a7e89aeb4b"}]}] Sep 05 17:38:15.365437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720023600 Sep 05 17:38:15.365437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: e933bc308b31482a9db533a7e89aeb4b Sep 05 17:38:15.365437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720023600 Sep 05 17:38:15.365437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeShelveTestJSON-1720023600-project Sep 05 17:38:15.365437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:38:15.365437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:38:15.365437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: c53ac49fbc054c01a5a1ef41e04bf253 Sep 05 17:38:15.365437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720023600-project Sep 05 17:38:15.365437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:38:15.365437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. Sep 05 17:38:15.365437 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': 'd4a9521e-4081-4432-b0c7-c8e5fca8eb38'} Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:38:15.366341 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. Sep 05 17:38:15.367776 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:15.369135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5166a1d8-695d-406b-9c39-556f289a08ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Returning 404 to user: Instance d4a9521e-4081-4432-b0c7-c8e5fca8eb38 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:38:15.369135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5166a1d8-695d-406b-9c39-556f289a08ad tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38" status: 404 len: 111 microversion: 2.20 time: 0.036139 Sep 05 17:38:15.369135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1442/2738] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:38:15 2022] GET /compute/v2.1/servers/d4a9521e-4081-4432-b0c7-c8e5fca8eb38 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 17:38:19.216543 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-79f3a9ef-b553-4668-817f-ffd684b4a664 req-b675a0f8-f470-46ee-96d9-d4f1d28e0968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba4a1fa-a126-4e6b-9ac4-32290e275435", "name": "network-vif-deleted", "tag": "cb173271-65d0-4643-8208-fb9a3bbbf346"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:38:19.228078 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-79f3a9ef-b553-4668-817f-ffd684b4a664 req-b675a0f8-f470-46ee-96d9-d4f1d28e0968 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:19.228587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-79f3a9ef-b553-4668-817f-ffd684b4a664 req-b675a0f8-f470-46ee-96d9-d4f1d28e0968 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:19.229001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-79f3a9ef-b553-4668-817f-ffd684b4a664 req-b675a0f8-f470-46ee-96d9-d4f1d28e0968 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:19.241792 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-79f3a9ef-b553-4668-817f-ffd684b4a664 req-b675a0f8-f470-46ee-96d9-d4f1d28e0968 service nova] Creating event network-vif-deleted:cb173271-65d0-4643-8208-fb9a3bbbf346 for instance cba4a1fa-a126-4e6b-9ac4-32290e275435 on hv-cinder-85596 Sep 05 17:38:19.247312 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-79f3a9ef-b553-4668-817f-ffd684b4a664 req-b675a0f8-f470-46ee-96d9-d4f1d28e0968 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035255 Sep 05 17:38:19.248838 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1297/2739] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:38:20.778906 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-090393a5-acc4-4486-8e5a-df8e9ba2a00b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6c4d212-ad32-4736-bca3-681478c46f08"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:38:20.782011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-090393a5-acc4-4486-8e5a-df8e9ba2a00b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:20.797053 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-090393a5-acc4-4486-8e5a-df8e9ba2a00b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:20.797612 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-090393a5-acc4-4486-8e5a-df8e9ba2a00b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:20.798293 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-090393a5-acc4-4486-8e5a-df8e9ba2a00b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:20.799351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-090393a5-acc4-4486-8e5a-df8e9ba2a00b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:20.800469 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-090393a5-acc4-4486-8e5a-df8e9ba2a00b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:20.801954 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-090393a5-acc4-4486-8e5a-df8e9ba2a00b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:21.176787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-090393a5-acc4-4486-8e5a-df8e9ba2a00b tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "POST /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407414 Sep 05 17:38:21.177403 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1443/2740] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Sep 5 17:38:20 2022] POST /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:38:29.870619 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e591d566-a72c-4572-b286-04ff6138874d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:29.872928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e591d566-a72c-4572-b286-04ff6138874d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:29.878595 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=4 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:38:29.879277 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=4 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:38:29.881260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e591d566-a72c-4572-b286-04ff6138874d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:29.881709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e591d566-a72c-4572-b286-04ff6138874d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:29.882136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e591d566-a72c-4572-b286-04ff6138874d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:29.882805 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e591d566-a72c-4572-b286-04ff6138874d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:29.883258 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e591d566-a72c-4572-b286-04ff6138874d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:29.883671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e591d566-a72c-4572-b286-04ff6138874d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:29.915934 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e591d566-a72c-4572-b286-04ff6138874d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049637 Sep 05 17:38:29.916535 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1298/2741] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:38:29 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:38:29.929767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-24b2ecb4-6047-4fa0-a5eb-2feba03e1593 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:29.930469 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-24b2ecb4-6047-4fa0-a5eb-2feba03e1593 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:29.937726 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24b2ecb4-6047-4fa0-a5eb-2feba03e1593 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:29.938216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24b2ecb4-6047-4fa0-a5eb-2feba03e1593 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:29.938640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24b2ecb4-6047-4fa0-a5eb-2feba03e1593 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:29.939632 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24b2ecb4-6047-4fa0-a5eb-2feba03e1593 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:29.940136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24b2ecb4-6047-4fa0-a5eb-2feba03e1593 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:29.940844 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24b2ecb4-6047-4fa0-a5eb-2feba03e1593 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:29.972640 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-24b2ecb4-6047-4fa0-a5eb-2feba03e1593 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments/b6c4d212-ad32-4736-bca3-681478c46f08" status: 200 len: 194 microversion: 2.1 time: 0.048744 Sep 05 17:38:29.973969 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1444/2742] 10.222.0.23 () {58 vars in 1413 bytes} [Mon Sep 5 17:38:29 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments/b6c4d212-ad32-4736-bca3-681478c46f08 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:38:31.343052 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-01923b88-181f-4c30-a9a7-7c4a4a9b085d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "235b4acf-ff4f-4041-b2e0-44ca540f1b0c"}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:38:31.345443 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-01923b88-181f-4c30-a9a7-7c4a4a9b085d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:31.352187 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-01923b88-181f-4c30-a9a7-7c4a4a9b085d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:31.352674 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-01923b88-181f-4c30-a9a7-7c4a4a9b085d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:31.353125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-01923b88-181f-4c30-a9a7-7c4a4a9b085d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:31.353807 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-01923b88-181f-4c30-a9a7-7c4a4a9b085d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:31.354250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-01923b88-181f-4c30-a9a7-7c4a4a9b085d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:31.354670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-01923b88-181f-4c30-a9a7-7c4a4a9b085d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:31.691102 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-01923b88-181f-4c30-a9a7-7c4a4a9b085d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "POST /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351691 Sep 05 17:38:31.695917 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1299/2743] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Sep 5 17:38:31 2022] POST /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:38:39.278125 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7e700cc3-aedf-408f-a084-d642db28cd52 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:39.280455 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7e700cc3-aedf-408f-a084-d642db28cd52 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:39.287656 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e700cc3-aedf-408f-a084-d642db28cd52 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:39.288255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e700cc3-aedf-408f-a084-d642db28cd52 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:39.288767 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e700cc3-aedf-408f-a084-d642db28cd52 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:39.289456 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e700cc3-aedf-408f-a084-d642db28cd52 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:39.289900 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e700cc3-aedf-408f-a084-d642db28cd52 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:39.290312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e700cc3-aedf-408f-a084-d642db28cd52 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:39.322022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7e700cc3-aedf-408f-a084-d642db28cd52 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048378 Sep 05 17:38:39.322578 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1445/2744] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:38:39 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:38:39.465038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f053d5fe-8461-4c23-9ffa-f925b202cc3f tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:39.465629 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f053d5fe-8461-4c23-9ffa-f925b202cc3f tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:39.472560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f053d5fe-8461-4c23-9ffa-f925b202cc3f tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:39.473049 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f053d5fe-8461-4c23-9ffa-f925b202cc3f tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:39.473743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f053d5fe-8461-4c23-9ffa-f925b202cc3f tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:39.474755 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f053d5fe-8461-4c23-9ffa-f925b202cc3f tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:39.475231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f053d5fe-8461-4c23-9ffa-f925b202cc3f tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:39.475670 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f053d5fe-8461-4c23-9ffa-f925b202cc3f tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:39.506671 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f053d5fe-8461-4c23-9ffa-f925b202cc3f tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments/b6c4d212-ad32-4736-bca3-681478c46f08" status: 200 len: 194 microversion: 2.1 time: 0.047039 Sep 05 17:38:39.507290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1300/2745] 10.222.0.23 () {58 vars in 1413 bytes} [Mon Sep 5 17:38:39 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments/b6c4d212-ad32-4736-bca3-681478c46f08 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:38:39.518166 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ed6b863e-6890-4df5-afe8-167e26d1799d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:39.518699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ed6b863e-6890-4df5-afe8-167e26d1799d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:39.526487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed6b863e-6890-4df5-afe8-167e26d1799d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:39.526968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed6b863e-6890-4df5-afe8-167e26d1799d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:39.527401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed6b863e-6890-4df5-afe8-167e26d1799d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:39.528171 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed6b863e-6890-4df5-afe8-167e26d1799d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:39.528633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed6b863e-6890-4df5-afe8-167e26d1799d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:39.529301 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed6b863e-6890-4df5-afe8-167e26d1799d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:39.616839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-ed6b863e-6890-4df5-afe8-167e26d1799d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lazy-loading 'services' on Instance uuid 7d44dddc-7dd2-48fa-9410-adc8e7112416 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:38:39.696160 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ed6b863e-6890-4df5-afe8-167e26d1799d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments/b6c4d212-ad32-4736-bca3-681478c46f08" status: 202 len: 0 microversion: 2.1 time: 0.181985 Sep 05 17:38:39.696775 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1446/2746] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Sep 5 17:38:39 2022] DELETE /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments/b6c4d212-ad32-4736-bca3-681478c46f08 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:38:41.900316 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c16c619b-cb44-4a77-8bb2-ccae8f33cd4d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:41.900863 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c16c619b-cb44-4a77-8bb2-ccae8f33cd4d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:41.907463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c16c619b-cb44-4a77-8bb2-ccae8f33cd4d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:41.907950 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c16c619b-cb44-4a77-8bb2-ccae8f33cd4d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:41.908439 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c16c619b-cb44-4a77-8bb2-ccae8f33cd4d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:41.909314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c16c619b-cb44-4a77-8bb2-ccae8f33cd4d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:41.909598 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c16c619b-cb44-4a77-8bb2-ccae8f33cd4d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:41.910016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c16c619b-cb44-4a77-8bb2-ccae8f33cd4d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:41.941009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c16c619b-cb44-4a77-8bb2-ccae8f33cd4d tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments/235b4acf-ff4f-4041-b2e0-44ca540f1b0c" status: 200 len: 194 microversion: 2.1 time: 0.045330 Sep 05 17:38:41.942339 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1301/2747] 10.222.0.23 () {58 vars in 1413 bytes} [Mon Sep 5 17:38:41 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments/235b4acf-ff4f-4041-b2e0-44ca540f1b0c => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:38:41.955267 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-da04ab59-7aa6-404c-bfe1-82e17743f8ac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:41.955927 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-da04ab59-7aa6-404c-bfe1-82e17743f8ac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:41.962901 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da04ab59-7aa6-404c-bfe1-82e17743f8ac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:41.963376 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da04ab59-7aa6-404c-bfe1-82e17743f8ac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:41.963808 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da04ab59-7aa6-404c-bfe1-82e17743f8ac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:41.964518 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da04ab59-7aa6-404c-bfe1-82e17743f8ac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:41.964968 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da04ab59-7aa6-404c-bfe1-82e17743f8ac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:41.965388 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da04ab59-7aa6-404c-bfe1-82e17743f8ac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:42.049150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-da04ab59-7aa6-404c-bfe1-82e17743f8ac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lazy-loading 'services' on Instance uuid 7d44dddc-7dd2-48fa-9410-adc8e7112416 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:38:42.126635 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-da04ab59-7aa6-404c-bfe1-82e17743f8ac tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments/235b4acf-ff4f-4041-b2e0-44ca540f1b0c" status: 202 len: 0 microversion: 2.1 time: 0.176925 Sep 05 17:38:42.127218 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1447/2748] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Sep 5 17:38:41 2022] DELETE /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments/235b4acf-ff4f-4041-b2e0-44ca540f1b0c => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:38:43.338579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c19c3903-36c1-4203-bd43-deb2780ca048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:43.340901 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c19c3903-36c1-4203-bd43-deb2780ca048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:43.347574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c19c3903-36c1-4203-bd43-deb2780ca048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:43.348060 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c19c3903-36c1-4203-bd43-deb2780ca048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:43.348511 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c19c3903-36c1-4203-bd43-deb2780ca048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:43.349184 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c19c3903-36c1-4203-bd43-deb2780ca048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:43.350003 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c19c3903-36c1-4203-bd43-deb2780ca048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:43.350304 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c19c3903-36c1-4203-bd43-deb2780ca048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:43.382147 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c19c3903-36c1-4203-bd43-deb2780ca048 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048009 Sep 05 17:38:43.382728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1302/2749] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:38:43 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 17:38:43.506683 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-02ac4e67-f336-40fc-97e9-a097382cca2e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:43.509177 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-02ac4e67-f336-40fc-97e9-a097382cca2e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:43.515664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02ac4e67-f336-40fc-97e9-a097382cca2e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:43.516138 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02ac4e67-f336-40fc-97e9-a097382cca2e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:43.516593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02ac4e67-f336-40fc-97e9-a097382cca2e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:43.517278 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02ac4e67-f336-40fc-97e9-a097382cca2e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:43.517722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02ac4e67-f336-40fc-97e9-a097382cca2e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:43.518134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02ac4e67-f336-40fc-97e9-a097382cca2e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:43.546914 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-02ac4e67-f336-40fc-97e9-a097382cca2e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047888 Sep 05 17:38:43.547469 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1448/2750] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Sep 5 17:38:43 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 17:38:43.615916 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-fd15929f-a0a5-43c3-99b8-a7f2b6c4b3bd tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:43.616439 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fd15929f-a0a5-43c3-99b8-a7f2b6c4b3bd tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:43.622783 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd15929f-a0a5-43c3-99b8-a7f2b6c4b3bd tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:43.623312 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd15929f-a0a5-43c3-99b8-a7f2b6c4b3bd tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:43.623737 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd15929f-a0a5-43c3-99b8-a7f2b6c4b3bd tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:43.624454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd15929f-a0a5-43c3-99b8-a7f2b6c4b3bd tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:43.624930 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd15929f-a0a5-43c3-99b8-a7f2b6c4b3bd tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:43.625346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-fd15929f-a0a5-43c3-99b8-a7f2b6c4b3bd tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:43.650563 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-fd15929f-a0a5-43c3-99b8-a7f2b6c4b3bd tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Going to try to terminate instance {{(pid=120733) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:38:43.739555 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-fd15929f-a0a5-43c3-99b8-a7f2b6c4b3bd tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 204 len: 0 microversion: 2.1 time: 0.127040 Sep 05 17:38:43.740250 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1303/2751] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:38:43 2022] DELETE /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:38:43.749529 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-195b1e3e-8f3b-4397-8866-b9141807efea tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:43.750143 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-195b1e3e-8f3b-4397-8866-b9141807efea tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:43.758335 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-195b1e3e-8f3b-4397-8866-b9141807efea tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:43.758765 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-195b1e3e-8f3b-4397-8866-b9141807efea tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:43.759211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-195b1e3e-8f3b-4397-8866-b9141807efea tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:43.759916 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-195b1e3e-8f3b-4397-8866-b9141807efea tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:43.760398 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-195b1e3e-8f3b-4397-8866-b9141807efea tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:43.760825 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-195b1e3e-8f3b-4397-8866-b9141807efea tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:43.897565 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-195b1e3e-8f3b-4397-8866-b9141807efea tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:38:43.905241 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-195b1e3e-8f3b-4397-8866-b9141807efea tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 200 len: 1672 microversion: 2.1 time: 0.160279 Sep 05 17:38:43.905803 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1449/2752] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:38:43 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:38:44.929438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-80a8f0fd-5a72-4490-b13e-930a095e2c72 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:44.930127 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-80a8f0fd-5a72-4490-b13e-930a095e2c72 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:44.936513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80a8f0fd-5a72-4490-b13e-930a095e2c72 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:44.936994 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80a8f0fd-5a72-4490-b13e-930a095e2c72 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:44.937420 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80a8f0fd-5a72-4490-b13e-930a095e2c72 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:44.938099 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80a8f0fd-5a72-4490-b13e-930a095e2c72 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:44.938738 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80a8f0fd-5a72-4490-b13e-930a095e2c72 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:44.939156 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-80a8f0fd-5a72-4490-b13e-930a095e2c72 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:45.081408 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-80a8f0fd-5a72-4490-b13e-930a095e2c72 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:38:45.090425 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-80a8f0fd-5a72-4490-b13e-930a095e2c72 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 200 len: 1672 microversion: 2.1 time: 0.165214 Sep 05 17:38:45.091120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1304/2753] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:38:44 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:38:46.114789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ff4ee56a-e675-4b03-b9e9-a85e862efd74 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:46.115522 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ff4ee56a-e675-4b03-b9e9-a85e862efd74 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:46.118049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=17 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:38:46.124086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4ee56a-e675-4b03-b9e9-a85e862efd74 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:46.124601 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4ee56a-e675-4b03-b9e9-a85e862efd74 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:46.125043 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4ee56a-e675-4b03-b9e9-a85e862efd74 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:46.125741 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4ee56a-e675-4b03-b9e9-a85e862efd74 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:46.126196 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4ee56a-e675-4b03-b9e9-a85e862efd74 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:46.126620 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4ee56a-e675-4b03-b9e9-a85e862efd74 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:46.129691 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:38:46.341391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ff4ee56a-e675-4b03-b9e9-a85e862efd74 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:38:46.350813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ff4ee56a-e675-4b03-b9e9-a85e862efd74 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 200 len: 1672 microversion: 2.1 time: 0.239851 Sep 05 17:38:46.351387 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1450/2754] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:38:46 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 1672 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:38:47.256491 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-7511a926-bba2-439c-8803-e56d727671e7 req-f8b60361-b84a-4a67-a614-8ad5fef02a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d44dddc-7dd2-48fa-9410-adc8e7112416", "name": "network-vif-deleted", "tag": "9a7d1594-8b9a-4bb0-ba9e-0179f1921c1c"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:38:47.267857 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-7511a926-bba2-439c-8803-e56d727671e7 req-f8b60361-b84a-4a67-a614-8ad5fef02a20 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:47.268549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-7511a926-bba2-439c-8803-e56d727671e7 req-f8b60361-b84a-4a67-a614-8ad5fef02a20 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:47.269062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-7511a926-bba2-439c-8803-e56d727671e7 req-f8b60361-b84a-4a67-a614-8ad5fef02a20 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:47.283687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-7511a926-bba2-439c-8803-e56d727671e7 req-f8b60361-b84a-4a67-a614-8ad5fef02a20 service nova] Creating event network-vif-deleted:9a7d1594-8b9a-4bb0-ba9e-0179f1921c1c for instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 on hv-cinder-85596 Sep 05 17:38:47.289838 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-7511a926-bba2-439c-8803-e56d727671e7 req-f8b60361-b84a-4a67-a614-8ad5fef02a20 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037065 Sep 05 17:38:47.290630 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1305/2755] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:38:47.379337 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f93134e0-b40f-40fe-8c6b-4923fd63aa9a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:47.380032 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f93134e0-b40f-40fe-8c6b-4923fd63aa9a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:47.387125 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f93134e0-b40f-40fe-8c6b-4923fd63aa9a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:47.387715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f93134e0-b40f-40fe-8c6b-4923fd63aa9a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:47.388278 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f93134e0-b40f-40fe-8c6b-4923fd63aa9a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:47.389098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f93134e0-b40f-40fe-8c6b-4923fd63aa9a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:47.389619 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f93134e0-b40f-40fe-8c6b-4923fd63aa9a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:47.390111 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f93134e0-b40f-40fe-8c6b-4923fd63aa9a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:47.423662 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f93134e0-b40f-40fe-8c6b-4923fd63aa9a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:47.424116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f93134e0-b40f-40fe-8c6b-4923fd63aa9a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:47.424577 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f93134e0-b40f-40fe-8c6b-4923fd63aa9a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:47.425023 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-f93134e0-b40f-40fe-8c6b-4923fd63aa9a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lazy-loading 'fault' on Instance uuid 7d44dddc-7dd2-48fa-9410-adc8e7112416 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:38:47.472100 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f93134e0-b40f-40fe-8c6b-4923fd63aa9a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7767df40d849b8bb870ad090fead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dd08c068a5435c8c426d4a9a24b30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:38:47.483706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f93134e0-b40f-40fe-8c6b-4923fd63aa9a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 200 len: 1326 microversion: 2.1 time: 0.108538 Sep 05 17:38:47.499633 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1451/2756] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:38:47 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 1326 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:38:48.510180 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1ebd71e3-461c-4c63-950a-73b8bc7c44d6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:48.510726 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1ebd71e3-461c-4c63-950a-73b8bc7c44d6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:48.517998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ebd71e3-461c-4c63-950a-73b8bc7c44d6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:48.518454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ebd71e3-461c-4c63-950a-73b8bc7c44d6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:48.518905 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ebd71e3-461c-4c63-950a-73b8bc7c44d6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:48.519579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ebd71e3-461c-4c63-950a-73b8bc7c44d6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:48.520021 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ebd71e3-461c-4c63-950a-73b8bc7c44d6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:48.520466 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1ebd71e3-461c-4c63-950a-73b8bc7c44d6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:48.534321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-1ebd71e3-461c-4c63-950a-73b8bc7c44d6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] HTTP exception thrown: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1ebd71e3-461c-4c63-950a-73b8bc7c44d6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Request method failure captured: Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 HTTP/1.1 Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFjG_0N19IaKUIriip5QYY2WI9Q_i_iEsLOceUWM3ilt4afBVEnGHXQ72BldGLrcb0eOBBLwl2nXf7k4nQlSIzTNhgCjJb1KdNHVPm3I-2JtCq60qBcDi2xptR-XnyOnRp0Fa5v58R4Z_Kgs63Cis5F6yKqvBvvmqXi84IoffWPQnhII Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: f8dd08c068a5435c8c426d4a9a24b30d Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:38:48.535953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:38:48.537764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8dd08c068a5435c8c426d4a9a24b30d"}]}] Sep 05 17:38:48.537764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:38:48.537764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: f8dd08c068a5435c8c426d4a9a24b30d Sep 05 17:38:48.537764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:38:48.537764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-AttachVolumeTestJSON-1448336597-project Sep 05 17:38:48.537764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:38:48.537764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:38:48.537764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: bb7767df40d849b8bb870ad090fead83 Sep 05 17:38:48.537764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-AttachVolumeTestJSON-1448336597-project Sep 05 17:38:48.537764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:38:48.537764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. Sep 05 17:38:48.537764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': '7d44dddc-7dd2-48fa-9410-adc8e7112416'} Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:38:48.538727 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. Sep 05 17:38:48.540280 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:48.541933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1ebd71e3-461c-4c63-950a-73b8bc7c44d6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Returning 404 to user: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:38:48.541933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1ebd71e3-461c-4c63-950a-73b8bc7c44d6 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 404 len: 111 microversion: 2.1 time: 0.032199 Sep 05 17:38:48.541933 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1306/2757] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:38:48 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:38:48.547387 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3251885e-713d-44ba-9035-a6d198bc2041 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '.version_select at 0x7f1d3ab99040>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:48.581131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3251885e-713d-44ba-9035-a6d198bc2041 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-383671274" status: 202 len: 0 microversion: 2.1 time: 0.037480 Sep 05 17:38:48.581710 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1452/2758] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Sep 5 17:38:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-383671274 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:38:51.518378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6a046ac3-ed6a-4af9-90a9-e318b375e304 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:51.518940 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-6a046ac3-ed6a-4af9-90a9-e318b375e304 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:51.525741 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a046ac3-ed6a-4af9-90a9-e318b375e304 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:51.526217 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a046ac3-ed6a-4af9-90a9-e318b375e304 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:51.526636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a046ac3-ed6a-4af9-90a9-e318b375e304 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:51.527510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a046ac3-ed6a-4af9-90a9-e318b375e304 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:51.527961 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a046ac3-ed6a-4af9-90a9-e318b375e304 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:51.528418 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-6a046ac3-ed6a-4af9-90a9-e318b375e304 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:51.543976 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-6a046ac3-ed6a-4af9-90a9-e318b375e304 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] HTTP exception thrown: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6a046ac3-ed6a-4af9-90a9-e318b375e304 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Request method failure captured: Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: DELETE /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 HTTP/1.1 Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFjG_0N19IaKUIriip5QYY2WI9Q_i_iEsLOceUWM3ilt4afBVEnGHXQ72BldGLrcb0eOBBLwl2nXf7k4nQlSIzTNhgCjJb1KdNHVPm3I-2JtCq60qBcDi2xptR-XnyOnRp0Fa5v58R4Z_Kgs63Cis5F6yKqvBvvmqXi84IoffWPQnhII Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: f8dd08c068a5435c8c426d4a9a24b30d Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:38:51.545553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:38:51.548255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8dd08c068a5435c8c426d4a9a24b30d"}]}] Sep 05 17:38:51.548255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:38:51.548255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: f8dd08c068a5435c8c426d4a9a24b30d Sep 05 17:38:51.548255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:38:51.548255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-AttachVolumeTestJSON-1448336597-project Sep 05 17:38:51.548255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:38:51.548255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:38:51.548255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: bb7767df40d849b8bb870ad090fead83 Sep 05 17:38:51.548255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-AttachVolumeTestJSON-1448336597-project Sep 05 17:38:51.548255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:38:51.548255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. Sep 05 17:38:51.548255 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': '7d44dddc-7dd2-48fa-9410-adc8e7112416'} Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:38:51.549381 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. Sep 05 17:38:51.551720 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:51.554319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-6a046ac3-ed6a-4af9-90a9-e318b375e304 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Returning 404 to user: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:38:51.554319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-6a046ac3-ed6a-4af9-90a9-e318b375e304 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 404 len: 111 microversion: 2.1 time: 0.032450 Sep 05 17:38:51.554319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1307/2759] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:38:51 2022] DELETE /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:38:51.556981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5084f5e0-6c3f-429c-be66-36fed7351772 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:51.557648 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5084f5e0-6c3f-429c-be66-36fed7351772 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 7d44dddc-7dd2-48fa-9410-adc8e7112416] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:51.568115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5084f5e0-6c3f-429c-be66-36fed7351772 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:51.568891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5084f5e0-6c3f-429c-be66-36fed7351772 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:51.569504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5084f5e0-6c3f-429c-be66-36fed7351772 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:51.570307 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5084f5e0-6c3f-429c-be66-36fed7351772 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:51.570980 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5084f5e0-6c3f-429c-be66-36fed7351772 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:51.571495 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5084f5e0-6c3f-429c-be66-36fed7351772 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:51.586851 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-5084f5e0-6c3f-429c-be66-36fed7351772 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] HTTP exception thrown: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5084f5e0-6c3f-429c-be66-36fed7351772 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Request method failure captured: Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 HTTP/1.1 Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFjG_0N19IaKUIriip5QYY2WI9Q_i_iEsLOceUWM3ilt4afBVEnGHXQ72BldGLrcb0eOBBLwl2nXf7k4nQlSIzTNhgCjJb1KdNHVPm3I-2JtCq60qBcDi2xptR-XnyOnRp0Fa5v58R4Z_Kgs63Cis5F6yKqvBvvmqXi84IoffWPQnhII Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: f8dd08c068a5435c8c426d4a9a24b30d Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:38:51.589000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:38:51.590763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8dd08c068a5435c8c426d4a9a24b30d"}]}] Sep 05 17:38:51.590763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:38:51.590763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: f8dd08c068a5435c8c426d4a9a24b30d Sep 05 17:38:51.590763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:38:51.590763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeTestJSON-1448336597-project Sep 05 17:38:51.590763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:38:51.590763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:38:51.590763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: bb7767df40d849b8bb870ad090fead83 Sep 05 17:38:51.590763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeTestJSON-1448336597-project Sep 05 17:38:51.590763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:38:51.590763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. Sep 05 17:38:51.590763 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': '7d44dddc-7dd2-48fa-9410-adc8e7112416'} Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:38:51.591787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. Sep 05 17:38:51.593528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:51.595179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5084f5e0-6c3f-429c-be66-36fed7351772 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Returning 404 to user: Instance 7d44dddc-7dd2-48fa-9410-adc8e7112416 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:38:51.595179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5084f5e0-6c3f-429c-be66-36fed7351772 tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416" status: 404 len: 111 microversion: 2.1 time: 0.038660 Sep 05 17:38:51.595179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1453/2760] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:38:51 2022] GET /compute/v2.1/servers/7d44dddc-7dd2-48fa-9410-adc8e7112416 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:38:52.739560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5d0ea380-6774-4c1e-9245-07e0f814225a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:52.740117 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5d0ea380-6774-4c1e-9245-07e0f814225a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:52.747177 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d0ea380-6774-4c1e-9245-07e0f814225a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:52.747656 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d0ea380-6774-4c1e-9245-07e0f814225a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:52.748085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d0ea380-6774-4c1e-9245-07e0f814225a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:52.748803 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d0ea380-6774-4c1e-9245-07e0f814225a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:52.749259 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d0ea380-6774-4c1e-9245-07e0f814225a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:52.749677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5d0ea380-6774-4c1e-9245-07e0f814225a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:52.763271 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-5d0ea380-6774-4c1e-9245-07e0f814225a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] HTTP exception thrown: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5d0ea380-6774-4c1e-9245-07e0f814225a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Request method failure captured: Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: DELETE /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 HTTP/1.1 Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFjG_0N19IaKUIriip5QYY2WI9Q_i_iEsLOceUWM3ilt4afBVEnGHXQ72BldGLrcb0eOBBLwl2nXf7k4nQlSIzTNhgCjJb1KdNHVPm3I-2JtCq60qBcDi2xptR-XnyOnRp0Fa5v58R4Z_Kgs63Cis5F6yKqvBvvmqXi84IoffWPQnhII Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: f8dd08c068a5435c8c426d4a9a24b30d Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:38:52.764942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:38:52.766879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8dd08c068a5435c8c426d4a9a24b30d"}]}] Sep 05 17:38:52.766879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:38:52.766879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: f8dd08c068a5435c8c426d4a9a24b30d Sep 05 17:38:52.766879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:38:52.766879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-AttachVolumeTestJSON-1448336597-project Sep 05 17:38:52.766879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:38:52.766879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:38:52.766879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: bb7767df40d849b8bb870ad090fead83 Sep 05 17:38:52.766879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-AttachVolumeTestJSON-1448336597-project Sep 05 17:38:52.766879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:38:52.766879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. Sep 05 17:38:52.766879 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': '6615b39c-c510-4c9b-8e33-08a489f85ec5'} Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:38:52.767794 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. Sep 05 17:38:52.769311 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:52.771194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5d0ea380-6774-4c1e-9245-07e0f814225a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Returning 404 to user: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:38:52.771194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5d0ea380-6774-4c1e-9245-07e0f814225a tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 404 len: 111 microversion: 2.1 time: 0.030801 Sep 05 17:38:52.771194 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1308/2761] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:38:52 2022] DELETE /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:38:52.775401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-497220c7-4bcc-4359-adaa-8c45ce32273e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:52.776092 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-497220c7-4bcc-4359-adaa-8c45ce32273e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] [instance: 6615b39c-c510-4c9b-8e33-08a489f85ec5] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:38:52.782937 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-497220c7-4bcc-4359-adaa-8c45ce32273e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:52.783415 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-497220c7-4bcc-4359-adaa-8c45ce32273e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:52.783842 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-497220c7-4bcc-4359-adaa-8c45ce32273e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:52.784581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-497220c7-4bcc-4359-adaa-8c45ce32273e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:38:52.785022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-497220c7-4bcc-4359-adaa-8c45ce32273e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:38:52.785436 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-497220c7-4bcc-4359-adaa-8c45ce32273e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:38:52.799447 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-497220c7-4bcc-4359-adaa-8c45ce32273e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] HTTP exception thrown: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-497220c7-4bcc-4359-adaa-8c45ce32273e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Request method failure captured: Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 HTTP/1.1 Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFjG_0N19IaKUIriip5QYY2WI9Q_i_iEsLOceUWM3ilt4afBVEnGHXQ72BldGLrcb0eOBBLwl2nXf7k4nQlSIzTNhgCjJb1KdNHVPm3I-2JtCq60qBcDi2xptR-XnyOnRp0Fa5v58R4Z_Kgs63Cis5F6yKqvBvvmqXi84IoffWPQnhII Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: f8dd08c068a5435c8c426d4a9a24b30d Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:38:52.801021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:38:52.803176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8dd08c068a5435c8c426d4a9a24b30d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8dd08c068a5435c8c426d4a9a24b30d"}]}] Sep 05 17:38:52.803176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:38:52.803176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: f8dd08c068a5435c8c426d4a9a24b30d Sep 05 17:38:52.803176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448336597 Sep 05 17:38:52.803176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeTestJSON-1448336597-project Sep 05 17:38:52.803176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:38:52.803176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:38:52.803176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: bb7767df40d849b8bb870ad090fead83 Sep 05 17:38:52.803176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeTestJSON-1448336597-project Sep 05 17:38:52.803176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:38:52.803176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. Sep 05 17:38:52.803176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': '6615b39c-c510-4c9b-8e33-08a489f85ec5'} Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:38:52.804216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. Sep 05 17:38:52.805777 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:52.807085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-497220c7-4bcc-4359-adaa-8c45ce32273e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] Returning 404 to user: Instance 6615b39c-c510-4c9b-8e33-08a489f85ec5 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:38:52.807085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-497220c7-4bcc-4359-adaa-8c45ce32273e tempest-AttachVolumeTestJSON-1448336597 tempest-AttachVolumeTestJSON-1448336597-project] 10.222.0.23 "GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5" status: 404 len: 111 microversion: 2.1 time: 0.031062 Sep 05 17:38:52.807085 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1454/2762] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:38:52 2022] GET /compute/v2.1/servers/6615b39c-c510-4c9b-8e33-08a489f85ec5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:38:57.480436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7d1b5907-0751-4cfe-9b70-830128ed161d tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Action: 'create', calling method: .version_select at 0x7f1d3af910d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-612035783", "metadata": {"Type": "work"}}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7d1b5907-0751-4cfe-9b70-830128ed161d tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Request method failure captured: Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 121 Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFjQxvwsRh84dKqzJgF6cBGyeu0jUnzG2S6-3kLtWXMS_GcEb_qgzdZ4YXKFcdKElZBtRHvcFIJvDJosGLrHUS58UUVmiW3txTStlXHksgKE8Kb5-9DyR1im9tWYbNUXg2ixOPFGLACAv9m-wU0ORW8RduEZcPxU-dB2Npr2tUG771t4 Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: e86ec106cddf4056aee5472be012e740 Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:38:57.494001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:38:57.495893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e86ec106cddf4056aee5472be012e740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e86ec106cddf4056aee5472be012e740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e86ec106cddf4056aee5472be012e740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e86ec106cddf4056aee5472be012e740"}]}] Sep 05 17:38:57.495893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.495893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: e86ec106cddf4056aee5472be012e740 Sep 05 17:38:57.495893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.495893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-VolumesNegativeTest-1486098618-project Sep 05 17:38:57.495893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:38:57.495893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:38:57.495893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: 922b991e8be44acb9a091f52846f665d Sep 05 17:38:57.495893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-VolumesNegativeTest-1486098618-project Sep 05 17:38:57.495893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Sep 05 17:38:57.495893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-612035783", "metadata": {"Type": "work"}}} Sep 05 17:38:57.495893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: Sep 05 17:38:57.495893 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-612035783', 'metadata': {'Type': 'work'}}}} Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise error Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi '#$%' Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:38:57.497094 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 05 17:38:57.499046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 05 17:38:57.500775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 05 17:38:57.500775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.500775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7d1b5907-0751-4cfe-9b70-830128ed161d tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:38:57.500775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7d1b5907-0751-4cfe-9b70-830128ed161d tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.148664 Sep 05 17:38:57.500775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1309/2763] 10.222.0.23 () {60 vars in 1156 bytes} [Mon Sep 5 17:38:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 17:38:57.505294 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-65f9a86b-51c4-4e5d-ab89-3588a564aff2 tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Action: 'create', calling method: .version_select at 0x7f1d3ac6ba60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-563389664", "metadata": {"Type": "work"}}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-65f9a86b-51c4-4e5d-ab89-3588a564aff2 tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Request method failure captured: Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 119 Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFjQxvwsRh84dKqzJgF6cBGyeu0jUnzG2S6-3kLtWXMS_GcEb_qgzdZ4YXKFcdKElZBtRHvcFIJvDJosGLrHUS58UUVmiW3txTStlXHksgKE8Kb5-9DyR1im9tWYbNUXg2ixOPFGLACAv9m-wU0ORW8RduEZcPxU-dB2Npr2tUG771t4 Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: e86ec106cddf4056aee5472be012e740 Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:38:57.510004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:38:57.511845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e86ec106cddf4056aee5472be012e740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e86ec106cddf4056aee5472be012e740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e86ec106cddf4056aee5472be012e740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e86ec106cddf4056aee5472be012e740"}]}] Sep 05 17:38:57.511845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.511845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: e86ec106cddf4056aee5472be012e740 Sep 05 17:38:57.511845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.511845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-VolumesNegativeTest-1486098618-project Sep 05 17:38:57.511845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:38:57.511845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:38:57.511845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: 922b991e8be44acb9a091f52846f665d Sep 05 17:38:57.511845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-VolumesNegativeTest-1486098618-project Sep 05 17:38:57.511845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Sep 05 17:38:57.511845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-563389664", "metadata": {"Type": "work"}}} Sep 05 17:38:57.511845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: Sep 05 17:38:57.511845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-563389664', 'metadata': {'Type': 'work'}}}} Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise error Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi '0' Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:38:57.513067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 05 17:38:57.514826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 05 17:38:57.516379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 05 17:38:57.516379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.516379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-65f9a86b-51c4-4e5d-ab89-3588a564aff2 tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:38:57.516379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-65f9a86b-51c4-4e5d-ab89-3588a564aff2 tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010129 Sep 05 17:38:57.516379 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1455/2764] 10.222.0.23 () {60 vars in 1156 bytes} [Mon Sep 5 17:38:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 17:38:57.520829 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-23ec38a2-1a92-4a6d-a607-c8e715c867ad tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Action: 'create', calling method: .version_select at 0x7f1d3e375820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-793568908", "metadata": {"Type": "work"}}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-23ec38a2-1a92-4a6d-a607-c8e715c867ad tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Request method failure captured: Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 118 Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFjQxvwsRh84dKqzJgF6cBGyeu0jUnzG2S6-3kLtWXMS_GcEb_qgzdZ4YXKFcdKElZBtRHvcFIJvDJosGLrHUS58UUVmiW3txTStlXHksgKE8Kb5-9DyR1im9tWYbNUXg2ixOPFGLACAv9m-wU0ORW8RduEZcPxU-dB2Npr2tUG771t4 Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: e86ec106cddf4056aee5472be012e740 Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:38:57.524437 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:38:57.526356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e86ec106cddf4056aee5472be012e740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e86ec106cddf4056aee5472be012e740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e86ec106cddf4056aee5472be012e740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e86ec106cddf4056aee5472be012e740"}]}] Sep 05 17:38:57.526356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.526356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: e86ec106cddf4056aee5472be012e740 Sep 05 17:38:57.526356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.526356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-VolumesNegativeTest-1486098618-project Sep 05 17:38:57.526356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:38:57.526356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:38:57.526356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: 922b991e8be44acb9a091f52846f665d Sep 05 17:38:57.526356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-VolumesNegativeTest-1486098618-project Sep 05 17:38:57.526356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Sep 05 17:38:57.526356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-793568908", "metadata": {"Type": "work"}}} Sep 05 17:38:57.526356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: Sep 05 17:38:57.526356 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-793568908', 'metadata': {'Type': 'work'}}}} Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise error Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi '' Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:38:57.527423 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 05 17:38:57.529427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 05 17:38:57.531044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 05 17:38:57.531044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.531044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-23ec38a2-1a92-4a6d-a607-c8e715c867ad tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:38:57.531044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-23ec38a2-1a92-4a6d-a607-c8e715c867ad tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008893 Sep 05 17:38:57.531044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1310/2765] 10.222.0.23 () {60 vars in 1156 bytes} [Mon Sep 5 17:38:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 17:38:57.535263 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6ce444f4-9266-475e-8cc9-34a02c6f288e tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Calling method '.version_select at 0x7f1d3ad1b5e0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:57.566501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-6ce444f4-9266-475e-8cc9-34a02c6f288e tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] HTTP exception thrown: Volume tempest-invalid-844946292 could not be found. Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6ce444f4-9266-475e-8cc9-34a02c6f288e tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Request method failure captured: Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-844946292 HTTP/1.1 Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFjQxvwsRh84dKqzJgF6cBGyeu0jUnzG2S6-3kLtWXMS_GcEb_qgzdZ4YXKFcdKElZBtRHvcFIJvDJosGLrHUS58UUVmiW3txTStlXHksgKE8Kb5-9DyR1im9tWYbNUXg2ixOPFGLACAv9m-wU0ORW8RduEZcPxU-dB2Npr2tUG771t4 Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: e86ec106cddf4056aee5472be012e740 Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:38:57.567505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:38:57.569351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e86ec106cddf4056aee5472be012e740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e86ec106cddf4056aee5472be012e740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e86ec106cddf4056aee5472be012e740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e86ec106cddf4056aee5472be012e740"}]}] Sep 05 17:38:57.569351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.569351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: e86ec106cddf4056aee5472be012e740 Sep 05 17:38:57.569351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.569351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-VolumesNegativeTest-1486098618-project Sep 05 17:38:57.569351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:38:57.569351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:38:57.569351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: 922b991e8be44acb9a091f52846f665d Sep 05 17:38:57.569351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-VolumesNegativeTest-1486098618-project Sep 05 17:38:57.569351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: Sep 05 17:38:57.569351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Volume tempest-invalid-844946292 could not be found. Sep 05 17:38:57.569351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': 'tempest-invalid-844946292'} Sep 05 17:38:57.569351 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-844946292 could not be found. (HTTP 404) (Request-ID: req-01954dd0-d86c-42d9-b38b-57107ea63301) Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:57.570394 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 17:38:57.572284 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-844946292 could not be found. Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:38:57.573792 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-844946292 could not be found. Sep 05 17:38:57.575371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.575371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:57.575371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.575371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.575371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:57.575371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:57.575371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:38:57.575371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:38:57.575371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-844946292 could not be found. Sep 05 17:38:57.575371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.575371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6ce444f4-9266-475e-8cc9-34a02c6f288e tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Returning 404 to user: Volume tempest-invalid-844946292 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:38:57.575371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6ce444f4-9266-475e-8cc9-34a02c6f288e tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-844946292" status: 404 len: 98 microversion: 2.1 time: 0.037900 Sep 05 17:38:57.575371 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1456/2766] 10.222.0.23 () {58 vars in 1215 bytes} [Mon Sep 5 17:38:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-844946292 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 05 17:38:57.582488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e28370e5-6189-4b5c-ae41-3fb12a026170 tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004075 Sep 05 17:38:57.583052 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1311/2767] 10.222.0.23 () {58 vars in 1140 bytes} [Mon Sep 5 17:38:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 05 17:38:57.593057 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-125e84d6-74bf-4404-a97a-2401ee2faf3b tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003878 Sep 05 17:38:57.593570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1457/2768] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Sep 5 17:38:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 05 17:38:57.601903 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a1a4fb85-1782-462c-987f-25bd163f0ba0 tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Calling method '.version_select at 0x7f1d3e375c10>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:57.631645 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-a1a4fb85-1782-462c-987f-25bd163f0ba0 tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] HTTP exception thrown: Volume bc91e4f6-ae49-47ee-84f3-eee17ef340a5 could not be found. Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a1a4fb85-1782-462c-987f-25bd163f0ba0 tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Request method failure captured: Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: DELETE /compute/v2.1/os-volumes/bc91e4f6-ae49-47ee-84f3-eee17ef340a5 HTTP/1.1 Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFjQxvwsRh84dKqzJgF6cBGyeu0jUnzG2S6-3kLtWXMS_GcEb_qgzdZ4YXKFcdKElZBtRHvcFIJvDJosGLrHUS58UUVmiW3txTStlXHksgKE8Kb5-9DyR1im9tWYbNUXg2ixOPFGLACAv9m-wU0ORW8RduEZcPxU-dB2Npr2tUG771t4 Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: e86ec106cddf4056aee5472be012e740 Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:38:57.633687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:38:57.635620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e86ec106cddf4056aee5472be012e740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e86ec106cddf4056aee5472be012e740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e86ec106cddf4056aee5472be012e740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e86ec106cddf4056aee5472be012e740"}]}] Sep 05 17:38:57.635620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.635620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: e86ec106cddf4056aee5472be012e740 Sep 05 17:38:57.635620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.635620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-VolumesNegativeTest-1486098618-project Sep 05 17:38:57.635620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:38:57.635620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:38:57.635620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: 922b991e8be44acb9a091f52846f665d Sep 05 17:38:57.635620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-VolumesNegativeTest-1486098618-project Sep 05 17:38:57.635620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: Sep 05 17:38:57.635620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Volume bc91e4f6-ae49-47ee-84f3-eee17ef340a5 could not be found. Sep 05 17:38:57.635620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': 'bc91e4f6-ae49-47ee-84f3-eee17ef340a5'} Sep 05 17:38:57.635620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc91e4f6-ae49-47ee-84f3-eee17ef340a5 could not be found. (HTTP 404) (Request-ID: req-1a5f505b-162a-4427-9362-31b604101b9a) Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:57.636921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 17:38:57.638492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc91e4f6-ae49-47ee-84f3-eee17ef340a5 could not be found. Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 05 17:38:57.640218 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:38:57.641846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc91e4f6-ae49-47ee-84f3-eee17ef340a5 could not be found. Sep 05 17:38:57.641846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.641846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:57.641846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.641846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.641846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:57.641846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:57.641846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:38:57.641846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:38:57.641846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc91e4f6-ae49-47ee-84f3-eee17ef340a5 could not be found. Sep 05 17:38:57.641846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.641846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a1a4fb85-1782-462c-987f-25bd163f0ba0 tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Returning 404 to user: Volume bc91e4f6-ae49-47ee-84f3-eee17ef340a5 could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:38:57.641846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a1a4fb85-1782-462c-987f-25bd163f0ba0 tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/bc91e4f6-ae49-47ee-84f3-eee17ef340a5" status: 404 len: 109 microversion: 2.1 time: 0.037102 Sep 05 17:38:57.641846 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1312/2769] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Sep 5 17:38:57 2022] DELETE /compute/v2.1/os-volumes/bc91e4f6-ae49-47ee-84f3-eee17ef340a5 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 17:38:57.644674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3fdd1e30-6105-4a89-96f6-37206b22244e tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Calling method '.version_select at 0x7f1d3ac6b8b0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:38:57.677657 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-3fdd1e30-6105-4a89-96f6-37206b22244e tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] HTTP exception thrown: Volume bd122a52-c4c8-4728-8d4e-13ec8ea5bde0 could not be found. Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3fdd1e30-6105-4a89-96f6-37206b22244e tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Request method failure captured: Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/os-volumes/bd122a52-c4c8-4728-8d4e-13ec8ea5bde0 HTTP/1.1 Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFjQxvwsRh84dKqzJgF6cBGyeu0jUnzG2S6-3kLtWXMS_GcEb_qgzdZ4YXKFcdKElZBtRHvcFIJvDJosGLrHUS58UUVmiW3txTStlXHksgKE8Kb5-9DyR1im9tWYbNUXg2ixOPFGLACAv9m-wU0ORW8RduEZcPxU-dB2Npr2tUG771t4 Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: e86ec106cddf4056aee5472be012e740 Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:38:57.679611 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:38:57.681423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e86ec106cddf4056aee5472be012e740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e86ec106cddf4056aee5472be012e740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e86ec106cddf4056aee5472be012e740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e86ec106cddf4056aee5472be012e740"}]}] Sep 05 17:38:57.681423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.681423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: e86ec106cddf4056aee5472be012e740 Sep 05 17:38:57.681423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-VolumesNegativeTest-1486098618 Sep 05 17:38:57.681423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-VolumesNegativeTest-1486098618-project Sep 05 17:38:57.681423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:38:57.681423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:38:57.681423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: 922b991e8be44acb9a091f52846f665d Sep 05 17:38:57.681423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-VolumesNegativeTest-1486098618-project Sep 05 17:38:57.681423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: Sep 05 17:38:57.681423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Volume bd122a52-c4c8-4728-8d4e-13ec8ea5bde0 could not be found. Sep 05 17:38:57.681423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': 'bd122a52-c4c8-4728-8d4e-13ec8ea5bde0'} Sep 05 17:38:57.681423 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd122a52-c4c8-4728-8d4e-13ec8ea5bde0 could not be found. (HTTP 404) (Request-ID: req-ffb18340-853b-4651-85ca-f79f56a9b861) Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:57.682400 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 17:38:57.684311 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd122a52-c4c8-4728-8d4e-13ec8ea5bde0 could not be found. Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 05 17:38:57.685903 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:38:57.687470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd122a52-c4c8-4728-8d4e-13ec8ea5bde0 could not be found. Sep 05 17:38:57.687470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.687470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:38:57.687470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.687470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:38:57.687470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:38:57.687470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:38:57.687470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:38:57.687470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:38:57.687470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd122a52-c4c8-4728-8d4e-13ec8ea5bde0 could not be found. Sep 05 17:38:57.687470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:38:57.687470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3fdd1e30-6105-4a89-96f6-37206b22244e tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] Returning 404 to user: Volume bd122a52-c4c8-4728-8d4e-13ec8ea5bde0 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:38:57.687470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3fdd1e30-6105-4a89-96f6-37206b22244e tempest-VolumesNegativeTest-1486098618 tempest-VolumesNegativeTest-1486098618-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/bd122a52-c4c8-4728-8d4e-13ec8ea5bde0" status: 404 len: 109 microversion: 2.1 time: 0.040307 Sep 05 17:38:57.687470 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1458/2770] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Sep 5 17:38:57 2022] GET /compute/v2.1/os-volumes/bd122a52-c4c8-4728-8d4e-13ec8ea5bde0 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:40:18.203427 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:40:18.204254 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:40:18.205043 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:40:18.205319 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:40:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 (ip 10.222.0.23) !!! Sep 05 17:40:18.206225 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:40:18.206321 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:40:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 (ip 10.222.0.23) !!! Sep 05 17:40:18.213607 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0c51123f-8b00-41d1-ae2e-fb444c1f51f9 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:40:18.214158 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0c51123f-8b00-41d1-ae2e-fb444c1f51f9 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:40:18.223387 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c51123f-8b00-41d1-ae2e-fb444c1f51f9 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:40:18.223868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c51123f-8b00-41d1-ae2e-fb444c1f51f9 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:40:18.224314 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c51123f-8b00-41d1-ae2e-fb444c1f51f9 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:40:18.224999 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c51123f-8b00-41d1-ae2e-fb444c1f51f9 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:40:18.225446 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c51123f-8b00-41d1-ae2e-fb444c1f51f9 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:40:18.225861 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0c51123f-8b00-41d1-ae2e-fb444c1f51f9 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:40:18.242095 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-0c51123f-8b00-41d1-ae2e-fb444c1f51f9 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] HTTP exception thrown: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0c51123f-8b00-41d1-ae2e-fb444c1f51f9 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Request method failure captured: Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: DELETE /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 HTTP/1.1 Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFiv_u9Fbkzz4N4EnwLFTHdVgGIHyTWZLVadgHsx5DjzJc71ULzFynHZ-XPxUeQAMj5CK9TClkqesRSKhjnpIv2d__HUGj1wgdznOqyEZDFoYmO3imZ0m9_h8uFe0RLmxeR8bY4quUM556Rumoa232jhk_i2qgcsiqF_5KIfw8vmSWkU Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:40:18.243654 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:40:18.245031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6ed4f1f1246408099252ebea491832c"}]}] Sep 05 17:40:18.245031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:18.245031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:40:18.245031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:18.245031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:40:18.245031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:40:18.245031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:40:18.245031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: 2b81fb00b1b545308d01f74a55b7e77b Sep 05 17:40:18.245031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:40:18.245031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:40:18.245031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. Sep 05 17:40:18.245031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': 'b84a236f-3d97-4011-b0d9-0c42454895c1'} Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:40:18.246438 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. Sep 05 17:40:18.247529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:40:18.248623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0c51123f-8b00-41d1-ae2e-fb444c1f51f9 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Returning 404 to user: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:40:18.248623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0c51123f-8b00-41d1-ae2e-fb444c1f51f9 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 404 len: 111 microversion: 2.1 time: 0.043997 Sep 05 17:40:18.248623 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1313/2771] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:40:18 2022] DELETE /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:40:18.252031 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:40:18.252821 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=17 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:40:18.255268 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:40:18.255396 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:40:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 (ip 10.222.0.23) !!! Sep 05 17:40:18.267555 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8aba6455-f5c4-4226-b146-89c66c284844 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:40:18.268210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8aba6455-f5c4-4226-b146-89c66c284844 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: b84a236f-3d97-4011-b0d9-0c42454895c1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:40:18.275574 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aba6455-f5c4-4226-b146-89c66c284844 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:40:18.276047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aba6455-f5c4-4226-b146-89c66c284844 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:40:18.276581 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aba6455-f5c4-4226-b146-89c66c284844 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:40:18.277251 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aba6455-f5c4-4226-b146-89c66c284844 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:40:18.277694 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aba6455-f5c4-4226-b146-89c66c284844 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:40:18.278108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aba6455-f5c4-4226-b146-89c66c284844 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:40:18.292952 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-8aba6455-f5c4-4226-b146-89c66c284844 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] HTTP exception thrown: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8aba6455-f5c4-4226-b146-89c66c284844 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Request method failure captured: Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 HTTP/1.1 Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFiv_u9Fbkzz4N4EnwLFTHdVgGIHyTWZLVadgHsx5DjzJc71ULzFynHZ-XPxUeQAMj5CK9TClkqesRSKhjnpIv2d__HUGj1wgdznOqyEZDFoYmO3imZ0m9_h8uFe0RLmxeR8bY4quUM556Rumoa232jhk_i2qgcsiqF_5KIfw8vmSWkU Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:40:18.294474 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:40:18.295829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6ed4f1f1246408099252ebea491832c"}]}] Sep 05 17:40:18.295829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:18.295829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:40:18.295829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:18.295829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:40:18.295829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:40:18.295829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:40:18.295829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: 2b81fb00b1b545308d01f74a55b7e77b Sep 05 17:40:18.295829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:40:18.295829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:40:18.295829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. Sep 05 17:40:18.295829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': 'b84a236f-3d97-4011-b0d9-0c42454895c1'} Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:40:18.296558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. Sep 05 17:40:18.297524 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:40:18.298384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8aba6455-f5c4-4226-b146-89c66c284844 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Returning 404 to user: Instance b84a236f-3d97-4011-b0d9-0c42454895c1 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:40:18.298384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8aba6455-f5c4-4226-b146-89c66c284844 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1" status: 404 len: 111 microversion: 2.1 time: 0.045702 Sep 05 17:40:18.298384 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1459/2772] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:40:18 2022] GET /compute/v2.1/servers/b84a236f-3d97-4011-b0d9-0c42454895c1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:40:19.458947 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-db8579c3-56c2-412f-9fed-4a80450ae97f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:40:19.459474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-db8579c3-56c2-412f-9fed-4a80450ae97f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:40:19.466454 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db8579c3-56c2-412f-9fed-4a80450ae97f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:40:19.466935 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db8579c3-56c2-412f-9fed-4a80450ae97f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:40:19.467391 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db8579c3-56c2-412f-9fed-4a80450ae97f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:40:19.468069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db8579c3-56c2-412f-9fed-4a80450ae97f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:40:19.468542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db8579c3-56c2-412f-9fed-4a80450ae97f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:40:19.468953 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-db8579c3-56c2-412f-9fed-4a80450ae97f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:40:19.482406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-db8579c3-56c2-412f-9fed-4a80450ae97f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] HTTP exception thrown: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-db8579c3-56c2-412f-9fed-4a80450ae97f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Request method failure captured: Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: DELETE /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 HTTP/1.1 Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFiv_u9Fbkzz4N4EnwLFTHdVgGIHyTWZLVadgHsx5DjzJc71ULzFynHZ-XPxUeQAMj5CK9TClkqesRSKhjnpIv2d__HUGj1wgdznOqyEZDFoYmO3imZ0m9_h8uFe0RLmxeR8bY4quUM556Rumoa232jhk_i2qgcsiqF_5KIfw8vmSWkU Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:40:19.483914 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:40:19.485058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6ed4f1f1246408099252ebea491832c"}]}] Sep 05 17:40:19.485058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:19.485058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:40:19.485058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:19.485058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:40:19.485058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:40:19.485058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:40:19.485058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: 2b81fb00b1b545308d01f74a55b7e77b Sep 05 17:40:19.485058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:40:19.485058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:40:19.485058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. Sep 05 17:40:19.485058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': 'c69901d5-72a5-4e1d-af30-b7c680f90b73'} Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:40:19.485646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. Sep 05 17:40:19.486587 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:40:19.487899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-db8579c3-56c2-412f-9fed-4a80450ae97f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Returning 404 to user: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:40:19.487899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-db8579c3-56c2-412f-9fed-4a80450ae97f tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 404 len: 111 microversion: 2.1 time: 0.030269 Sep 05 17:40:19.487899 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1314/2773] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:40:19 2022] DELETE /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:40:19.494236 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2608dca4-0fa2-48e2-8370-67397db8fcd8 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:40:19.494818 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2608dca4-0fa2-48e2-8370-67397db8fcd8 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: c69901d5-72a5-4e1d-af30-b7c680f90b73] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:40:19.501931 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2608dca4-0fa2-48e2-8370-67397db8fcd8 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:40:19.502377 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2608dca4-0fa2-48e2-8370-67397db8fcd8 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:40:19.502802 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2608dca4-0fa2-48e2-8370-67397db8fcd8 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:40:19.503485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2608dca4-0fa2-48e2-8370-67397db8fcd8 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:40:19.503928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2608dca4-0fa2-48e2-8370-67397db8fcd8 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:40:19.504378 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2608dca4-0fa2-48e2-8370-67397db8fcd8 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:40:19.518115 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-2608dca4-0fa2-48e2-8370-67397db8fcd8 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] HTTP exception thrown: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2608dca4-0fa2-48e2-8370-67397db8fcd8 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Request method failure captured: Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 HTTP/1.1 Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFiv_u9Fbkzz4N4EnwLFTHdVgGIHyTWZLVadgHsx5DjzJc71ULzFynHZ-XPxUeQAMj5CK9TClkqesRSKhjnpIv2d__HUGj1wgdznOqyEZDFoYmO3imZ0m9_h8uFe0RLmxeR8bY4quUM556Rumoa232jhk_i2qgcsiqF_5KIfw8vmSWkU Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:40:19.519626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:40:19.520871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6ed4f1f1246408099252ebea491832c"}]}] Sep 05 17:40:19.520871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:19.520871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:40:19.520871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:19.520871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:40:19.520871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:40:19.520871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:40:19.520871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: 2b81fb00b1b545308d01f74a55b7e77b Sep 05 17:40:19.520871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:40:19.520871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:40:19.520871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. Sep 05 17:40:19.520871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': 'c69901d5-72a5-4e1d-af30-b7c680f90b73'} Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:40:19.522355 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. Sep 05 17:40:19.523567 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:40:19.524663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2608dca4-0fa2-48e2-8370-67397db8fcd8 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Returning 404 to user: Instance c69901d5-72a5-4e1d-af30-b7c680f90b73 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:40:19.524663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2608dca4-0fa2-48e2-8370-67397db8fcd8 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73" status: 404 len: 111 microversion: 2.1 time: 0.030888 Sep 05 17:40:19.524663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1460/2774] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:40:19 2022] GET /compute/v2.1/servers/c69901d5-72a5-4e1d-af30-b7c680f90b73 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:40:20.684569 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c76a6ccf-08f5-4b3b-b894-de406c4b11e5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:40:20.685068 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c76a6ccf-08f5-4b3b-b894-de406c4b11e5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:40:20.691793 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c76a6ccf-08f5-4b3b-b894-de406c4b11e5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:40:20.692384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c76a6ccf-08f5-4b3b-b894-de406c4b11e5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:40:20.692817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c76a6ccf-08f5-4b3b-b894-de406c4b11e5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:40:20.693581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c76a6ccf-08f5-4b3b-b894-de406c4b11e5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:40:20.694038 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c76a6ccf-08f5-4b3b-b894-de406c4b11e5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:40:20.694463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c76a6ccf-08f5-4b3b-b894-de406c4b11e5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:40:20.708285 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-c76a6ccf-08f5-4b3b-b894-de406c4b11e5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] HTTP exception thrown: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c76a6ccf-08f5-4b3b-b894-de406c4b11e5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Request method failure captured: Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: DELETE /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 HTTP/1.1 Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFiv_u9Fbkzz4N4EnwLFTHdVgGIHyTWZLVadgHsx5DjzJc71ULzFynHZ-XPxUeQAMj5CK9TClkqesRSKhjnpIv2d__HUGj1wgdznOqyEZDFoYmO3imZ0m9_h8uFe0RLmxeR8bY4quUM556Rumoa232jhk_i2qgcsiqF_5KIfw8vmSWkU Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:40:20.709837 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:40:20.711109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6ed4f1f1246408099252ebea491832c"}]}] Sep 05 17:40:20.711109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:20.711109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:40:20.711109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:20.711109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:40:20.711109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:40:20.711109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:40:20.711109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: 2b81fb00b1b545308d01f74a55b7e77b Sep 05 17:40:20.711109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:40:20.711109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:40:20.711109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. Sep 05 17:40:20.711109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': 'e647f8e8-c663-4226-a839-4e44249e4955'} Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:40:20.712191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. Sep 05 17:40:20.713384 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:40:20.714580 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c76a6ccf-08f5-4b3b-b894-de406c4b11e5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Returning 404 to user: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:40:20.714580 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c76a6ccf-08f5-4b3b-b894-de406c4b11e5 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 404 len: 111 microversion: 2.1 time: 0.030782 Sep 05 17:40:20.714580 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1315/2775] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:40:20 2022] DELETE /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:40:20.721917 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fe81e14c-8e8c-4d33-bf4e-2ac8778978c3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:40:20.722497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fe81e14c-8e8c-4d33-bf4e-2ac8778978c3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] [instance: e647f8e8-c663-4226-a839-4e44249e4955] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:40:20.730991 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe81e14c-8e8c-4d33-bf4e-2ac8778978c3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:40:20.731782 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe81e14c-8e8c-4d33-bf4e-2ac8778978c3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:40:20.732534 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe81e14c-8e8c-4d33-bf4e-2ac8778978c3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:40:20.734155 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe81e14c-8e8c-4d33-bf4e-2ac8778978c3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:40:20.735970 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe81e14c-8e8c-4d33-bf4e-2ac8778978c3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:40:20.736434 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe81e14c-8e8c-4d33-bf4e-2ac8778978c3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:40:20.750785 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-fe81e14c-8e8c-4d33-bf4e-2ac8778978c3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] HTTP exception thrown: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fe81e14c-8e8c-4d33-bf4e-2ac8778978c3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Request method failure captured: Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 HTTP/1.1 Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFiv_u9Fbkzz4N4EnwLFTHdVgGIHyTWZLVadgHsx5DjzJc71ULzFynHZ-XPxUeQAMj5CK9TClkqesRSKhjnpIv2d__HUGj1wgdznOqyEZDFoYmO3imZ0m9_h8uFe0RLmxeR8bY4quUM556Rumoa232jhk_i2qgcsiqF_5KIfw8vmSWkU Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:40:20.752349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:40:20.753758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6ed4f1f1246408099252ebea491832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6ed4f1f1246408099252ebea491832c"}]}] Sep 05 17:40:20.753758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:20.753758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: c6ed4f1f1246408099252ebea491832c Sep 05 17:40:20.753758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1686170102 Sep 05 17:40:20.753758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:40:20.753758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:40:20.753758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:40:20.753758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: 2b81fb00b1b545308d01f74a55b7e77b Sep 05 17:40:20.753758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeNegativeTest-1686170102-project Sep 05 17:40:20.753758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:40:20.753758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. Sep 05 17:40:20.753758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': 'e647f8e8-c663-4226-a839-4e44249e4955'} Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:40:20.754449 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. Sep 05 17:40:20.755624 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:40:20.756915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fe81e14c-8e8c-4d33-bf4e-2ac8778978c3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] Returning 404 to user: Instance e647f8e8-c663-4226-a839-4e44249e4955 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:40:20.756915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fe81e14c-8e8c-4d33-bf4e-2ac8778978c3 tempest-AttachVolumeNegativeTest-1686170102 tempest-AttachVolumeNegativeTest-1686170102-project] 10.222.0.23 "GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955" status: 404 len: 111 microversion: 2.1 time: 0.036693 Sep 05 17:40:20.756915 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1461/2776] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:40:20 2022] GET /compute/v2.1/servers/e647f8e8-c663-4226-a839-4e44249e4955 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:41:07.344740 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-25247099", "imageRef": "c1a4f3d3-4d68-489a-a57b-bae7854beb29", "flavorRef": "452"}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:41:07.352136 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=6 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:41:07.352787 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=6 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:41:07.404809 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.network.neutron [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] validate_networks() for None {{(pid=120733) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:41:07.690092 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Flavor limits 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:41:07.690706 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Image limits 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:41:07.691327 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Flavor pref 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:41:07.691895 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Image pref 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:41:07.692518 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:41:07.705448 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:07.706106 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:07.706734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:07.707845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:07.708487 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:07.708915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:07.725625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Getting quotas for project 448baffb86284acda27f4470b2c85c07. Resources: {'ram', 'cores', 'instances'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:41:07.729612 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Getting quotas for user e0d73370a2e54b92b3094522335466d9 and project 448baffb86284acda27f4470b2c85c07. Resources: {'ram', 'cores', 'instances'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:41:07.740091 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Going to run 1 instances... {{(pid=120733) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:41:07.742380 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a4f3d3-4d68-489a-a57b-bae7854beb29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120733) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:41:07.795699 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-4e9f8cca-967b-41f9-8cd1-b3ce159cc295 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.454765 Sep 05 17:41:07.796495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1316/2777] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:41:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 17:41:07.808238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ce9b575e-bb6e-4f53-8500-a1a685fcbbba tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:07.808822 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ce9b575e-bb6e-4f53-8500-a1a685fcbbba tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:07.810876 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=6 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:41:07.811476 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=6 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:41:07.869022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ce9b575e-bb6e-4f53-8500-a1a685fcbbba tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d73370a2e54b92b3094522335466d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448baffb86284acda27f4470b2c85c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:41:07.875931 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ce9b575e-bb6e-4f53-8500-a1a685fcbbba tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 200 len: 1213 microversion: 2.1 time: 0.071783 Sep 05 17:41:07.876528 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1462/2778] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:41:07 2022] GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:41:08.898701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-1b4342fb-d94a-4e09-99bd-cb4ab93c04cd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:08.899273 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-1b4342fb-d94a-4e09-99bd-cb4ab93c04cd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:08.906422 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b4342fb-d94a-4e09-99bd-cb4ab93c04cd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:08.906906 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b4342fb-d94a-4e09-99bd-cb4ab93c04cd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:08.907358 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b4342fb-d94a-4e09-99bd-cb4ab93c04cd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:08.908009 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b4342fb-d94a-4e09-99bd-cb4ab93c04cd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:08.908490 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b4342fb-d94a-4e09-99bd-cb4ab93c04cd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:08.908903 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-1b4342fb-d94a-4e09-99bd-cb4ab93c04cd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:08.972002 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-1b4342fb-d94a-4e09-99bd-cb4ab93c04cd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d73370a2e54b92b3094522335466d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448baffb86284acda27f4470b2c85c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:41:08.980488 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-1b4342fb-d94a-4e09-99bd-cb4ab93c04cd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 200 len: 1265 microversion: 2.1 time: 0.086190 Sep 05 17:41:08.981046 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1317/2779] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:41:08 2022] GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:41:10.006682 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-267ecdb2-de97-462a-ba44-0c29d1acbf7a tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:10.007305 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-267ecdb2-de97-462a-ba44-0c29d1acbf7a tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:10.015558 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-267ecdb2-de97-462a-ba44-0c29d1acbf7a tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:10.016108 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-267ecdb2-de97-462a-ba44-0c29d1acbf7a tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:10.016589 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-267ecdb2-de97-462a-ba44-0c29d1acbf7a tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:10.017362 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-267ecdb2-de97-462a-ba44-0c29d1acbf7a tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:10.017826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-267ecdb2-de97-462a-ba44-0c29d1acbf7a tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:10.018247 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-267ecdb2-de97-462a-ba44-0c29d1acbf7a tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:10.226580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-267ecdb2-de97-462a-ba44-0c29d1acbf7a tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d73370a2e54b92b3094522335466d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448baffb86284acda27f4470b2c85c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:41:10.236959 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-267ecdb2-de97-462a-ba44-0c29d1acbf7a tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 200 len: 1313 microversion: 2.1 time: 0.234707 Sep 05 17:41:10.237519 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1463/2780] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:41:10 2022] GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:41:10.819524 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-ab89b1b0-73f2-49ce-8902-0575cc27408b req-98162637-e308-4ce1-b3b6-cfd4e198addb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a", "tag": "49579994-2b8f-492b-9550-bb819ad8da8f"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:41:10.832974 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-ab89b1b0-73f2-49ce-8902-0575cc27408b req-98162637-e308-4ce1-b3b6-cfd4e198addb service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:10.833453 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-ab89b1b0-73f2-49ce-8902-0575cc27408b req-98162637-e308-4ce1-b3b6-cfd4e198addb service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:10.834006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-ab89b1b0-73f2-49ce-8902-0575cc27408b req-98162637-e308-4ce1-b3b6-cfd4e198addb service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:10.847126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-ab89b1b0-73f2-49ce-8902-0575cc27408b req-98162637-e308-4ce1-b3b6-cfd4e198addb service nova] Creating event network-changed:49579994-2b8f-492b-9550-bb819ad8da8f for instance ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a on hv-cinder-85596 Sep 05 17:41:10.853425 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-ab89b1b0-73f2-49ce-8902-0575cc27408b req-98162637-e308-4ce1-b3b6-cfd4e198addb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037771 Sep 05 17:41:10.854026 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1318/2781] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:41:11.260596 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-314f7828-d74a-4f73-b170-776a06682a5c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:11.261198 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-314f7828-d74a-4f73-b170-776a06682a5c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:11.267871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-314f7828-d74a-4f73-b170-776a06682a5c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:11.268397 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-314f7828-d74a-4f73-b170-776a06682a5c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:11.268838 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-314f7828-d74a-4f73-b170-776a06682a5c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:11.269539 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-314f7828-d74a-4f73-b170-776a06682a5c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:11.269998 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-314f7828-d74a-4f73-b170-776a06682a5c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:11.270454 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-314f7828-d74a-4f73-b170-776a06682a5c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:11.404099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-314f7828-d74a-4f73-b170-776a06682a5c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d73370a2e54b92b3094522335466d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448baffb86284acda27f4470b2c85c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:41:11.412410 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-314f7828-d74a-4f73-b170-776a06682a5c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 200 len: 1313 microversion: 2.1 time: 0.155699 Sep 05 17:41:11.413026 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1464/2782] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:41:11 2022] GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:41:12.440868 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e77c78c3-4044-450a-937f-be47f7ac7435 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:12.442006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e77c78c3-4044-450a-937f-be47f7ac7435 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:12.454762 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e77c78c3-4044-450a-937f-be47f7ac7435 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:12.455505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e77c78c3-4044-450a-937f-be47f7ac7435 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:12.456232 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e77c78c3-4044-450a-937f-be47f7ac7435 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:12.457371 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e77c78c3-4044-450a-937f-be47f7ac7435 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:12.458111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e77c78c3-4044-450a-937f-be47f7ac7435 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:12.458887 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e77c78c3-4044-450a-937f-be47f7ac7435 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:12.595944 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e77c78c3-4044-450a-937f-be47f7ac7435 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d73370a2e54b92b3094522335466d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448baffb86284acda27f4470b2c85c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:41:12.604296 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e77c78c3-4044-450a-937f-be47f7ac7435 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 200 len: 1313 microversion: 2.1 time: 0.171272 Sep 05 17:41:12.604883 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1319/2783] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:41:12 2022] GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:41:13.631225 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-56721aaf-8262-4784-9778-0034a859b884 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:13.631697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-56721aaf-8262-4784-9778-0034a859b884 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:13.638564 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56721aaf-8262-4784-9778-0034a859b884 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:13.639049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56721aaf-8262-4784-9778-0034a859b884 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:13.639482 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56721aaf-8262-4784-9778-0034a859b884 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:13.640185 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56721aaf-8262-4784-9778-0034a859b884 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:13.640671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56721aaf-8262-4784-9778-0034a859b884 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:13.641099 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56721aaf-8262-4784-9778-0034a859b884 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:13.780366 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-56721aaf-8262-4784-9778-0034a859b884 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d73370a2e54b92b3094522335466d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448baffb86284acda27f4470b2c85c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:41:13.788798 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-56721aaf-8262-4784-9778-0034a859b884 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 200 len: 1313 microversion: 2.1 time: 0.164335 Sep 05 17:41:13.789345 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1465/2784] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:41:13 2022] GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:41:14.821757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f6233888-59ad-4b2c-9c9f-ae8abc8508bd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:14.822510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f6233888-59ad-4b2c-9c9f-ae8abc8508bd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:14.830802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6233888-59ad-4b2c-9c9f-ae8abc8508bd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:14.831402 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6233888-59ad-4b2c-9c9f-ae8abc8508bd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:14.831942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6233888-59ad-4b2c-9c9f-ae8abc8508bd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:14.832832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6233888-59ad-4b2c-9c9f-ae8abc8508bd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:14.833395 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6233888-59ad-4b2c-9c9f-ae8abc8508bd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:14.833949 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f6233888-59ad-4b2c-9c9f-ae8abc8508bd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:14.979978 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f6233888-59ad-4b2c-9c9f-ae8abc8508bd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d73370a2e54b92b3094522335466d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448baffb86284acda27f4470b2c85c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:41:14.988212 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f6233888-59ad-4b2c-9c9f-ae8abc8508bd tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 200 len: 1313 microversion: 2.1 time: 0.172067 Sep 05 17:41:14.988788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1320/2785] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:41:14 2022] GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:41:16.015631 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c799682b-a655-4645-90cd-8d19ae1d557b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:16.016612 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c799682b-a655-4645-90cd-8d19ae1d557b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:16.027583 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c799682b-a655-4645-90cd-8d19ae1d557b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:16.028452 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c799682b-a655-4645-90cd-8d19ae1d557b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:16.029190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c799682b-a655-4645-90cd-8d19ae1d557b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:16.030343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c799682b-a655-4645-90cd-8d19ae1d557b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:16.031101 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c799682b-a655-4645-90cd-8d19ae1d557b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:16.031811 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c799682b-a655-4645-90cd-8d19ae1d557b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:16.173575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c799682b-a655-4645-90cd-8d19ae1d557b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d73370a2e54b92b3094522335466d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448baffb86284acda27f4470b2c85c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:41:16.182175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c799682b-a655-4645-90cd-8d19ae1d557b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 200 len: 1313 microversion: 2.1 time: 0.173293 Sep 05 17:41:16.182747 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1466/2786] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:41:16 2022] GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:41:17.210246 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a456151a-54a2-44f0-a91e-2a411b8a6d48 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:17.211469 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a456151a-54a2-44f0-a91e-2a411b8a6d48 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:17.222228 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a456151a-54a2-44f0-a91e-2a411b8a6d48 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:17.223017 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a456151a-54a2-44f0-a91e-2a411b8a6d48 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:17.223717 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a456151a-54a2-44f0-a91e-2a411b8a6d48 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:17.224877 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a456151a-54a2-44f0-a91e-2a411b8a6d48 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:17.225571 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a456151a-54a2-44f0-a91e-2a411b8a6d48 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:17.225989 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a456151a-54a2-44f0-a91e-2a411b8a6d48 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:17.368565 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-a456151a-54a2-44f0-a91e-2a411b8a6d48 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d73370a2e54b92b3094522335466d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448baffb86284acda27f4470b2c85c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:41:17.377036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a456151a-54a2-44f0-a91e-2a411b8a6d48 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 200 len: 1313 microversion: 2.1 time: 0.173700 Sep 05 17:41:17.377620 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1321/2787] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:41:17 2022] GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:41:18.329095 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-7669114f-972f-4da1-8b5a-06552f09f3d7 req-16e5b82b-029e-4f48-951b-34e64e1af900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a", "name": "network-vif-plugged", "status": "completed", "tag": "49579994-2b8f-492b-9550-bb819ad8da8f"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:41:18.335746 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:41:18.340047 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-7669114f-972f-4da1-8b5a-06552f09f3d7 req-16e5b82b-029e-4f48-951b-34e64e1af900 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:18.340653 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-7669114f-972f-4da1-8b5a-06552f09f3d7 req-16e5b82b-029e-4f48-951b-34e64e1af900 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:18.341142 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-7669114f-972f-4da1-8b5a-06552f09f3d7 req-16e5b82b-029e-4f48-951b-34e64e1af900 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:18.352987 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-7669114f-972f-4da1-8b5a-06552f09f3d7 req-16e5b82b-029e-4f48-951b-34e64e1af900 service nova] Creating event network-vif-plugged:49579994-2b8f-492b-9550-bb819ad8da8f for instance ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a on hv-cinder-85596 Sep 05 17:41:18.358356 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-7669114f-972f-4da1-8b5a-06552f09f3d7 req-16e5b82b-029e-4f48-951b-34e64e1af900 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033144 Sep 05 17:41:18.358978 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1467/2788] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:41:18.407553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-74870f3b-0a83-47e4-880f-aece0de06b8c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:18.408285 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-74870f3b-0a83-47e4-880f-aece0de06b8c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:18.411853 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=2 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:41:18.413817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=6 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:41:18.424015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74870f3b-0a83-47e4-880f-aece0de06b8c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:18.424736 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74870f3b-0a83-47e4-880f-aece0de06b8c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:18.425328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74870f3b-0a83-47e4-880f-aece0de06b8c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:18.426358 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74870f3b-0a83-47e4-880f-aece0de06b8c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:18.427039 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74870f3b-0a83-47e4-880f-aece0de06b8c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:18.427669 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-74870f3b-0a83-47e4-880f-aece0de06b8c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:18.591441 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-74870f3b-0a83-47e4-880f-aece0de06b8c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d73370a2e54b92b3094522335466d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448baffb86284acda27f4470b2c85c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:41:18.600763 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-74870f3b-0a83-47e4-880f-aece0de06b8c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 200 len: 1313 microversion: 2.1 time: 0.197494 Sep 05 17:41:18.601379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1322/2789] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:41:18 2022] GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:41:19.630064 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9661d4e8-5175-4a61-96cc-7c4c1d9e6e26 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:19.631182 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9661d4e8-5175-4a61-96cc-7c4c1d9e6e26 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:19.638245 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9661d4e8-5175-4a61-96cc-7c4c1d9e6e26 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:19.638735 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9661d4e8-5175-4a61-96cc-7c4c1d9e6e26 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:19.639167 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9661d4e8-5175-4a61-96cc-7c4c1d9e6e26 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:19.639863 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9661d4e8-5175-4a61-96cc-7c4c1d9e6e26 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:19.640360 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9661d4e8-5175-4a61-96cc-7c4c1d9e6e26 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:19.640789 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9661d4e8-5175-4a61-96cc-7c4c1d9e6e26 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:19.784609 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9661d4e8-5175-4a61-96cc-7c4c1d9e6e26 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d73370a2e54b92b3094522335466d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448baffb86284acda27f4470b2c85c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:41:19.792723 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9661d4e8-5175-4a61-96cc-7c4c1d9e6e26 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 200 len: 1313 microversion: 2.1 time: 0.171006 Sep 05 17:41:19.793325 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1468/2790] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:41:19 2022] GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:41:20.822001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-54c28c0b-f110-43b3-863e-1cc4a19e529b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:20.822574 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-54c28c0b-f110-43b3-863e-1cc4a19e529b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:20.829244 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54c28c0b-f110-43b3-863e-1cc4a19e529b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:20.829749 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54c28c0b-f110-43b3-863e-1cc4a19e529b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:20.830196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54c28c0b-f110-43b3-863e-1cc4a19e529b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:20.830909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54c28c0b-f110-43b3-863e-1cc4a19e529b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:20.831495 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54c28c0b-f110-43b3-863e-1cc4a19e529b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:20.831955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-54c28c0b-f110-43b3-863e-1cc4a19e529b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:20.963402 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-54c28c0b-f110-43b3-863e-1cc4a19e529b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d73370a2e54b92b3094522335466d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448baffb86284acda27f4470b2c85c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:41:20.971390 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-54c28c0b-f110-43b3-863e-1cc4a19e529b tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 200 len: 1462 microversion: 2.1 time: 0.154895 Sep 05 17:41:20.971939 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1323/2791] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:41:20 2022] GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 1462 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:41:21.018318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6fa82b13-25d0-46c2-af7d-268a547e06da tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:21.018813 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6fa82b13-25d0-46c2-af7d-268a547e06da tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:21.025459 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fa82b13-25d0-46c2-af7d-268a547e06da tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:21.025939 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fa82b13-25d0-46c2-af7d-268a547e06da tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:21.026373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fa82b13-25d0-46c2-af7d-268a547e06da tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:21.027056 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fa82b13-25d0-46c2-af7d-268a547e06da tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:21.027504 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fa82b13-25d0-46c2-af7d-268a547e06da tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:21.027925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fa82b13-25d0-46c2-af7d-268a547e06da tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:21.053839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6fa82b13-25d0-46c2-af7d-268a547e06da tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:41:21.146254 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6fa82b13-25d0-46c2-af7d-268a547e06da tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 204 len: 0 microversion: 2.1 time: 0.131598 Sep 05 17:41:21.146895 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1469/2792] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:41:21 2022] DELETE /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:41:21.155085 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3503f7b1-a69f-449e-93c5-9fb4e628441c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:21.155690 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3503f7b1-a69f-449e-93c5-9fb4e628441c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:21.161662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3503f7b1-a69f-449e-93c5-9fb4e628441c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:21.162124 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3503f7b1-a69f-449e-93c5-9fb4e628441c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:21.162693 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3503f7b1-a69f-449e-93c5-9fb4e628441c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:21.163365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3503f7b1-a69f-449e-93c5-9fb4e628441c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:21.163827 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3503f7b1-a69f-449e-93c5-9fb4e628441c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:21.164267 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3503f7b1-a69f-449e-93c5-9fb4e628441c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:21.301290 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3503f7b1-a69f-449e-93c5-9fb4e628441c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d73370a2e54b92b3094522335466d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448baffb86284acda27f4470b2c85c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:41:21.310103 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3503f7b1-a69f-449e-93c5-9fb4e628441c tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 200 len: 1468 microversion: 2.1 time: 0.158837 Sep 05 17:41:21.310673 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1324/2793] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:41:21 2022] GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 1468 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:41:22.338979 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-102594e0-9de9-4502-87af-7774bd3c7590 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:22.340120 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-102594e0-9de9-4502-87af-7774bd3c7590 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:22.350781 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-102594e0-9de9-4502-87af-7774bd3c7590 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:22.351265 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-102594e0-9de9-4502-87af-7774bd3c7590 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:22.351683 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-102594e0-9de9-4502-87af-7774bd3c7590 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:22.352401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-102594e0-9de9-4502-87af-7774bd3c7590 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:22.352868 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-102594e0-9de9-4502-87af-7774bd3c7590 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:22.353281 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-102594e0-9de9-4502-87af-7774bd3c7590 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:22.509649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-102594e0-9de9-4502-87af-7774bd3c7590 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d73370a2e54b92b3094522335466d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448baffb86284acda27f4470b2c85c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:41:22.517839 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-102594e0-9de9-4502-87af-7774bd3c7590 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 200 len: 1468 microversion: 2.1 time: 0.186448 Sep 05 17:41:22.518407 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1470/2794] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:41:22 2022] GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 1468 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:41:23.403480 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-036c42d8-9ca1-4df7-8cde-57b7e9cabc55 req-030ba6b2-05a5-4e9d-98eb-8bde0603e191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a", "name": "network-vif-deleted", "tag": "49579994-2b8f-492b-9550-bb819ad8da8f"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:41:23.413219 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-036c42d8-9ca1-4df7-8cde-57b7e9cabc55 req-030ba6b2-05a5-4e9d-98eb-8bde0603e191 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:23.413686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-036c42d8-9ca1-4df7-8cde-57b7e9cabc55 req-030ba6b2-05a5-4e9d-98eb-8bde0603e191 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:23.414102 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-036c42d8-9ca1-4df7-8cde-57b7e9cabc55 req-030ba6b2-05a5-4e9d-98eb-8bde0603e191 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:23.425080 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-036c42d8-9ca1-4df7-8cde-57b7e9cabc55 req-030ba6b2-05a5-4e9d-98eb-8bde0603e191 service nova] Creating event network-vif-deleted:49579994-2b8f-492b-9550-bb819ad8da8f for instance ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a on hv-cinder-85596 Sep 05 17:41:23.430375 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-036c42d8-9ca1-4df7-8cde-57b7e9cabc55 req-030ba6b2-05a5-4e9d-98eb-8bde0603e191 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190005 Sep 05 17:41:23.430971 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1325/2795] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:41:23.544060 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-26411b15-ebe9-4033-8d39-92433a81eba1 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:23.544890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-26411b15-ebe9-4033-8d39-92433a81eba1 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:23.554391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26411b15-ebe9-4033-8d39-92433a81eba1 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:23.555067 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26411b15-ebe9-4033-8d39-92433a81eba1 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:23.555677 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26411b15-ebe9-4033-8d39-92433a81eba1 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:23.556693 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26411b15-ebe9-4033-8d39-92433a81eba1 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:23.557327 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26411b15-ebe9-4033-8d39-92433a81eba1 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:23.557931 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26411b15-ebe9-4033-8d39-92433a81eba1 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:23.595209 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26411b15-ebe9-4033-8d39-92433a81eba1 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:23.595678 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26411b15-ebe9-4033-8d39-92433a81eba1 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:23.596102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26411b15-ebe9-4033-8d39-92433a81eba1 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:23.596570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-26411b15-ebe9-4033-8d39-92433a81eba1 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lazy-loading 'fault' on Instance uuid ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:41:23.637752 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-26411b15-ebe9-4033-8d39-92433a81eba1 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d73370a2e54b92b3094522335466d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448baffb86284acda27f4470b2c85c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:41:23.645399 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-26411b15-ebe9-4033-8d39-92433a81eba1 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 200 len: 1303 microversion: 2.1 time: 0.106873 Sep 05 17:41:23.645960 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1471/2796] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:41:23 2022] GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:41:24.671647 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9354c498-bf5b-4aba-ad81-31513aacafc0 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:41:24.672490 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9354c498-bf5b-4aba-ad81-31513aacafc0 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] [instance: ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:41:24.680585 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9354c498-bf5b-4aba-ad81-31513aacafc0 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:24.681256 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9354c498-bf5b-4aba-ad81-31513aacafc0 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:24.681870 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9354c498-bf5b-4aba-ad81-31513aacafc0 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:24.682851 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9354c498-bf5b-4aba-ad81-31513aacafc0 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:41:24.683383 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9354c498-bf5b-4aba-ad81-31513aacafc0 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:41:24.683808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9354c498-bf5b-4aba-ad81-31513aacafc0 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:41:24.706251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-9354c498-bf5b-4aba-ad81-31513aacafc0 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] HTTP exception thrown: Instance ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a could not be found. Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9354c498-bf5b-4aba-ad81-31513aacafc0 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Request method failure captured: Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a HTTP/1.1 Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFjSxjaLsTR83q404mgsxqh3_dDhIZjIdeCM3DmB-xWPikrX418FT13GDRmxttuwhEFTncK7mhwLkjo7l30vEyBcfMZeEKpOjiLnSE1UVCTXIimlggFHQlr8UN2nTq7JELX85OEjS-6dTlE3AtWFt9kgaDlySXkKMb5Y6G71DFLK-tUc Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: 448baffb86284acda27f4470b2c85c07 Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-VolumesNegativeTest-1534895718 Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:41:24.708744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:41:24.710128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/448baffb86284acda27f4470b2c85c07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/448baffb86284acda27f4470b2c85c07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/448baffb86284acda27f4470b2c85c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_448baffb86284acda27f4470b2c85c07"}]}] Sep 05 17:41:24.710128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-VolumesNegativeTest-1534895718 Sep 05 17:41:24.710128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: 448baffb86284acda27f4470b2c85c07 Sep 05 17:41:24.710128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-VolumesNegativeTest-1534895718 Sep 05 17:41:24.710128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-VolumesNegativeTest-1534895718-project Sep 05 17:41:24.710128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:41:24.710128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:41:24.710128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: e0d73370a2e54b92b3094522335466d9 Sep 05 17:41:24.710128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-VolumesNegativeTest-1534895718-project Sep 05 17:41:24.710128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:41:24.710128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a could not be found. Sep 05 17:41:24.710128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': 'ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a'} Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a could not be found. Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:41:24.710921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a could not be found. Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a could not be found. Sep 05 17:41:24.712553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:41:24.713734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9354c498-bf5b-4aba-ad81-31513aacafc0 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] Returning 404 to user: Instance ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:41:24.713734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9354c498-bf5b-4aba-ad81-31513aacafc0 tempest-VolumesNegativeTest-1534895718 tempest-VolumesNegativeTest-1534895718-project] 10.222.0.23 "GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a" status: 404 len: 111 microversion: 2.1 time: 0.044142 Sep 05 17:41:24.713734 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1326/2797] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:41:24 2022] GET /compute/v2.1/servers/ea640a8f-dc6c-4208-ace7-bf2cabcb6a3a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:42:03.692117 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:42:03.693958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:42:03.695501 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:42:03.695806 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:42:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.23) !!! Sep 05 17:42:03.881700 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-48807e17-0ce4-4b1c-9667-0098af641c7e tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Action: 'create', calling method: .version_select at 0x7f1d3ad2e0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-925738388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSuumTeS8yjlaxSclQXmxXUx+Sgf0+wfp2Q/LmgJTjs/ifJGIWnFUn9RhFzMrY78T19p97061R32OmsSpbZ/QtfXZLbvwsFwkKkeanym7biI0156q3gLAkOExNbEPlOnw=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:42:03.917434 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-48807e17-0ce4-4b1c-9667-0098af641c7e tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Getting quotas for project 668b8711b6fd422b9e58f852c1801569. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:42:03.924869 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-48807e17-0ce4-4b1c-9667-0098af641c7e tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Getting quotas for user f0a8514ae867426c80200fbc90435c6d and project 668b8711b6fd422b9e58f852c1801569. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:42:03.968637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-48807e17-0ce4-4b1c-9667-0098af641c7e tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.281848 Sep 05 17:42:03.975622 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1472/2798] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Sep 5 17:42:03 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:42:28.836513 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:42:28.837253 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=50 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:42:28.841900 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1656384116", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-925738388", "security_groups": [{"name": "tempest-secgroup-smoke-1127860032"}], "networks": [{"uuid": "9df0cf9c-8390-4244-9cd2-ecba5ffab766"}], "block_device_mapping_v2": [{"uuid": "25567824-1c8f-4aa7-9ff0-8df01a2fa210", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:42:28.970635 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.network.neutron [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] validate_networks() for [('9df0cf9c-8390-4244-9cd2-ecba5ffab766', None, None, None, None, None)] {{(pid=120733) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 17:42:29.518845 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Flavor limits 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 17:42:29.519460 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Image limits 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 17:42:29.520141 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Flavor pref 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 17:42:29.520759 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Image pref 0:0:0 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 17:42:29.521393 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.virt.hardware [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120733) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 17:42:29.534534 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:29.535007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:29.535433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:29.536140 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:29.536622 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:29.537034 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:29.555399 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Getting quotas for project 668b8711b6fd422b9e58f852c1801569. Resources: {'ram', 'cores', 'instances'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 17:42:29.559478 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.quota [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Getting quotas for user f0a8514ae867426c80200fbc90435c6d and project 668b8711b6fd422b9e58f852c1801569. Resources: {'ram', 'cores', 'instances'} {{(pid=120733) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 17:42:29.616863 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Going to run 1 instances... {{(pid=120733) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 17:42:29.618962 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='25567824-1c8f-4aa7-9ff0-8df01a2fa210',volume_size=None,volume_type=None)] {{(pid=120733) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 17:42:29.759957 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-325aa3fe-7dd4-4050-b589-f3827a010195 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.925740 Sep 05 17:42:29.760697 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1327/2799] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Sep 5 17:42:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 17:42:29.769391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=4 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:42:29.770203 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:42:29.775369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-af206f3c-f4da-44ce-a447-010d10c9fc4c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:42:29.778174 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-af206f3c-f4da-44ce-a447-010d10c9fc4c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:42:29.833910 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-af206f3c-f4da-44ce-a447-010d10c9fc4c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:42:29.842052 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-af206f3c-f4da-44ce-a447-010d10c9fc4c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1088 microversion: 2.1 time: 0.074228 Sep 05 17:42:29.842605 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1473/2800] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:42:29 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:42:30.867367 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-32208b58-4948-43f7-b434-952aef9f38d1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:42:30.867967 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-32208b58-4948-43f7-b434-952aef9f38d1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:42:30.875552 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32208b58-4948-43f7-b434-952aef9f38d1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:30.876065 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32208b58-4948-43f7-b434-952aef9f38d1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:30.876744 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32208b58-4948-43f7-b434-952aef9f38d1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:30.877468 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32208b58-4948-43f7-b434-952aef9f38d1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:30.877958 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32208b58-4948-43f7-b434-952aef9f38d1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:30.878379 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-32208b58-4948-43f7-b434-952aef9f38d1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:30.949921 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-32208b58-4948-43f7-b434-952aef9f38d1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:42:30.958492 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-32208b58-4948-43f7-b434-952aef9f38d1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1186 microversion: 2.1 time: 0.095193 Sep 05 17:42:30.959072 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1328/2801] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:42:30 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1186 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:42:31.983390 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-edf5d5e0-d42b-4429-8e81-6e12440af189 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:42:31.984983 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-edf5d5e0-d42b-4429-8e81-6e12440af189 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:42:31.996485 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edf5d5e0-d42b-4429-8e81-6e12440af189 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:31.997216 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edf5d5e0-d42b-4429-8e81-6e12440af189 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:31.997832 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edf5d5e0-d42b-4429-8e81-6e12440af189 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:31.998840 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edf5d5e0-d42b-4429-8e81-6e12440af189 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:31.999387 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edf5d5e0-d42b-4429-8e81-6e12440af189 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:31.999892 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edf5d5e0-d42b-4429-8e81-6e12440af189 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:32.470958 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-edf5d5e0-d42b-4429-8e81-6e12440af189 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:42:32.479353 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-edf5d5e0-d42b-4429-8e81-6e12440af189 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1260 microversion: 2.1 time: 0.500228 Sep 05 17:42:32.479934 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1474/2802] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:42:31 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1260 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:42:32.873451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-6eeb479d-2827-4333-b059-910367baeff5 req-509ecde7-5d78-4bdb-a36b-9c3f9f6616cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ef497e1-25c6-4e3b-930a-4ed31e1b956b", "tag": "47d789fe-1b05-46cd-b623-afedca04c82c"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:42:32.884068 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-6eeb479d-2827-4333-b059-910367baeff5 req-509ecde7-5d78-4bdb-a36b-9c3f9f6616cb service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:32.884542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-6eeb479d-2827-4333-b059-910367baeff5 req-509ecde7-5d78-4bdb-a36b-9c3f9f6616cb service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:32.885005 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-6eeb479d-2827-4333-b059-910367baeff5 req-509ecde7-5d78-4bdb-a36b-9c3f9f6616cb service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:32.898409 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-6eeb479d-2827-4333-b059-910367baeff5 req-509ecde7-5d78-4bdb-a36b-9c3f9f6616cb service nova] Creating event network-changed:47d789fe-1b05-46cd-b623-afedca04c82c for instance 8ef497e1-25c6-4e3b-930a-4ed31e1b956b on hv-cinder-85596 Sep 05 17:42:32.903627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-6eeb479d-2827-4333-b059-910367baeff5 req-509ecde7-5d78-4bdb-a36b-9c3f9f6616cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034148 Sep 05 17:42:32.904251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1329/2803] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:42:33.505102 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2dd60093-b7a7-4819-9844-948f5e6da55b tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:42:33.505637 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2dd60093-b7a7-4819-9844-948f5e6da55b tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:42:33.512525 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2dd60093-b7a7-4819-9844-948f5e6da55b tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:33.513016 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2dd60093-b7a7-4819-9844-948f5e6da55b tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:33.513451 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2dd60093-b7a7-4819-9844-948f5e6da55b tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:33.514147 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2dd60093-b7a7-4819-9844-948f5e6da55b tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:33.514606 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2dd60093-b7a7-4819-9844-948f5e6da55b tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:33.515009 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2dd60093-b7a7-4819-9844-948f5e6da55b tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:33.654402 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2dd60093-b7a7-4819-9844-948f5e6da55b tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:42:33.662698 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2dd60093-b7a7-4819-9844-948f5e6da55b tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1260 microversion: 2.1 time: 0.162266 Sep 05 17:42:33.663250 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1475/2804] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:42:33 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:42:34.687248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-aea90fe9-b4de-4718-8649-625fe7ba7c51 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:42:34.688015 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-aea90fe9-b4de-4718-8649-625fe7ba7c51 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:42:34.697463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aea90fe9-b4de-4718-8649-625fe7ba7c51 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:34.698176 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aea90fe9-b4de-4718-8649-625fe7ba7c51 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:34.699111 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aea90fe9-b4de-4718-8649-625fe7ba7c51 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:34.700203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aea90fe9-b4de-4718-8649-625fe7ba7c51 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:34.700866 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aea90fe9-b4de-4718-8649-625fe7ba7c51 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:34.701952 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-aea90fe9-b4de-4718-8649-625fe7ba7c51 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:34.910049 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-aea90fe9-b4de-4718-8649-625fe7ba7c51 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:42:34.922679 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-aea90fe9-b4de-4718-8649-625fe7ba7c51 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1260 microversion: 2.1 time: 0.240740 Sep 05 17:42:34.923264 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1330/2805] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:42:34 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1260 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:42:35.953297 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-405f7762-9551-4836-8a5c-88b40b6c22e6 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:42:35.954829 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-405f7762-9551-4836-8a5c-88b40b6c22e6 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:42:35.962318 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-405f7762-9551-4836-8a5c-88b40b6c22e6 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:35.962821 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-405f7762-9551-4836-8a5c-88b40b6c22e6 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:35.963274 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-405f7762-9551-4836-8a5c-88b40b6c22e6 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:35.963996 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-405f7762-9551-4836-8a5c-88b40b6c22e6 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:35.964507 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-405f7762-9551-4836-8a5c-88b40b6c22e6 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:35.964949 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-405f7762-9551-4836-8a5c-88b40b6c22e6 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:36.096614 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-405f7762-9551-4836-8a5c-88b40b6c22e6 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:42:36.105225 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-405f7762-9551-4836-8a5c-88b40b6c22e6 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1260 microversion: 2.1 time: 0.158568 Sep 05 17:42:36.105800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1476/2806] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:42:35 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:42:37.136203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ace6e512-af6a-4724-a694-a78df37ee4c4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:42:37.137452 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ace6e512-af6a-4724-a694-a78df37ee4c4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:42:37.148198 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ace6e512-af6a-4724-a694-a78df37ee4c4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:37.149031 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ace6e512-af6a-4724-a694-a78df37ee4c4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:37.149743 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ace6e512-af6a-4724-a694-a78df37ee4c4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:37.150871 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ace6e512-af6a-4724-a694-a78df37ee4c4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:37.151616 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ace6e512-af6a-4724-a694-a78df37ee4c4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:37.152363 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ace6e512-af6a-4724-a694-a78df37ee4c4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:37.293281 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ace6e512-af6a-4724-a694-a78df37ee4c4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:42:37.306365 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ace6e512-af6a-4724-a694-a78df37ee4c4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1260 microversion: 2.1 time: 0.179039 Sep 05 17:42:37.307145 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1331/2807] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:42:37 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:42:38.332136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-57aa6199-dd26-4c02-be4d-6cb85adcb940 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:42:38.332718 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-57aa6199-dd26-4c02-be4d-6cb85adcb940 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:42:38.340134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57aa6199-dd26-4c02-be4d-6cb85adcb940 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:38.340650 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57aa6199-dd26-4c02-be4d-6cb85adcb940 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:38.341087 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57aa6199-dd26-4c02-be4d-6cb85adcb940 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:38.341787 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57aa6199-dd26-4c02-be4d-6cb85adcb940 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:38.342238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57aa6199-dd26-4c02-be4d-6cb85adcb940 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:38.342663 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57aa6199-dd26-4c02-be4d-6cb85adcb940 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:38.472191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-57aa6199-dd26-4c02-be4d-6cb85adcb940 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:42:38.480483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-57aa6199-dd26-4c02-be4d-6cb85adcb940 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1260 microversion: 2.1 time: 0.152471 Sep 05 17:42:38.481173 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1477/2808] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:42:38 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:42:39.507810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-00dfb2c2-0be8-4b64-a1f9-789044130551 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:42:39.508867 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-00dfb2c2-0be8-4b64-a1f9-789044130551 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:42:39.519876 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00dfb2c2-0be8-4b64-a1f9-789044130551 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:39.520745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00dfb2c2-0be8-4b64-a1f9-789044130551 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:39.521463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00dfb2c2-0be8-4b64-a1f9-789044130551 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:39.522596 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00dfb2c2-0be8-4b64-a1f9-789044130551 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:39.523346 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00dfb2c2-0be8-4b64-a1f9-789044130551 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:39.524054 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-00dfb2c2-0be8-4b64-a1f9-789044130551 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:39.546786 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=2 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:42:39.566557 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell0:SELECT=6 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:42:39.660125 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-00dfb2c2-0be8-4b64-a1f9-789044130551 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:42:39.668275 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-00dfb2c2-0be8-4b64-a1f9-789044130551 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1260 microversion: 2.1 time: 0.167211 Sep 05 17:42:39.668817 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1332/2809] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:42:39 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:42:40.695989 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a0ea6937-0209-4e2d-af34-55656989d0b2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:42:40.697150 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a0ea6937-0209-4e2d-af34-55656989d0b2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:42:40.701369 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:42:40.708981 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ea6937-0209-4e2d-af34-55656989d0b2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:40.709587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ea6937-0209-4e2d-af34-55656989d0b2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:40.710135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ea6937-0209-4e2d-af34-55656989d0b2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:40.711276 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ea6937-0209-4e2d-af34-55656989d0b2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:40.711722 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ea6937-0209-4e2d-af34-55656989d0b2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:40.712136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ea6937-0209-4e2d-af34-55656989d0b2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:40.857757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a0ea6937-0209-4e2d-af34-55656989d0b2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:42:40.869707 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a0ea6937-0209-4e2d-af34-55656989d0b2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1260 microversion: 2.1 time: 0.180716 Sep 05 17:42:40.870434 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1478/2810] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:42:40 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:42:41.894205 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-65bf76e4-dd9d-4b46-b534-810fd1e25967 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:42:41.894778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-65bf76e4-dd9d-4b46-b534-810fd1e25967 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:42:41.901778 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-65bf76e4-dd9d-4b46-b534-810fd1e25967 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:41.902260 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-65bf76e4-dd9d-4b46-b534-810fd1e25967 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:41.902687 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-65bf76e4-dd9d-4b46-b534-810fd1e25967 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:41.903360 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-65bf76e4-dd9d-4b46-b534-810fd1e25967 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:41.903808 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-65bf76e4-dd9d-4b46-b534-810fd1e25967 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:41.904263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-65bf76e4-dd9d-4b46-b534-810fd1e25967 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:42.041615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-65bf76e4-dd9d-4b46-b534-810fd1e25967 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:42:42.049541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-65bf76e4-dd9d-4b46-b534-810fd1e25967 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1260 microversion: 2.1 time: 0.159795 Sep 05 17:42:42.050123 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1333/2811] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:42:41 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:42:43.073997 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2ca500a6-ae5f-45d0-9cf6-fcd63c61f25c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:42:43.074715 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2ca500a6-ae5f-45d0-9cf6-fcd63c61f25c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:42:43.083721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ca500a6-ae5f-45d0-9cf6-fcd63c61f25c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:43.084483 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ca500a6-ae5f-45d0-9cf6-fcd63c61f25c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:43.085022 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ca500a6-ae5f-45d0-9cf6-fcd63c61f25c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:43.086257 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ca500a6-ae5f-45d0-9cf6-fcd63c61f25c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:43.086819 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ca500a6-ae5f-45d0-9cf6-fcd63c61f25c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:43.087334 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ca500a6-ae5f-45d0-9cf6-fcd63c61f25c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:43.229238 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2ca500a6-ae5f-45d0-9cf6-fcd63c61f25c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:42:43.248408 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2ca500a6-ae5f-45d0-9cf6-fcd63c61f25c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1260 microversion: 2.1 time: 0.179166 Sep 05 17:42:43.249019 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1479/2812] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:42:43 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:42:44.274672 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-16cc2f78-daab-42dc-9128-9643d43cd7c5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:42:44.275419 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-16cc2f78-daab-42dc-9128-9643d43cd7c5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:42:44.285014 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-16cc2f78-daab-42dc-9128-9643d43cd7c5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:44.285696 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-16cc2f78-daab-42dc-9128-9643d43cd7c5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:44.286309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-16cc2f78-daab-42dc-9128-9643d43cd7c5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:44.287261 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-16cc2f78-daab-42dc-9128-9643d43cd7c5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:44.287900 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-16cc2f78-daab-42dc-9128-9643d43cd7c5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:44.288541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-16cc2f78-daab-42dc-9128-9643d43cd7c5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:44.428197 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-16cc2f78-daab-42dc-9128-9643d43cd7c5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:42:44.437665 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-16cc2f78-daab-42dc-9128-9643d43cd7c5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1260 microversion: 2.1 time: 0.168822 Sep 05 17:42:44.438248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1334/2813] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:42:44 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:42:44.869224 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-a50d303a-c5b9-4bc9-a57e-e6415734e701 req-69259087-4fd6-4378-8349-afaff168fa16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef497e1-25c6-4e3b-930a-4ed31e1b956b", "name": "network-vif-plugged", "status": "completed", "tag": "47d789fe-1b05-46cd-b623-afedca04c82c"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:42:44.878688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-a50d303a-c5b9-4bc9-a57e-e6415734e701 req-69259087-4fd6-4378-8349-afaff168fa16 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:44.879161 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-a50d303a-c5b9-4bc9-a57e-e6415734e701 req-69259087-4fd6-4378-8349-afaff168fa16 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:44.879590 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-a50d303a-c5b9-4bc9-a57e-e6415734e701 req-69259087-4fd6-4378-8349-afaff168fa16 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:44.891010 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-a50d303a-c5b9-4bc9-a57e-e6415734e701 req-69259087-4fd6-4378-8349-afaff168fa16 service nova] Creating event network-vif-plugged:47d789fe-1b05-46cd-b623-afedca04c82c for instance 8ef497e1-25c6-4e3b-930a-4ed31e1b956b on hv-cinder-85596 Sep 05 17:42:44.896729 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-a50d303a-c5b9-4bc9-a57e-e6415734e701 req-69259087-4fd6-4378-8349-afaff168fa16 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113914 Sep 05 17:42:44.897352 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1480/2814] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:42:45.465167 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e0126e44-aaa6-4202-8262-00ebc270fcd4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:42:45.466102 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e0126e44-aaa6-4202-8262-00ebc270fcd4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:42:45.474639 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e0126e44-aaa6-4202-8262-00ebc270fcd4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:45.475126 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e0126e44-aaa6-4202-8262-00ebc270fcd4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:45.475560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e0126e44-aaa6-4202-8262-00ebc270fcd4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:45.476287 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e0126e44-aaa6-4202-8262-00ebc270fcd4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:45.476745 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e0126e44-aaa6-4202-8262-00ebc270fcd4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:45.477167 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e0126e44-aaa6-4202-8262-00ebc270fcd4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:45.625166 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e0126e44-aaa6-4202-8262-00ebc270fcd4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:42:45.632993 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e0126e44-aaa6-4202-8262-00ebc270fcd4 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1260 microversion: 2.1 time: 0.175001 Sep 05 17:42:45.633560 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1335/2815] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:42:45 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:42:46.656900 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-557d4d48-df22-4d9e-b2b8-d1a7590472e2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:42:46.657623 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-557d4d48-df22-4d9e-b2b8-d1a7590472e2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:42:46.664826 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557d4d48-df22-4d9e-b2b8-d1a7590472e2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:46.665308 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557d4d48-df22-4d9e-b2b8-d1a7590472e2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:46.665738 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557d4d48-df22-4d9e-b2b8-d1a7590472e2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:46.666422 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557d4d48-df22-4d9e-b2b8-d1a7590472e2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:46.666871 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557d4d48-df22-4d9e-b2b8-d1a7590472e2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:46.667289 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557d4d48-df22-4d9e-b2b8-d1a7590472e2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:46.803698 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-557d4d48-df22-4d9e-b2b8-d1a7590472e2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:42:46.813239 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-557d4d48-df22-4d9e-b2b8-d1a7590472e2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1445 microversion: 2.1 time: 0.160902 Sep 05 17:42:46.813834 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1481/2816] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:42:46 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1445 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:42:46.838161 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-3e54d30e-bc70-40de-bbf6-7c8b75d69f1c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:42:46.838769 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-3e54d30e-bc70-40de-bbf6-7c8b75d69f1c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:42:46.845982 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3e54d30e-bc70-40de-bbf6-7c8b75d69f1c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:46.846769 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3e54d30e-bc70-40de-bbf6-7c8b75d69f1c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:46.847262 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3e54d30e-bc70-40de-bbf6-7c8b75d69f1c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:46.848235 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3e54d30e-bc70-40de-bbf6-7c8b75d69f1c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:46.848775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3e54d30e-bc70-40de-bbf6-7c8b75d69f1c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:46.849300 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-3e54d30e-bc70-40de-bbf6-7c8b75d69f1c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:46.987636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-3e54d30e-bc70-40de-bbf6-7c8b75d69f1c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:42:46.995577 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-3e54d30e-bc70-40de-bbf6-7c8b75d69f1c tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1445 microversion: 2.1 time: 0.161951 Sep 05 17:42:46.996191 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1336/2817] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:42:46 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1445 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:42:48.746063 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-137b4385-dce2-4294-8f73-e8cfc55bb9fb req-4e0cf98f-98cd-44f8-9727-bb0d4d91026c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ef497e1-25c6-4e3b-930a-4ed31e1b956b", "tag": "47d789fe-1b05-46cd-b623-afedca04c82c"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:42:48.756190 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-137b4385-dce2-4294-8f73-e8cfc55bb9fb req-4e0cf98f-98cd-44f8-9727-bb0d4d91026c service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:42:48.756671 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-137b4385-dce2-4294-8f73-e8cfc55bb9fb req-4e0cf98f-98cd-44f8-9727-bb0d4d91026c service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:42:48.757097 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-137b4385-dce2-4294-8f73-e8cfc55bb9fb req-4e0cf98f-98cd-44f8-9727-bb0d4d91026c service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:42:48.768164 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-137b4385-dce2-4294-8f73-e8cfc55bb9fb req-4e0cf98f-98cd-44f8-9727-bb0d4d91026c service nova] Creating event network-changed:47d789fe-1b05-46cd-b623-afedca04c82c for instance 8ef497e1-25c6-4e3b-930a-4ed31e1b956b on hv-cinder-85596 Sep 05 17:42:48.773239 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-137b4385-dce2-4294-8f73-e8cfc55bb9fb req-4e0cf98f-98cd-44f8-9727-bb0d4d91026c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030836 Sep 05 17:42:48.773874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1482/2818] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:44:15.654647 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:44:15.655406 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=52 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:44:15.656686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:44:15.656842 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:44:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 (ip 10.222.0.23) !!! Sep 05 17:44:15.662248 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a5f7b195-0181-4e60-9050-9ed978c7a187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:44:15.662752 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-a5f7b195-0181-4e60-9050-9ed978c7a187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:44:15.675701 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5f7b195-0181-4e60-9050-9ed978c7a187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:44:15.676185 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5f7b195-0181-4e60-9050-9ed978c7a187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:44:15.676609 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5f7b195-0181-4e60-9050-9ed978c7a187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:44:15.677279 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5f7b195-0181-4e60-9050-9ed978c7a187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:44:15.677724 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5f7b195-0181-4e60-9050-9ed978c7a187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:44:15.678171 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-a5f7b195-0181-4e60-9050-9ed978c7a187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:44:15.692059 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-a5f7b195-0181-4e60-9050-9ed978c7a187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] HTTP exception thrown: Instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 could not be found. Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a5f7b195-0181-4e60-9050-9ed978c7a187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Request method failure captured: Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: DELETE /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 HTTP/1.1 Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFitwWfs1eoGn1PxRIG11Wt03bDV9g56JxpIR6zL3zS6ommzT23LFKAHz3X30q1L_3eC5KN6CLXlYj9IPTX79SEd_OXUCZ9JsKzD3bEGHsihDAoCgSV2MfOvhIO0YY1xkYznidYRO3b1jn9_1rPHR8-MeDaZemOPww1T5YQlO8xLZFe8 Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: e933bc308b31482a9db533a7e89aeb4b Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720023600 Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:44:15.693802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:44:15.695322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e933bc308b31482a9db533a7e89aeb4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e933bc308b31482a9db533a7e89aeb4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e933bc308b31482a9db533a7e89aeb4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e933bc308b31482a9db533a7e89aeb4b"}]}] Sep 05 17:44:15.695322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720023600 Sep 05 17:44:15.695322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: e933bc308b31482a9db533a7e89aeb4b Sep 05 17:44:15.695322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720023600 Sep 05 17:44:15.695322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-AttachVolumeShelveTestJSON-1720023600-project Sep 05 17:44:15.695322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:44:15.695322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:44:15.695322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: c53ac49fbc054c01a5a1ef41e04bf253 Sep 05 17:44:15.695322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720023600-project Sep 05 17:44:15.695322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:44:15.695322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 could not be found. Sep 05 17:44:15.695322 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': '97cc15c7-947d-4daf-80e8-8edc37c01e68'} Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 could not be found. Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:44:15.696050 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 could not be found. Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 could not be found. Sep 05 17:44:15.697192 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:44:15.698268 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-a5f7b195-0181-4e60-9050-9ed978c7a187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Returning 404 to user: Instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:44:15.698268 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-a5f7b195-0181-4e60-9050-9ed978c7a187 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 404 len: 111 microversion: 2.20 time: 0.042375 Sep 05 17:44:15.698268 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1337/2819] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Sep 5 17:44:15 2022] DELETE /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 17:44:15.702557 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=22 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:44:15.703326 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=46 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:44:15.704093 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:44:15.704290 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:44:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 (ip 10.222.0.23) !!! Sep 05 17:44:15.709956 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-36992abf-d803-4657-878b-66b40d4a9874 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:44:15.711002 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-36992abf-d803-4657-878b-66b40d4a9874 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] [instance: 97cc15c7-947d-4daf-80e8-8edc37c01e68] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:44:15.719116 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36992abf-d803-4657-878b-66b40d4a9874 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:44:15.719649 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36992abf-d803-4657-878b-66b40d4a9874 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:44:15.720086 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36992abf-d803-4657-878b-66b40d4a9874 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:44:15.720825 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36992abf-d803-4657-878b-66b40d4a9874 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:44:15.721271 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36992abf-d803-4657-878b-66b40d4a9874 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:44:15.721697 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36992abf-d803-4657-878b-66b40d4a9874 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:44:15.735940 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-36992abf-d803-4657-878b-66b40d4a9874 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] HTTP exception thrown: Instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 could not be found. Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-36992abf-d803-4657-878b-66b40d4a9874 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Request method failure captured: Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 HTTP/1.1 Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept: application/json Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Connection: close Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Length: 0 Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Content-Type: application/json Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Host: 10.222.0.23 Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.12 Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABjFitwWfs1eoGn1PxRIG11Wt03bDV9g56JxpIR6zL3zS6ommzT23LFKAHz3X30q1L_3eC5KN6CLXlYj9IPTX79SEd_OXUCZ9JsKzD3bEGHsihDAoCgSV2MfOvhIO0YY1xkYznidYRO3b1jn9_1rPHR8-MeDaZemOPww1T5YQlO8xLZFe8 Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Id: e933bc308b31482a9db533a7e89aeb4b Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1720023600 Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Role: member,reader Sep 05 17:44:15.737645 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Roles: member,reader Sep 05 17:44:15.738948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e933bc308b31482a9db533a7e89aeb4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e933bc308b31482a9db533a7e89aeb4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e933bc308b31482a9db533a7e89aeb4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e933bc308b31482a9db533a7e89aeb4b"}]}] Sep 05 17:44:15.738948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1720023600 Sep 05 17:44:15.738948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Id: e933bc308b31482a9db533a7e89aeb4b Sep 05 17:44:15.738948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1720023600 Sep 05 17:44:15.738948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeShelveTestJSON-1720023600-project Sep 05 17:44:15.738948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Sep 05 17:44:15.738948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Sep 05 17:44:15.738948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Id: c53ac49fbc054c01a5a1ef41e04bf253 Sep 05 17:44:15.738948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1720023600-project Sep 05 17:44:15.738948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: method: > Sep 05 17:44:15.738948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: exception: Instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 could not be found. Sep 05 17:44:15.738948 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: action_args: {'id': '97cc15c7-947d-4daf-80e8-8edc37c01e68'} Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 could not be found. Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:44:15.739597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 could not be found. Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 could not be found. Sep 05 17:44:15.740845 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Sep 05 17:44:15.742049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-36992abf-d803-4657-878b-66b40d4a9874 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] Returning 404 to user: Instance 97cc15c7-947d-4daf-80e8-8edc37c01e68 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:44:15.742049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-36992abf-d803-4657-878b-66b40d4a9874 tempest-AttachVolumeShelveTestJSON-1720023600 tempest-AttachVolumeShelveTestJSON-1720023600-project] 10.222.0.23 "GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68" status: 404 len: 111 microversion: 2.20 time: 0.038669 Sep 05 17:44:15.742049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1483/2820] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Sep 5 17:44:15 2022] GET /compute/v2.1/servers/97cc15c7-947d-4daf-80e8-8edc37c01e68 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 17:44:20.609285 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-14e2f97f-c76c-4dad-bc84-d789d516a587 tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] Action: 'create', calling method: .version_select at 0x7f1d3ab44c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-274356155", "metadata": {"Type": "work"}}} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:44:21.052553 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-14e2f97f-c76c-4dad-bc84-d789d516a587 tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.575183 Sep 05 17:44:21.053181 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1338/2821] 10.222.0.23 () {60 vars in 1156 bytes} [Mon Sep 5 17:44:20 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 577 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 05 17:44:21.066373 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dc1dd74c-8020-4389-88ac-3a74c7289049 tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] Calling method '.version_select at 0x7f1d3ab990d0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:44:21.170487 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dc1dd74c-8020-4389-88ac-3a74c7289049 tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/326bbb8e-4673-493d-b6b5-6cf6e51527ab" status: 200 len: 352 microversion: 2.1 time: 0.108048 Sep 05 17:44:21.171049 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1484/2822] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Sep 5 17:44:21 2022] GET /compute/v2.1/os-volumes/326bbb8e-4673-493d-b6b5-6cf6e51527ab => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:44:22.190166 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-edb5e17e-7fcc-4436-9588-120d66b9aaf5 tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] Calling method '.version_select at 0x7f1d3e326040>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:44:22.251610 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-edb5e17e-7fcc-4436-9588-120d66b9aaf5 tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/326bbb8e-4673-493d-b6b5-6cf6e51527ab" status: 200 len: 353 microversion: 2.1 time: 0.068817 Sep 05 17:44:22.252183 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1339/2823] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Sep 5 17:44:22 2022] GET /compute/v2.1/os-volumes/326bbb8e-4673-493d-b6b5-6cf6e51527ab => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:44:22.270026 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f6d030b2-d59b-4ba4-9848-29ae9b84c1be tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] Calling method '.version_select at 0x7f1d3b8e0d30>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:44:22.332074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f6d030b2-d59b-4ba4-9848-29ae9b84c1be tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/326bbb8e-4673-493d-b6b5-6cf6e51527ab" status: 200 len: 353 microversion: 2.1 time: 0.066361 Sep 05 17:44:22.332678 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1485/2824] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Sep 5 17:44:22 2022] GET /compute/v2.1/os-volumes/326bbb8e-4673-493d-b6b5-6cf6e51527ab => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:44:22.352664 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-35fa96d2-8121-4b7e-8396-d3ea01dbec11 tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] Calling method '.version_select at 0x7f1d3abf3dc0>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:44:22.416442 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-35fa96d2-8121-4b7e-8396-d3ea01dbec11 tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/326bbb8e-4673-493d-b6b5-6cf6e51527ab" status: 202 len: 0 microversion: 2.1 time: 0.068138 Sep 05 17:44:22.417048 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1340/2825] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Sep 5 17:44:22 2022] DELETE /compute/v2.1/os-volumes/326bbb8e-4673-493d-b6b5-6cf6e51527ab => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:44:22.425684 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ffafb647-f24d-41c7-a372-d40c0690bb1d tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] Calling method '.version_select at 0x7f1d3ab99e50>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:44:22.474908 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ffafb647-f24d-41c7-a372-d40c0690bb1d tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/326bbb8e-4673-493d-b6b5-6cf6e51527ab" status: 200 len: 352 microversion: 2.1 time: 0.053255 Sep 05 17:44:22.475670 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1486/2826] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Sep 5 17:44:22 2022] GET /compute/v2.1/os-volumes/326bbb8e-4673-493d-b6b5-6cf6e51527ab => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:44:23.497655 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9c95e8d2-f2de-4424-8277-070381e53aad tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] Calling method '.version_select at 0x7f1d3aae2670>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:44:23.536305 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-9c95e8d2-f2de-4424-8277-070381e53aad tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] HTTP exception thrown: Volume 326bbb8e-4673-493d-b6b5-6cf6e51527ab could not be found. Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9c95e8d2-f2de-4424-8277-070381e53aad tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] Request method failure captured: Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: GET /compute/v2.1/os-volumes/326bbb8e-4673-493d-b6b5-6cf6e51527ab HTTP/1.1 Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFjV0SWSLsqr1wHyW3_4joNG7Hx8VAZXaeOXh-lMPNIhyVukxZXEfm-Atgep3bqwOV66ZqCdN7tL4q2VoObizvQt1ZGxOZZ-PXS80oE9g4uJgXFblRNVugiFd3Eof4bOlCDfuW2Fom8zzph-nk6u7SL9PyJtROITmyCpro5PABVwgjyw Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: 29c9e354f00a4031afd32692840373b6 Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-VolumesGetTestJSON-1271818671 Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:44:23.539581 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:44:23.541243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/29c9e354f00a4031afd32692840373b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29c9e354f00a4031afd32692840373b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29c9e354f00a4031afd32692840373b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_29c9e354f00a4031afd32692840373b6"}]}] Sep 05 17:44:23.541243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-VolumesGetTestJSON-1271818671 Sep 05 17:44:23.541243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: 29c9e354f00a4031afd32692840373b6 Sep 05 17:44:23.541243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-VolumesGetTestJSON-1271818671 Sep 05 17:44:23.541243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-VolumesGetTestJSON-1271818671-project Sep 05 17:44:23.541243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:44:23.541243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:44:23.541243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: 6111ebdac50645a98b4538a4f6bae1a3 Sep 05 17:44:23.541243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-VolumesGetTestJSON-1271818671-project Sep 05 17:44:23.541243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: Sep 05 17:44:23.541243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Volume 326bbb8e-4673-493d-b6b5-6cf6e51527ab could not be found. Sep 05 17:44:23.541243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': '326bbb8e-4673-493d-b6b5-6cf6e51527ab'} Sep 05 17:44:23.541243 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 326bbb8e-4673-493d-b6b5-6cf6e51527ab could not be found. (HTTP 404) (Request-ID: req-1d976608-bf94-49d6-bb41-b18a570235a5) Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:44:23.542115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 17:44:23.543403 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 326bbb8e-4673-493d-b6b5-6cf6e51527ab could not be found. Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 05 17:44:23.544998 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:44:23.546325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 326bbb8e-4673-493d-b6b5-6cf6e51527ab could not be found. Sep 05 17:44:23.546325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:44:23.546325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:44:23.546325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:44:23.546325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:44:23.546325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:44:23.546325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:44:23.546325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:44:23.546325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:44:23.546325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 326bbb8e-4673-493d-b6b5-6cf6e51527ab could not be found. Sep 05 17:44:23.546325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:44:23.546325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9c95e8d2-f2de-4424-8277-070381e53aad tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] Returning 404 to user: Volume 326bbb8e-4673-493d-b6b5-6cf6e51527ab could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:44:23.546325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9c95e8d2-f2de-4424-8277-070381e53aad tempest-VolumesGetTestJSON-1271818671 tempest-VolumesGetTestJSON-1271818671-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/326bbb8e-4673-493d-b6b5-6cf6e51527ab" status: 404 len: 109 microversion: 2.1 time: 0.049334 Sep 05 17:44:23.546325 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1341/2827] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Sep 5 17:44:23 2022] GET /compute/v2.1/os-volumes/326bbb8e-4673-493d-b6b5-6cf6e51527ab => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:45:03.847824 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:45:03.849066 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:45:03.855188 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-04380487-7421-424d-980f-6328406b5d52 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:45:03.855911 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-04380487-7421-424d-980f-6328406b5d52 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:03.862598 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04380487-7421-424d-980f-6328406b5d52 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:03.863073 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04380487-7421-424d-980f-6328406b5d52 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:03.863497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04380487-7421-424d-980f-6328406b5d52 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:03.864175 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04380487-7421-424d-980f-6328406b5d52 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:03.864641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04380487-7421-424d-980f-6328406b5d52 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:03.865054 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04380487-7421-424d-980f-6328406b5d52 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:03.888090 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-04380487-7421-424d-980f-6328406b5d52 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lazy-loading 'flavor' on Instance uuid 8ef497e1-25c6-4e3b-930a-4ed31e1b956b {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 17:45:03.966891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-04380487-7421-424d-980f-6328406b5d52 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "POST /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b/action" status: 202 len: 0 microversion: 2.1 time: 0.121368 Sep 05 17:45:03.967856 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1487/2828] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Sep 5 17:45:03 2022] POST /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:45:03.973865 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=2 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:45:03.974627 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=2 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:45:03.978652 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-481b0471-8912-4510-9334-333835695ec5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:03.979263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-481b0471-8912-4510-9334-333835695ec5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:03.986385 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-481b0471-8912-4510-9334-333835695ec5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:03.986920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-481b0471-8912-4510-9334-333835695ec5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:03.987540 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-481b0471-8912-4510-9334-333835695ec5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:03.988333 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-481b0471-8912-4510-9334-333835695ec5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:03.988775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-481b0471-8912-4510-9334-333835695ec5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:03.989426 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-481b0471-8912-4510-9334-333835695ec5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:04.122109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-481b0471-8912-4510-9334-333835695ec5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:04.130006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-481b0471-8912-4510-9334-333835695ec5 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.158039 Sep 05 17:45:04.130606 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1342/2829] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:03 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:05.159130 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-383845c0-ee66-4f7d-aeca-2010545ea200 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:05.160263 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-383845c0-ee66-4f7d-aeca-2010545ea200 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:05.170828 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-383845c0-ee66-4f7d-aeca-2010545ea200 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:05.171570 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-383845c0-ee66-4f7d-aeca-2010545ea200 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:05.172287 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-383845c0-ee66-4f7d-aeca-2010545ea200 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:05.173432 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-383845c0-ee66-4f7d-aeca-2010545ea200 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:05.174179 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-383845c0-ee66-4f7d-aeca-2010545ea200 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:05.174880 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-383845c0-ee66-4f7d-aeca-2010545ea200 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:05.313527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-383845c0-ee66-4f7d-aeca-2010545ea200 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:05.324304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-383845c0-ee66-4f7d-aeca-2010545ea200 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.172920 Sep 05 17:45:05.324891 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1488/2830] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:05 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:06.348630 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5240bbbc-406a-43bf-b0f8-22268e627966 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:06.349219 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5240bbbc-406a-43bf-b0f8-22268e627966 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:06.356603 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5240bbbc-406a-43bf-b0f8-22268e627966 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:06.357088 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5240bbbc-406a-43bf-b0f8-22268e627966 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:06.357521 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5240bbbc-406a-43bf-b0f8-22268e627966 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:06.358251 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5240bbbc-406a-43bf-b0f8-22268e627966 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:06.358725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5240bbbc-406a-43bf-b0f8-22268e627966 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:06.359148 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5240bbbc-406a-43bf-b0f8-22268e627966 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:06.503062 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5240bbbc-406a-43bf-b0f8-22268e627966 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:06.510915 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5240bbbc-406a-43bf-b0f8-22268e627966 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.166351 Sep 05 17:45:06.511451 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1343/2831] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:06 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:07.533841 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-32e43dd9-6902-41d0-bed7-f19032d474d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:07.534406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-32e43dd9-6902-41d0-bed7-f19032d474d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:07.541688 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32e43dd9-6902-41d0-bed7-f19032d474d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:07.542180 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32e43dd9-6902-41d0-bed7-f19032d474d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:07.542615 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32e43dd9-6902-41d0-bed7-f19032d474d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:07.543304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32e43dd9-6902-41d0-bed7-f19032d474d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:07.543759 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32e43dd9-6902-41d0-bed7-f19032d474d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:07.544207 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32e43dd9-6902-41d0-bed7-f19032d474d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:07.683024 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-32e43dd9-6902-41d0-bed7-f19032d474d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:07.695468 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-32e43dd9-6902-41d0-bed7-f19032d474d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.165372 Sep 05 17:45:07.696338 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1489/2832] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:07 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:08.723662 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c92f5fa7-99b8-46b2-a082-2143403e9593 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:08.724680 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c92f5fa7-99b8-46b2-a082-2143403e9593 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:08.736594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c92f5fa7-99b8-46b2-a082-2143403e9593 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:08.737396 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c92f5fa7-99b8-46b2-a082-2143403e9593 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:08.738113 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c92f5fa7-99b8-46b2-a082-2143403e9593 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:08.739241 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c92f5fa7-99b8-46b2-a082-2143403e9593 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:08.739988 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c92f5fa7-99b8-46b2-a082-2143403e9593 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:08.740728 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c92f5fa7-99b8-46b2-a082-2143403e9593 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:08.888293 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c92f5fa7-99b8-46b2-a082-2143403e9593 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:08.896412 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c92f5fa7-99b8-46b2-a082-2143403e9593 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.179201 Sep 05 17:45:08.897016 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1344/2833] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:08 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:09.920924 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-70018172-4380-468e-9c8b-424beaabc699 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:09.921607 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-70018172-4380-468e-9c8b-424beaabc699 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:09.928511 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70018172-4380-468e-9c8b-424beaabc699 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:09.929131 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70018172-4380-468e-9c8b-424beaabc699 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:09.929714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70018172-4380-468e-9c8b-424beaabc699 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:09.930561 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70018172-4380-468e-9c8b-424beaabc699 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:09.931231 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70018172-4380-468e-9c8b-424beaabc699 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:09.931721 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70018172-4380-468e-9c8b-424beaabc699 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:10.077343 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-70018172-4380-468e-9c8b-424beaabc699 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:10.085964 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-70018172-4380-468e-9c8b-424beaabc699 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.169436 Sep 05 17:45:10.086538 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1490/2834] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:09 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:11.109645 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ad5fe469-6179-44ba-9360-774a3d62f1fc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:11.110221 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ad5fe469-6179-44ba-9360-774a3d62f1fc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:11.117213 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ad5fe469-6179-44ba-9360-774a3d62f1fc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:11.117690 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ad5fe469-6179-44ba-9360-774a3d62f1fc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:11.118114 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ad5fe469-6179-44ba-9360-774a3d62f1fc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:11.118788 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ad5fe469-6179-44ba-9360-774a3d62f1fc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:11.119235 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ad5fe469-6179-44ba-9360-774a3d62f1fc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:11.119646 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ad5fe469-6179-44ba-9360-774a3d62f1fc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:11.272411 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-ad5fe469-6179-44ba-9360-774a3d62f1fc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:11.280986 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ad5fe469-6179-44ba-9360-774a3d62f1fc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.175250 Sep 05 17:45:11.281905 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1345/2835] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:11 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:12.308967 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ab5a8126-8b30-419c-afaf-da9576b23923 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:12.309794 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ab5a8126-8b30-419c-afaf-da9576b23923 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:12.321461 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab5a8126-8b30-419c-afaf-da9576b23923 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:12.322646 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab5a8126-8b30-419c-afaf-da9576b23923 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:12.323512 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab5a8126-8b30-419c-afaf-da9576b23923 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:12.324702 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab5a8126-8b30-419c-afaf-da9576b23923 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:12.325206 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab5a8126-8b30-419c-afaf-da9576b23923 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:12.325673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab5a8126-8b30-419c-afaf-da9576b23923 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:12.472296 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ab5a8126-8b30-419c-afaf-da9576b23923 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:12.483908 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ab5a8126-8b30-419c-afaf-da9576b23923 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.181790 Sep 05 17:45:12.484526 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1491/2836] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:12 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:13.511341 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-af791ea4-915f-464a-b955-df436119d411 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:13.512206 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-af791ea4-915f-464a-b955-df436119d411 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:13.523499 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af791ea4-915f-464a-b955-df436119d411 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:13.524327 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af791ea4-915f-464a-b955-df436119d411 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:13.525036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af791ea4-915f-464a-b955-df436119d411 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:13.526166 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af791ea4-915f-464a-b955-df436119d411 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:13.526906 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af791ea4-915f-464a-b955-df436119d411 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:13.527595 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-af791ea4-915f-464a-b955-df436119d411 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:13.663827 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-af791ea4-915f-464a-b955-df436119d411 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:13.672061 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-af791ea4-915f-464a-b955-df436119d411 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.167486 Sep 05 17:45:13.672667 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1346/2837] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:13 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:14.703659 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-57921258-1c95-488d-b617-30672bbe689f tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:14.704391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-57921258-1c95-488d-b617-30672bbe689f tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:14.712699 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57921258-1c95-488d-b617-30672bbe689f tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:14.713255 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57921258-1c95-488d-b617-30672bbe689f tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:14.713757 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57921258-1c95-488d-b617-30672bbe689f tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:14.714586 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57921258-1c95-488d-b617-30672bbe689f tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:14.715106 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57921258-1c95-488d-b617-30672bbe689f tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:14.715593 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57921258-1c95-488d-b617-30672bbe689f tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:14.851795 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-57921258-1c95-488d-b617-30672bbe689f tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:14.860074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-57921258-1c95-488d-b617-30672bbe689f tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.162556 Sep 05 17:45:14.860666 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1492/2838] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:14 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:15.887378 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-c8f38f2d-d55e-41d3-93c9-43991fd1c6c7 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:15.888408 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-c8f38f2d-d55e-41d3-93c9-43991fd1c6c7 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:15.899650 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8f38f2d-d55e-41d3-93c9-43991fd1c6c7 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:15.901044 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8f38f2d-d55e-41d3-93c9-43991fd1c6c7 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:15.901759 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8f38f2d-d55e-41d3-93c9-43991fd1c6c7 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:15.902873 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8f38f2d-d55e-41d3-93c9-43991fd1c6c7 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:15.903614 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8f38f2d-d55e-41d3-93c9-43991fd1c6c7 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:15.904347 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-c8f38f2d-d55e-41d3-93c9-43991fd1c6c7 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:16.043725 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-c8f38f2d-d55e-41d3-93c9-43991fd1c6c7 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:16.054237 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-c8f38f2d-d55e-41d3-93c9-43991fd1c6c7 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.172968 Sep 05 17:45:16.055069 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1347/2839] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:15 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:17.079575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-02df34f4-808e-4bae-b0f4-aa186616be2a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:17.080137 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-02df34f4-808e-4bae-b0f4-aa186616be2a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:17.087406 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02df34f4-808e-4bae-b0f4-aa186616be2a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:17.087883 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02df34f4-808e-4bae-b0f4-aa186616be2a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:17.088344 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02df34f4-808e-4bae-b0f4-aa186616be2a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:17.089070 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02df34f4-808e-4bae-b0f4-aa186616be2a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:17.089513 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02df34f4-808e-4bae-b0f4-aa186616be2a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:17.089928 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02df34f4-808e-4bae-b0f4-aa186616be2a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:17.307559 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-02df34f4-808e-4bae-b0f4-aa186616be2a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:17.315758 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-02df34f4-808e-4bae-b0f4-aa186616be2a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.240165 Sep 05 17:45:17.316363 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1493/2840] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:17 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:18.342201 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-df30d1df-6b6f-4dc4-a9df-c82bc0be81fa tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:18.343342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-df30d1df-6b6f-4dc4-a9df-c82bc0be81fa tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:18.350436 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df30d1df-6b6f-4dc4-a9df-c82bc0be81fa tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:18.350913 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df30d1df-6b6f-4dc4-a9df-c82bc0be81fa tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:18.351342 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df30d1df-6b6f-4dc4-a9df-c82bc0be81fa tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:18.352022 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df30d1df-6b6f-4dc4-a9df-c82bc0be81fa tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:18.352583 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df30d1df-6b6f-4dc4-a9df-c82bc0be81fa tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:18.353004 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-df30d1df-6b6f-4dc4-a9df-c82bc0be81fa tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:18.493593 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-df30d1df-6b6f-4dc4-a9df-c82bc0be81fa tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:18.502120 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-df30d1df-6b6f-4dc4-a9df-c82bc0be81fa tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.163811 Sep 05 17:45:18.502709 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1348/2841] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:18 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:19.526210 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f88c4836-9148-418a-a695-73d7bba33a44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:19.526814 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f88c4836-9148-418a-a695-73d7bba33a44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:19.534098 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f88c4836-9148-418a-a695-73d7bba33a44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:19.534580 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f88c4836-9148-418a-a695-73d7bba33a44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:19.535007 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f88c4836-9148-418a-a695-73d7bba33a44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:19.535696 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f88c4836-9148-418a-a695-73d7bba33a44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:19.536141 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f88c4836-9148-418a-a695-73d7bba33a44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:19.536588 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f88c4836-9148-418a-a695-73d7bba33a44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:19.745275 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f88c4836-9148-418a-a695-73d7bba33a44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:19.753943 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f88c4836-9148-418a-a695-73d7bba33a44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.231649 Sep 05 17:45:19.754546 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1494/2842] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:19 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:20.779975 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-b7bb71ba-50e5-4f89-b9fe-1b967c624750 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:20.780764 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-b7bb71ba-50e5-4f89-b9fe-1b967c624750 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:20.789956 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7bb71ba-50e5-4f89-b9fe-1b967c624750 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:20.790562 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7bb71ba-50e5-4f89-b9fe-1b967c624750 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:20.791101 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7bb71ba-50e5-4f89-b9fe-1b967c624750 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:20.791984 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7bb71ba-50e5-4f89-b9fe-1b967c624750 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:20.792591 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7bb71ba-50e5-4f89-b9fe-1b967c624750 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:20.793150 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-b7bb71ba-50e5-4f89-b9fe-1b967c624750 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:20.945601 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-b7bb71ba-50e5-4f89-b9fe-1b967c624750 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:20.955799 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-b7bb71ba-50e5-4f89-b9fe-1b967c624750 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.180759 Sep 05 17:45:20.956417 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1349/2843] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:20 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:21.988420 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bc77c423-ae94-4b03-9192-608a8b94f567 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:21.989414 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bc77c423-ae94-4b03-9192-608a8b94f567 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:21.999506 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc77c423-ae94-4b03-9192-608a8b94f567 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:21.999975 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc77c423-ae94-4b03-9192-608a8b94f567 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:22.000433 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc77c423-ae94-4b03-9192-608a8b94f567 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:22.001139 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc77c423-ae94-4b03-9192-608a8b94f567 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:22.001569 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc77c423-ae94-4b03-9192-608a8b94f567 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:22.001984 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc77c423-ae94-4b03-9192-608a8b94f567 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:22.139267 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bc77c423-ae94-4b03-9192-608a8b94f567 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:22.147471 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bc77c423-ae94-4b03-9192-608a8b94f567 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.165981 Sep 05 17:45:22.148391 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1495/2844] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:21 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:23.175429 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-0d2a560f-7b6d-414b-aa88-b2859f602e2d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:23.176463 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-0d2a560f-7b6d-414b-aa88-b2859f602e2d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:23.187433 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d2a560f-7b6d-414b-aa88-b2859f602e2d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:23.188337 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d2a560f-7b6d-414b-aa88-b2859f602e2d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:23.188776 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d2a560f-7b6d-414b-aa88-b2859f602e2d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:23.189462 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d2a560f-7b6d-414b-aa88-b2859f602e2d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:23.189909 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d2a560f-7b6d-414b-aa88-b2859f602e2d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:23.190327 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-0d2a560f-7b6d-414b-aa88-b2859f602e2d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:23.338735 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-0d2a560f-7b6d-414b-aa88-b2859f602e2d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:23.349301 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-0d2a560f-7b6d-414b-aa88-b2859f602e2d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.180490 Sep 05 17:45:23.350102 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1350/2845] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:23 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:24.378051 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-81286de8-42df-444a-9f42-f6eec6c9ee22 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:24.380110 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-81286de8-42df-444a-9f42-f6eec6c9ee22 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:24.391563 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81286de8-42df-444a-9f42-f6eec6c9ee22 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:24.392178 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81286de8-42df-444a-9f42-f6eec6c9ee22 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:24.392641 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81286de8-42df-444a-9f42-f6eec6c9ee22 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:24.393440 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81286de8-42df-444a-9f42-f6eec6c9ee22 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:24.393890 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81286de8-42df-444a-9f42-f6eec6c9ee22 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:24.394306 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81286de8-42df-444a-9f42-f6eec6c9ee22 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:24.538639 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-81286de8-42df-444a-9f42-f6eec6c9ee22 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:24.546497 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-81286de8-42df-444a-9f42-f6eec6c9ee22 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.175611 Sep 05 17:45:24.547132 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1496/2846] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:24 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:25.569501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7ba5b06b-a677-4c5d-9812-ad348e06778d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:25.570775 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7ba5b06b-a677-4c5d-9812-ad348e06778d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:25.577372 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ba5b06b-a677-4c5d-9812-ad348e06778d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:25.577855 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ba5b06b-a677-4c5d-9812-ad348e06778d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:25.578324 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ba5b06b-a677-4c5d-9812-ad348e06778d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:25.579006 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ba5b06b-a677-4c5d-9812-ad348e06778d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:25.579449 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ba5b06b-a677-4c5d-9812-ad348e06778d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:25.579860 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7ba5b06b-a677-4c5d-9812-ad348e06778d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:25.715081 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7ba5b06b-a677-4c5d-9812-ad348e06778d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:25.723984 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7ba5b06b-a677-4c5d-9812-ad348e06778d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.158532 Sep 05 17:45:25.724636 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1351/2847] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:25 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:26.747994 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-28e01e6a-1f23-49e2-b48e-c3f1a36e43d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:26.748634 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-28e01e6a-1f23-49e2-b48e-c3f1a36e43d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:26.755515 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28e01e6a-1f23-49e2-b48e-c3f1a36e43d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:26.756096 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28e01e6a-1f23-49e2-b48e-c3f1a36e43d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:26.756442 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28e01e6a-1f23-49e2-b48e-c3f1a36e43d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:26.757136 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28e01e6a-1f23-49e2-b48e-c3f1a36e43d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:26.757583 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28e01e6a-1f23-49e2-b48e-c3f1a36e43d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:26.758000 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28e01e6a-1f23-49e2-b48e-c3f1a36e43d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:26.906027 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-28e01e6a-1f23-49e2-b48e-c3f1a36e43d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:26.914466 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-28e01e6a-1f23-49e2-b48e-c3f1a36e43d3 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1511 microversion: 2.1 time: 0.170377 Sep 05 17:45:26.915042 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1497/2848] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:26 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:26.938542 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-ffb1e0e0-6f44-4d25-b0c1-4cc6f27f8830 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:45:26.939115 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ffb1e0e0-6f44-4d25-b0c1-4cc6f27f8830 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:26.946037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ffb1e0e0-6f44-4d25-b0c1-4cc6f27f8830 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:26.946505 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ffb1e0e0-6f44-4d25-b0c1-4cc6f27f8830 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:26.946929 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ffb1e0e0-6f44-4d25-b0c1-4cc6f27f8830 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:26.947592 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ffb1e0e0-6f44-4d25-b0c1-4cc6f27f8830 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:26.948033 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ffb1e0e0-6f44-4d25-b0c1-4cc6f27f8830 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:26.948474 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-ffb1e0e0-6f44-4d25-b0c1-4cc6f27f8830 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:26.998962 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-ffb1e0e0-6f44-4d25-b0c1-4cc6f27f8830 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120733) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 05 17:45:27.076523 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ffb1e0e0-6f44-4d25-b0c1-4cc6f27f8830 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [e9df7650-873c-4ceb-beb3-16832e466062] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 05 17:45:28.086232 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [None req-ffb1e0e0-6f44-4d25-b0c1-4cc6f27f8830 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [e9df7650-873c-4ceb-beb3-16832e466062] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 42702. Sep 05 17:45:28.090946 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-ffb1e0e0-6f44-4d25-b0c1-4cc6f27f8830 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "POST /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b/action" status: 202 len: 0 microversion: 2.1 time: 1.156621 Sep 05 17:45:28.091751 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1352/2849] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Sep 5 17:45:26 2022] POST /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b/action => generated 0 bytes in 1158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 17:45:28.100950 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4daee38f-a8d7-4ebd-9167-4860f3c749b1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:28.101582 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4daee38f-a8d7-4ebd-9167-4860f3c749b1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:28.108065 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4daee38f-a8d7-4ebd-9167-4860f3c749b1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:28.108587 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4daee38f-a8d7-4ebd-9167-4860f3c749b1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:28.109013 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4daee38f-a8d7-4ebd-9167-4860f3c749b1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:28.109689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4daee38f-a8d7-4ebd-9167-4860f3c749b1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:28.110134 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4daee38f-a8d7-4ebd-9167-4860f3c749b1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:28.110711 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4daee38f-a8d7-4ebd-9167-4860f3c749b1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:28.285389 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4daee38f-a8d7-4ebd-9167-4860f3c749b1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:28.293857 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4daee38f-a8d7-4ebd-9167-4860f3c749b1 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1519 microversion: 2.1 time: 0.196730 Sep 05 17:45:28.294706 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1498/2850] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:28 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:29.318754 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-9919ec36-5620-4d32-b8b9-78d0ed2d4358 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:29.319364 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-9919ec36-5620-4d32-b8b9-78d0ed2d4358 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:29.326554 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9919ec36-5620-4d32-b8b9-78d0ed2d4358 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:29.327032 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9919ec36-5620-4d32-b8b9-78d0ed2d4358 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:29.327481 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9919ec36-5620-4d32-b8b9-78d0ed2d4358 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:29.328142 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9919ec36-5620-4d32-b8b9-78d0ed2d4358 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:29.328658 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9919ec36-5620-4d32-b8b9-78d0ed2d4358 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:29.329075 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-9919ec36-5620-4d32-b8b9-78d0ed2d4358 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:29.465309 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-9919ec36-5620-4d32-b8b9-78d0ed2d4358 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:29.475832 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-9919ec36-5620-4d32-b8b9-78d0ed2d4358 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1521 microversion: 2.1 time: 0.161419 Sep 05 17:45:29.476643 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1353/2851] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:29 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:29.657068 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-e0bb306f-9d11-4038-9c52-b4695210d6e0 req-f0fc5dd3-f62d-4140-ab19-00cfa5ebfd01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef497e1-25c6-4e3b-930a-4ed31e1b956b", "name": "network-vif-unplugged", "status": "completed", "tag": "47d789fe-1b05-46cd-b623-afedca04c82c"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:45:29.667664 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-e0bb306f-9d11-4038-9c52-b4695210d6e0 req-f0fc5dd3-f62d-4140-ab19-00cfa5ebfd01 service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:29.668211 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-e0bb306f-9d11-4038-9c52-b4695210d6e0 req-f0fc5dd3-f62d-4140-ab19-00cfa5ebfd01 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:29.668672 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-e0bb306f-9d11-4038-9c52-b4695210d6e0 req-f0fc5dd3-f62d-4140-ab19-00cfa5ebfd01 service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:29.680674 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.compute.server_external_events [req-e0bb306f-9d11-4038-9c52-b4695210d6e0 req-f0fc5dd3-f62d-4140-ab19-00cfa5ebfd01 service nova] Unable to find a host for instance 8ef497e1-25c6-4e3b-930a-4ed31e1b956b. Dropping event network-vif-unplugged {{(pid=120731) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 05 17:45:29.681556 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-e0bb306f-9d11-4038-9c52-b4695210d6e0 req-f0fc5dd3-f62d-4140-ab19-00cfa5ebfd01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030951 Sep 05 17:45:29.682184 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1499/2852] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 05 17:45:30.502952 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-8de65fe1-6c1d-48cc-ad10-8c626974c9cc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:30.503549 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-8de65fe1-6c1d-48cc-ad10-8c626974c9cc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:30.510263 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8de65fe1-6c1d-48cc-ad10-8c626974c9cc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:30.510738 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8de65fe1-6c1d-48cc-ad10-8c626974c9cc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:30.511166 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8de65fe1-6c1d-48cc-ad10-8c626974c9cc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:30.511844 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8de65fe1-6c1d-48cc-ad10-8c626974c9cc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:30.512328 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8de65fe1-6c1d-48cc-ad10-8c626974c9cc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:30.512746 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-8de65fe1-6c1d-48cc-ad10-8c626974c9cc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:30.718447 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-8de65fe1-6c1d-48cc-ad10-8c626974c9cc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:30.726920 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-8de65fe1-6c1d-48cc-ad10-8c626974c9cc tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1577 microversion: 2.1 time: 0.228207 Sep 05 17:45:30.727510 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1354/2853] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:30 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:31.749597 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5a2e7d71-fc17-4e79-b065-55fdfc24576d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:31.750572 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5a2e7d71-fc17-4e79-b065-55fdfc24576d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:31.758673 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a2e7d71-fc17-4e79-b065-55fdfc24576d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:31.759225 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a2e7d71-fc17-4e79-b065-55fdfc24576d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:31.759703 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a2e7d71-fc17-4e79-b065-55fdfc24576d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:31.760517 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a2e7d71-fc17-4e79-b065-55fdfc24576d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:31.761039 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a2e7d71-fc17-4e79-b065-55fdfc24576d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:31.761527 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a2e7d71-fc17-4e79-b065-55fdfc24576d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:31.910575 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5a2e7d71-fc17-4e79-b065-55fdfc24576d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:31.920304 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5a2e7d71-fc17-4e79-b065-55fdfc24576d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1577 microversion: 2.1 time: 0.174502 Sep 05 17:45:31.921220 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1500/2854] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:31 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:32.948850 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e2dfade7-8d48-4319-be14-96ce46814a04 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:32.949541 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e2dfade7-8d48-4319-be14-96ce46814a04 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:32.956629 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e2dfade7-8d48-4319-be14-96ce46814a04 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:32.957274 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e2dfade7-8d48-4319-be14-96ce46814a04 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:32.957810 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e2dfade7-8d48-4319-be14-96ce46814a04 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:32.958742 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e2dfade7-8d48-4319-be14-96ce46814a04 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:32.959196 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e2dfade7-8d48-4319-be14-96ce46814a04 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:32.959611 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e2dfade7-8d48-4319-be14-96ce46814a04 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:33.098866 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-e2dfade7-8d48-4319-be14-96ce46814a04 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:33.107504 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e2dfade7-8d48-4319-be14-96ce46814a04 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1577 microversion: 2.1 time: 0.162699 Sep 05 17:45:33.108302 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1355/2855] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:32 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:34.135312 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5477ddb6-5c10-4571-91c5-99ba93cf50df tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:34.136644 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5477ddb6-5c10-4571-91c5-99ba93cf50df tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:34.140447 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=29 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:45:34.149627 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5477ddb6-5c10-4571-91c5-99ba93cf50df tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:34.150385 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5477ddb6-5c10-4571-91c5-99ba93cf50df tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:34.151133 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5477ddb6-5c10-4571-91c5-99ba93cf50df tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:34.152279 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5477ddb6-5c10-4571-91c5-99ba93cf50df tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:34.153011 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5477ddb6-5c10-4571-91c5-99ba93cf50df tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:34.153709 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5477ddb6-5c10-4571-91c5-99ba93cf50df tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:34.158626 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:45:34.293850 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5477ddb6-5c10-4571-91c5-99ba93cf50df tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:34.302135 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5477ddb6-5c10-4571-91c5-99ba93cf50df tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1577 microversion: 2.1 time: 0.173494 Sep 05 17:45:34.302977 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1501/2856] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:34 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:35.328644 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-7af84e7a-6f49-4116-a578-4e1ae24d1cef tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:35.329246 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-7af84e7a-6f49-4116-a578-4e1ae24d1cef tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:35.331928 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:45:35.338068 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7af84e7a-6f49-4116-a578-4e1ae24d1cef tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:35.338551 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7af84e7a-6f49-4116-a578-4e1ae24d1cef tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:35.338985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7af84e7a-6f49-4116-a578-4e1ae24d1cef tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:35.339686 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7af84e7a-6f49-4116-a578-4e1ae24d1cef tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:35.340143 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7af84e7a-6f49-4116-a578-4e1ae24d1cef tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:35.340584 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-7af84e7a-6f49-4116-a578-4e1ae24d1cef tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:35.343943 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:45:35.483497 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-7af84e7a-6f49-4116-a578-4e1ae24d1cef tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:35.495320 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-7af84e7a-6f49-4116-a578-4e1ae24d1cef tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1577 microversion: 2.1 time: 0.173232 Sep 05 17:45:35.496102 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1356/2857] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:35 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:35.716644 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-a6114ce5-ea77-42ca-b422-cc42cd65da9d req-d1c5c383-1f4d-490d-8996-ae2d7a4ac5dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef497e1-25c6-4e3b-930a-4ed31e1b956b", "name": "network-vif-plugged", "status": "completed", "tag": "47d789fe-1b05-46cd-b623-afedca04c82c"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:45:35.727875 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-a6114ce5-ea77-42ca-b422-cc42cd65da9d req-d1c5c383-1f4d-490d-8996-ae2d7a4ac5dd service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:35.728380 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-a6114ce5-ea77-42ca-b422-cc42cd65da9d req-d1c5c383-1f4d-490d-8996-ae2d7a4ac5dd service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:35.728905 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-a6114ce5-ea77-42ca-b422-cc42cd65da9d req-d1c5c383-1f4d-490d-8996-ae2d7a4ac5dd service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:35.741988 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-a6114ce5-ea77-42ca-b422-cc42cd65da9d req-d1c5c383-1f4d-490d-8996-ae2d7a4ac5dd service nova] Creating event network-vif-plugged:47d789fe-1b05-46cd-b623-afedca04c82c for instance 8ef497e1-25c6-4e3b-930a-4ed31e1b956b on hv-cinder-85596 Sep 05 17:45:35.747568 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-a6114ce5-ea77-42ca-b422-cc42cd65da9d req-d1c5c383-1f4d-490d-8996-ae2d7a4ac5dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035000 Sep 05 17:45:35.748200 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1502/2858] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:45:36.523594 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-f0fbdb46-ccaa-481f-9827-3c74fe603c44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:36.524677 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-f0fbdb46-ccaa-481f-9827-3c74fe603c44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:36.535753 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0fbdb46-ccaa-481f-9827-3c74fe603c44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:36.536637 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0fbdb46-ccaa-481f-9827-3c74fe603c44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:36.537086 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0fbdb46-ccaa-481f-9827-3c74fe603c44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:36.537813 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0fbdb46-ccaa-481f-9827-3c74fe603c44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:36.538267 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0fbdb46-ccaa-481f-9827-3c74fe603c44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:36.538691 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-f0fbdb46-ccaa-481f-9827-3c74fe603c44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:36.683665 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-f0fbdb46-ccaa-481f-9827-3c74fe603c44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:36.695786 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-f0fbdb46-ccaa-481f-9827-3c74fe603c44 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1577 microversion: 2.1 time: 0.178612 Sep 05 17:45:36.696615 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1357/2859] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:36 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:45:37.727004 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c0b55d13-505e-41af-b92d-4ae39e885394 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:45:37.727698 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c0b55d13-505e-41af-b92d-4ae39e885394 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:45:37.734434 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0b55d13-505e-41af-b92d-4ae39e885394 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:37.734920 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0b55d13-505e-41af-b92d-4ae39e885394 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:37.735344 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0b55d13-505e-41af-b92d-4ae39e885394 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:37.736021 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0b55d13-505e-41af-b92d-4ae39e885394 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:45:37.736516 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0b55d13-505e-41af-b92d-4ae39e885394 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:45:37.736944 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0b55d13-505e-41af-b92d-4ae39e885394 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:45:37.879261 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c0b55d13-505e-41af-b92d-4ae39e885394 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:45:37.887864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c0b55d13-505e-41af-b92d-4ae39e885394 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1564 microversion: 2.1 time: 0.166013 Sep 05 17:45:37.888473 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1503/2860] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:45:37 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:47:14.965529 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_api:SELECT=3 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:47:14.966284 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG dbcounter [-] [120733] Writing DB stats nova_cell1:SELECT=11 {{(pid=120733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:47:14.969908 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=5 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:47:14.970714 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=13 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 17:47:14.971736 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:47:14.971864 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: Mon Sep 5 17:47:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Sep 05 17:47:14.974442 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 17:47:14.974566 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Mon Sep 5 17:47:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b (ip 10.222.0.23) !!! Sep 05 17:47:14.980626 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-e26dcbee-2f3b-496d-b0eb-4ee233f408c2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:47:14.981128 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e26dcbee-2f3b-496d-b0eb-4ee233f408c2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:47:15.006766 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e26dcbee-2f3b-496d-b0eb-4ee233f408c2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:47:15.007244 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e26dcbee-2f3b-496d-b0eb-4ee233f408c2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:47:15.007841 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e26dcbee-2f3b-496d-b0eb-4ee233f408c2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:47:15.008579 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e26dcbee-2f3b-496d-b0eb-4ee233f408c2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:47:15.009621 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e26dcbee-2f3b-496d-b0eb-4ee233f408c2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:47:15.010045 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-e26dcbee-2f3b-496d-b0eb-4ee233f408c2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:47:15.040293 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-e26dcbee-2f3b-496d-b0eb-4ee233f408c2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Going to try to terminate instance {{(pid=120733) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 17:47:15.133037 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-e26dcbee-2f3b-496d-b0eb-4ee233f408c2 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 204 len: 0 microversion: 2.1 time: 0.168863 Sep 05 17:47:15.134058 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1358/2861] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Sep 5 17:47:14 2022] DELETE /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 17:47:15.141119 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-9e2afb03-2fcd-44c2-ba55-8c750cae228e req-a5dc3869-d9b2-44df-bdcb-9f8299bd4f3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ef497e1-25c6-4e3b-930a-4ed31e1b956b", "tag": "47d789fe-1b05-46cd-b623-afedca04c82c"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:47:15.142985 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-5f35bf9a-350a-44d7-9518-2211d21dc28d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:47:15.143684 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-5f35bf9a-350a-44d7-9518-2211d21dc28d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:47:15.150371 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f35bf9a-350a-44d7-9518-2211d21dc28d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:47:15.150880 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f35bf9a-350a-44d7-9518-2211d21dc28d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:47:15.151334 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f35bf9a-350a-44d7-9518-2211d21dc28d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:47:15.152036 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f35bf9a-350a-44d7-9518-2211d21dc28d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:47:15.152519 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f35bf9a-350a-44d7-9518-2211d21dc28d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:47:15.152942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-5f35bf9a-350a-44d7-9518-2211d21dc28d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:47:15.153909 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-9e2afb03-2fcd-44c2-ba55-8c750cae228e req-a5dc3869-d9b2-44df-bdcb-9f8299bd4f3b service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:47:15.154385 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-9e2afb03-2fcd-44c2-ba55-8c750cae228e req-a5dc3869-d9b2-44df-bdcb-9f8299bd4f3b service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:47:15.154837 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-9e2afb03-2fcd-44c2-ba55-8c750cae228e req-a5dc3869-d9b2-44df-bdcb-9f8299bd4f3b service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:47:15.167078 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-9e2afb03-2fcd-44c2-ba55-8c750cae228e req-a5dc3869-d9b2-44df-bdcb-9f8299bd4f3b service nova] Creating event network-changed:47d789fe-1b05-46cd-b623-afedca04c82c for instance 8ef497e1-25c6-4e3b-930a-4ed31e1b956b on hv-cinder-85596 Sep 05 17:47:15.172505 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-9e2afb03-2fcd-44c2-ba55-8c750cae228e req-a5dc3869-d9b2-44df-bdcb-9f8299bd4f3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204557 Sep 05 17:47:15.173749 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1504/2862] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 17:47:15.290819 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.policy [None req-5f35bf9a-350a-44d7-9518-2211d21dc28d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120733) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:47:15.298625 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-5f35bf9a-350a-44d7-9518-2211d21dc28d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.160240 Sep 05 17:47:15.299203 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1359/2863] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:47:15 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 17:47:16.324197 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-eb05daab-8254-4cc6-a6ac-48f365527367 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:47:16.324925 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-eb05daab-8254-4cc6-a6ac-48f365527367 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:47:16.332176 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb05daab-8254-4cc6-a6ac-48f365527367 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:47:16.332689 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb05daab-8254-4cc6-a6ac-48f365527367 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:47:16.333122 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb05daab-8254-4cc6-a6ac-48f365527367 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:47:16.333874 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb05daab-8254-4cc6-a6ac-48f365527367 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:47:16.334694 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb05daab-8254-4cc6-a6ac-48f365527367 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:47:16.335191 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb05daab-8254-4cc6-a6ac-48f365527367 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:47:16.537074 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eb05daab-8254-4cc6-a6ac-48f365527367 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:47:16.547800 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-eb05daab-8254-4cc6-a6ac-48f365527367 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1570 microversion: 2.1 time: 0.228460 Sep 05 17:47:16.548413 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1505/2864] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:47:16 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1570 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:47:17.461230 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [req-19b6ca95-50c9-4309-9eaf-44a3e6e43ac6 req-2cbdaa5e-e99e-4ed1-adee-faca4cf6db2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef497e1-25c6-4e3b-930a-4ed31e1b956b", "name": "network-vif-deleted", "tag": "47d789fe-1b05-46cd-b623-afedca04c82c"}]} {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 17:47:17.474001 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-19b6ca95-50c9-4309-9eaf-44a3e6e43ac6 req-2cbdaa5e-e99e-4ed1-adee-faca4cf6db2d service nova] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:47:17.474383 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-19b6ca95-50c9-4309-9eaf-44a3e6e43ac6 req-2cbdaa5e-e99e-4ed1-adee-faca4cf6db2d service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:47:17.474802 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [req-19b6ca95-50c9-4309-9eaf-44a3e6e43ac6 req-2cbdaa5e-e99e-4ed1-adee-faca4cf6db2d service nova] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:47:17.487165 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.compute.server_external_events [req-19b6ca95-50c9-4309-9eaf-44a3e6e43ac6 req-2cbdaa5e-e99e-4ed1-adee-faca4cf6db2d service nova] Creating event network-vif-deleted:47d789fe-1b05-46cd-b623-afedca04c82c for instance 8ef497e1-25c6-4e3b-930a-4ed31e1b956b on hv-cinder-85596 Sep 05 17:47:17.492408 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [req-19b6ca95-50c9-4309-9eaf-44a3e6e43ac6 req-2cbdaa5e-e99e-4ed1-adee-faca4cf6db2d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035365 Sep 05 17:47:17.492983 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1360/2865] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Sep 5 17:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 17:47:17.571349 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-79758405-4dc1-4b88-aa02-af10004f1c81 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:47:17.572025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-79758405-4dc1-4b88-aa02-af10004f1c81 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:47:17.578525 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79758405-4dc1-4b88-aa02-af10004f1c81 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:47:17.579012 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79758405-4dc1-4b88-aa02-af10004f1c81 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:47:17.579401 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79758405-4dc1-4b88-aa02-af10004f1c81 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:47:17.580127 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79758405-4dc1-4b88-aa02-af10004f1c81 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:47:17.580604 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79758405-4dc1-4b88-aa02-af10004f1c81 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:47:17.581023 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79758405-4dc1-4b88-aa02-af10004f1c81 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:47:17.643655 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-79758405-4dc1-4b88-aa02-af10004f1c81 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a8514ae867426c80200fbc90435c6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '668b8711b6fd422b9e58f852c1801569', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 17:47:17.651766 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-79758405-4dc1-4b88-aa02-af10004f1c81 tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 200 len: 1219 microversion: 2.1 time: 0.084423 Sep 05 17:47:17.652361 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1506/2866] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:47:17 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 17:47:18.679330 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2340bb29-15c4-450b-99e0-2974047b710a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '>' {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:47:18.679968 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.compute.api [None req-2340bb29-15c4-450b-99e0-2974047b710a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] [instance: 8ef497e1-25c6-4e3b-930a-4ed31e1b956b] Fetching instance by UUID {{(pid=120733) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 17:47:18.687239 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2340bb29-15c4-450b-99e0-2974047b710a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:47:18.687757 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2340bb29-15c4-450b-99e0-2974047b710a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:47:18.688261 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2340bb29-15c4-450b-99e0-2974047b710a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:47:18.689007 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2340bb29-15c4-450b-99e0-2974047b710a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Acquiring lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 17:47:18.689501 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2340bb29-15c4-450b-99e0-2974047b710a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 17:47:18.689955 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG oslo_concurrency.lockutils [None req-2340bb29-15c4-450b-99e0-2974047b710a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Lock "58a28fd3-8685-4f6c-b4e5-aee03c36263b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120733) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 17:47:18.705109 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.wsgi [None req-2340bb29-15c4-450b-99e0-2974047b710a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] HTTP exception thrown: Instance 8ef497e1-25c6-4e3b-930a-4ed31e1b956b could not be found. Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2340bb29-15c4-450b-99e0-2974047b710a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Request method failure captured: Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: request: GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b HTTP/1.1 Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept: application/json Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Accept-Encoding: identity Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Connection: close Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Length: 0 Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Content-Type: application/json Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Host: 10.222.0.23 Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: Openstack-System-Scope: None Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: User-Agent: python-urllib3/1.26.12 Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Auth-Token: gAAAAABjFjTm_UMzLX5OUeb-V_O8itugOspeEkKnsR0DILJuEFrIb1zaEa3R69T-JbyFZ-v3Ikkde-uz5SDfiJKHAy90-QcmCkZYhN9Lzr2te6_pqpiYZxZZ7H4dCZ76S4EvaHOiT3tR0CaMl2TueMYeF-scIvfNs_RQ3g7JJX4_zwVy-yhDfZk Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Id: None Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Domain-Name: None Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Identity-Status: Confirmed Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Is-Admin-Project: True Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Id: default Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Domain-Name: Default Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Id: 668b8711b6fd422b9e58f852c1801569 Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Project-Name: tempest-TestShelveInstance-859074114 Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Role: member,reader Sep 05 17:47:18.706942 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Roles: member,reader Sep 05 17:47:18.708231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/668b8711b6fd422b9e58f852c1801569"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/668b8711b6fd422b9e58f852c1801569"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/668b8711b6fd422b9e58f852c1801569"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_668b8711b6fd422b9e58f852c1801569"}]}] Sep 05 17:47:18.708231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant: tempest-TestShelveInstance-859074114 Sep 05 17:47:18.708231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Id: 668b8711b6fd422b9e58f852c1801569 Sep 05 17:47:18.708231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-Tenant-Name: tempest-TestShelveInstance-859074114 Sep 05 17:47:18.708231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User: tempest-TestShelveInstance-859074114-project Sep 05 17:47:18.708231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Id: default Sep 05 17:47:18.708231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Domain-Name: Default Sep 05 17:47:18.708231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Id: f0a8514ae867426c80200fbc90435c6d Sep 05 17:47:18.708231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: X-User-Name: tempest-TestShelveInstance-859074114-project Sep 05 17:47:18.708231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: method: > Sep 05 17:47:18.708231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: exception: Instance 8ef497e1-25c6-4e3b-930a-4ed31e1b956b could not be found. Sep 05 17:47:18.708231 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: action_args: {'id': '8ef497e1-25c6-4e3b-930a-4ed31e1b956b'} Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: {{(pid=120733) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ef497e1-25c6-4e3b-930a-4ed31e1b956b could not be found. Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 17:47:18.708979 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ef497e1-25c6-4e3b-930a-4ed31e1b956b could not be found. Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ef497e1-25c6-4e3b-930a-4ed31e1b956b could not be found. Sep 05 17:47:18.710631 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: ERROR nova.api.openstack.wsgi Sep 05 17:47:18.711856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: DEBUG nova.api.openstack.wsgi [None req-2340bb29-15c4-450b-99e0-2974047b710a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Returning 404 to user: Instance 8ef497e1-25c6-4e3b-930a-4ed31e1b956b could not be found. {{(pid=120733) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 17:47:18.711856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: INFO nova.api.openstack.requestlog [None req-2340bb29-15c4-450b-99e0-2974047b710a tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b" status: 404 len: 111 microversion: 2.1 time: 0.035465 Sep 05 17:47:18.711856 dv-cinder-855964-1-iscsi devstack@n-api.service[120733]: [pid: 120733|app: 0|req: 1361/2867] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Sep 5 17:47:18 2022] GET /compute/v2.1/servers/8ef497e1-25c6-4e3b-930a-4ed31e1b956b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 17:47:18.886025 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9602691f-10d4-4754-b12c-dd47be84033d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] Calling method '.version_select at 0x7f1d3ac4b310>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 17:47:18.912852 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9602691f-10d4-4754-b12c-dd47be84033d tempest-TestShelveInstance-859074114 tempest-TestShelveInstance-859074114-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-925738388" status: 202 len: 0 microversion: 2.1 time: 0.030711 Sep 05 17:47:18.913764 dv-cinder-855964-1-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1507/2868] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Sep 5 17:47:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-925738388 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)